2022-09-20T20:02:51.348 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-20T20:02:51.349 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} --verbose --name pdonnell-2022-09-20_19:41:25-fs:functional-wip-pdonnell-testing-20220920.151129-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2022-09-20_19:41:25-fs:functional-wip-pdonnell-testing-20220920.151129-distro-default-smithi/7039474 --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2022-09-20_19:41:25-fs:functional-wip-pdonnell-testing-20220920.151129-distro-default-smithi/7039474/orig.config.yaml 2022-09-20T20:02:51.406 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-09-20T20:02:51.490 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2022-09-20_19:41:25-fs:functional-wip-pdonnell-testing-20220920.151129-distro-default-smithi/7039474 branch: wip-pdonnell-testing-20220920.151129 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} email: pdonnell@redhat.com first_in_suite: false job_id: '7039474' kernel: client: sha1: distro kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2022-09-20_19:41:25-fs:functional-wip-pdonnell-testing-20220920.151129-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-pdonnell-testing-20220920.151129 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - bad backtrace - object missing on disk - error reading table object - error reading sessionmap - unmatched fragstat - unmatched rstat - was unreadable, recreating it now - Scrub error on inode - Metadata damage detected - MDS_FAILED - MDS_DAMAGE sha1: ada1013c357729fc3bf91fdc0bbe1d411f5af166 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ada1013c357729fc3bf91fdc0bbe1d411f5af166 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20220920.151129 sha1: 7874f3907d0b2e2027e668918a6854269060504f owner: scheduled_pdonnell@teuthology priority: 50 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: ada1013c357729fc3bf91fdc0bbe1d411f5af166 sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-pdonnell-testing-20220920.151129 suite_path: /home/teuthworker/src/github.com_batrick_ceph_7874f3907d0b2e2027e668918a6854269060504f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 7874f3907d0b2e2027e668918a6854269060504f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLgOG79UlSPojUvsXMAdJKtxnK8pUkfrR6/98kX770g/U15z4vI5dh/pxom/CGgt/4zv7ThmAm1HzeyodrPcmqAP8vUEtVAJBfY2fH61uKwXADHCLUlRyaQo99MoikBbln1s0W3I/CJgObOY4iJWic2FMmft25BqtJqX5J3Mgv2Y2/vynyAUWcyIumgCGYR+r6LeiMK1gPUcRF6Aea06sDcGZK63dhFszd0XJlh0y9tasYIrRZriiS55m4QWv0EMLaUsInflrrsxOEQg+Hgq7AlrbX7255tFZ9FCy4gOBhdjIRf2GRIW8eMRCmcyL8cN8QH3LqGVMuseGe2Yqwz9JlIth3Lm7pPVnct+HcFiOiGGKmIZ01fcvs6lsfwzBzWixND1NL1aGicCw1nCtUW5PgBB5IcgDsWGgAAS6BWt1/FAKgemQbpMTpQN/j6oQFVNKIUIlRupCEqslOVJcV7PQUuonRMQDFBjgNmZb6tFN1ARU6xg/36pyWC1BHvLt4eQ8= smithi055.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0ybvTUkYqxKf7p+YrbwPIFOMzGEFxu7x4d8q7BJsgWqDJGjzDUK7ULkwNgPxoumVBHwH6co8Cv5+oZ400ZvfHDKwt46H00/8mrKtQ6woEhXka6zOFtnDa2IFa9Y3EpQMOumhroSPRw6ouibdwHrodYtPPY69+y1R6AqT6V2JHK1JTs6Q0Slp7LLODIqoI1fRn/E00INXdCreq9dzxFKUrdmybyVuczzF1k6sw9i/6BjF4KWd4kVsr5+iBgFlGQ/y+ndwFvJ0Y4UVqIi/9ulFiq910+xCneV5T2/R2jb5hqfNfPCHZ8BODgWmg+2TnSQft0tpEXS/TLUw3IFiXGwYUNIYMlJLcHX+534OnFqi6Su/H+gz4uuC8liFSO0HJuAoDqlt6/S8qQQQI+2PPPFtef4PobshJb3SmxKBOBbUTQdKxgduLPFtw4PX8BAIaCtaylMg1CvthvroU14KSFVGtrHSzzcsUEUW589IkxwkAhRBaShmv6gOxZw9p3zA0cnk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_recovery_pool teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b58f2c18636eb10faa77ed3614abd00cb85dfc2c timestamp: 2022-09-20_19:41:25 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.20382 2022-09-20T20:02:51.491 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_7874f3907d0b2e2027e668918a6854269060504f/qa; will attempt to use it 2022-09-20T20:02:51.491 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_7874f3907d0b2e2027e668918a6854269060504f/qa/tasks 2022-09-20T20:02:51.492 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-09-20T20:02:51.495 INFO:teuthology.task.internal:Checking packages... 2022-09-20T20:02:51.520 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'ada1013c357729fc3bf91fdc0bbe1d411f5af166' 2022-09-20T20:02:51.521 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-09-20T20:02:51.522 INFO:teuthology.packaging:ref: None 2022-09-20T20:02:51.522 INFO:teuthology.packaging:tag: None 2022-09-20T20:02:51.523 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20220920.151129 2022-09-20T20:02:51.523 INFO:teuthology.packaging:sha1: ada1013c357729fc3bf91fdc0bbe1d411f5af166 2022-09-20T20:02:51.523 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20220920.151129 2022-09-20T20:02:51.695 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-15134.gada1013c 2022-09-20T20:02:51.696 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-09-20T20:02:51.703 INFO:teuthology.task.internal:no buildpackages task found 2022-09-20T20:02:51.703 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-09-20T20:02:51.721 INFO:teuthology.task.internal:Saving configuration 2022-09-20T20:02:51.740 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-09-20T20:02:51.746 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-20T20:02:51.770 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2022-09-20_19:41:25-fs:functional-wip-pdonnell-testing-20220920.151129-distro-default-smithi/7039474', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-09-20 19:58:00.474487', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHb498xzg8cU3Arrid7d/vULMxkncM5pp7ifJa5YI2cEI+swRD6PV+W3w3k+3OqIzCgJUGpRiKC5FfYafSlvtDM='} 2022-09-20T20:02:51.793 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2022-09-20_19:41:25-fs:functional-wip-pdonnell-testing-20220920.151129-distro-default-smithi/7039474', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-09-20 19:58:00.473008', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOgORCGSJ1Jy+pmSuaGV277acfNwodFQQmaAhrJyHi4W+bereAW212EC/UzH6VICTdJhk0fgCGSYToyIlfIb41Q='} 2022-09-20T20:02:51.794 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-09-20T20:02:51.800 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2022-09-20T20:02:51.801 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2022-09-20T20:02:51.801 INFO:teuthology.run_tasks:Running task console_log... 2022-09-20T20:02:51.878 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb787857ea0>, signals=[15]) 2022-09-20T20:02:51.880 INFO:teuthology.run_tasks:Running task internal.connect... 2022-09-20T20:02:51.889 INFO:teuthology.task.internal:Opening connections... 2022-09-20T20:02:51.890 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi008.front.sepia.ceph.com 2022-09-20T20:02:51.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-20T20:02:51.987 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi055.front.sepia.ceph.com 2022-09-20T20:02:51.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-20T20:02:52.075 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-09-20T20:02:52.082 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2022-09-20T20:02:52.105 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2022-09-20T20:02:52.105 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2022-09-20T20:02:52.165 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2022-09-20T20:02:52.166 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.6 (Ootpa)" 2022-09-20T20:02:52.166 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2022-09-20T20:02:52.166 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2022-09-20T20:02:52.167 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.6" 2022-09-20T20:02:52.167 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2022-09-20T20:02:52.167 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-09-20T20:02:52.167 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2022-09-20T20:02:52.168 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-09-20T20:02:52.168 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2022-09-20T20:02:52.168 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-09-20T20:02:52.168 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-20T20:02:52.168 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:02:52.169 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-20T20:02:52.169 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-09-20T20:02:52.169 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-09-20T20:02:52.169 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-09-20T20:02:52.170 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2022-09-20T20:02:52.192 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2022-09-20T20:02:52.215 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2022-09-20T20:02:52.216 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2022-09-20T20:02:52.276 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Red Hat Enterprise Linux" 2022-09-20T20:02:52.276 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8.6 (Ootpa)" 2022-09-20T20:02:52.276 INFO:teuthology.orchestra.run.smithi055.stdout:ID="rhel" 2022-09-20T20:02:52.277 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="fedora" 2022-09-20T20:02:52.277 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8.6" 2022-09-20T20:02:52.277 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2022-09-20T20:02:52.278 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-09-20T20:02:52.278 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2022-09-20T20:02:52.278 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-09-20T20:02:52.279 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.redhat.com/" 2022-09-20T20:02:52.279 INFO:teuthology.orchestra.run.smithi055.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-09-20T20:02:52.280 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-20T20:02:52.280 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:02:52.281 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-20T20:02:52.281 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-09-20T20:02:52.281 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-09-20T20:02:52.282 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-09-20T20:02:52.283 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2022-09-20T20:02:52.303 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-09-20T20:02:52.313 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-09-20T20:02:52.321 INFO:teuthology.task.internal:Checking for old test directory... 2022-09-20T20:02:52.322 DEBUG:teuthology.orchestra.run.smithi008:> test '!' -e /home/ubuntu/cephtest 2022-09-20T20:02:52.325 DEBUG:teuthology.orchestra.run.smithi055:> test '!' -e /home/ubuntu/cephtest 2022-09-20T20:02:52.345 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-09-20T20:02:52.351 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-09-20T20:02:52.352 DEBUG:teuthology.orchestra.run.smithi008:> test -z $(ls -A /var/lib/ceph) 2022-09-20T20:02:52.385 DEBUG:teuthology.orchestra.run.smithi055:> test -z $(ls -A /var/lib/ceph) 2022-09-20T20:02:52.413 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-09-20T20:02:52.472 INFO:teuthology.run_tasks:Running task kernel... 2022-09-20T20:02:52.486 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2022-09-20T20:02:52.487 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2022-09-20T20:02:52.487 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2022-09-20T20:02:52.488 DEBUG:teuthology.orchestra.run.smithi008:> test -f /run/.containerenv -o -f /.dockerenv 2022-09-20T20:02:52.489 DEBUG:teuthology.orchestra.run.smithi055:> test -f /run/.containerenv -o -f /.dockerenv 2022-09-20T20:02:52.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-20T20:02:52.510 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2022-09-20T20:02:52.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-20T20:02:52.512 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2022-09-20T20:02:52.569 INFO:teuthology.orchestra.run.smithi008.stdout:4.18.0-372.9.1.el8.x86_64 2022-09-20T20:02:52.570 INFO:teuthology.task.kernel:Running kernel on smithi008: 4.18.0-372.9.1.el8.x86_64 2022-09-20T20:02:52.570 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum install -y kernel 2022-09-20T20:02:52.572 INFO:teuthology.orchestra.run.smithi055.stdout:4.18.0-372.9.1.el8.x86_64 2022-09-20T20:02:52.572 INFO:teuthology.task.kernel:Running kernel on smithi055: 4.18.0-372.9.1.el8.x86_64 2022-09-20T20:02:52.573 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum install -y kernel 2022-09-20T20:02:53.544 INFO:teuthology.orchestra.run.smithi055.stdout:Updating Subscription Management repositories. 2022-09-20T20:02:53.545 INFO:teuthology.orchestra.run.smithi055.stdout:Unable to read consumer identity 2022-09-20T20:02:53.603 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:02:53.604 INFO:teuthology.orchestra.run.smithi055.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-09-20T20:02:53.604 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:02:53.635 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2022-09-20T20:02:53.636 INFO:teuthology.orchestra.run.smithi008.stdout:Unable to read consumer identity 2022-09-20T20:02:53.712 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:02:53.713 INFO:teuthology.orchestra.run.smithi008.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-09-20T20:02:53.713 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:02:54.984 INFO:teuthology.orchestra.run.smithi055.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2022-09-20T20:02:55.144 INFO:teuthology.orchestra.run.smithi008.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2022-09-20T20:02:56.095 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 12 MB/s | 13 MB 00:01 2022-09-20T20:02:56.251 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 12 MB/s | 13 MB 00:01 2022-09-20T20:02:59.143 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 405 kB/s | 24 kB 00:00 2022-09-20T20:02:59.286 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 401 kB/s | 24 kB 00:00 2022-09-20T20:02:59.829 INFO:teuthology.orchestra.run.smithi055.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2022-09-20T20:02:59.879 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2022-09-20T20:02:59.880 INFO:teuthology.orchestra.run.smithi055.stdout:Nothing to do. 2022-09-20T20:02:59.880 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2022-09-20T20:02:59.964 INFO:teuthology.orchestra.run.smithi008.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2022-09-20T20:03:00.002 DEBUG:teuthology.orchestra.run.smithi055:> echo no | sudo yum reinstall kernel || true 2022-09-20T20:03:00.018 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2022-09-20T20:03:00.019 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2022-09-20T20:03:00.019 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2022-09-20T20:03:00.153 DEBUG:teuthology.orchestra.run.smithi008:> echo no | sudo yum reinstall kernel || true 2022-09-20T20:03:00.393 INFO:teuthology.orchestra.run.smithi055.stdout:Updating Subscription Management repositories. 2022-09-20T20:03:00.393 INFO:teuthology.orchestra.run.smithi055.stdout:Unable to read consumer identity 2022-09-20T20:03:00.434 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:03:00.434 INFO:teuthology.orchestra.run.smithi055.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-09-20T20:03:00.434 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:03:00.502 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2022-09-20T20:03:00.503 INFO:teuthology.orchestra.run.smithi008.stdout:Unable to read consumer identity 2022-09-20T20:03:00.540 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:03:00.540 INFO:teuthology.orchestra.run.smithi008.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-09-20T20:03:00.541 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:03:00.676 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:00:01 ago on Tue 20 Sep 2022 08:02:59 PM UTC. 2022-09-20T20:03:00.719 INFO:teuthology.orchestra.run.smithi055.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2022-09-20T20:03:00.758 INFO:teuthology.orchestra.run.smithi055.stderr:Error: No packages marked for reinstall. 2022-09-20T20:03:00.781 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:00:01 ago on Tue 20 Sep 2022 08:02:59 PM UTC. 2022-09-20T20:03:00.804 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum reinstall -y kernel || true 2022-09-20T20:03:00.822 INFO:teuthology.orchestra.run.smithi008.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2022-09-20T20:03:00.863 INFO:teuthology.orchestra.run.smithi008.stderr:Error: No packages marked for reinstall. 2022-09-20T20:03:00.910 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum reinstall -y kernel || true 2022-09-20T20:03:01.152 INFO:teuthology.orchestra.run.smithi055.stdout:Updating Subscription Management repositories. 2022-09-20T20:03:01.153 INFO:teuthology.orchestra.run.smithi055.stdout:Unable to read consumer identity 2022-09-20T20:03:01.193 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:03:01.193 INFO:teuthology.orchestra.run.smithi055.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-09-20T20:03:01.194 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:03:01.261 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2022-09-20T20:03:01.262 INFO:teuthology.orchestra.run.smithi008.stdout:Unable to read consumer identity 2022-09-20T20:03:01.300 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:03:01.300 INFO:teuthology.orchestra.run.smithi008.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-09-20T20:03:01.300 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:03:01.428 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:00:02 ago on Tue 20 Sep 2022 08:02:59 PM UTC. 2022-09-20T20:03:01.468 INFO:teuthology.orchestra.run.smithi055.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2022-09-20T20:03:01.496 INFO:teuthology.orchestra.run.smithi055.stderr:Error: No packages marked for reinstall. 2022-09-20T20:03:01.534 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:00:02 ago on Tue 20 Sep 2022 08:02:59 PM UTC. 2022-09-20T20:03:01.543 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q kernel --last | head -n 1 2022-09-20T20:03:01.577 INFO:teuthology.orchestra.run.smithi008.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2022-09-20T20:03:01.610 INFO:teuthology.orchestra.run.smithi008.stderr:Error: No packages marked for reinstall. 2022-09-20T20:03:01.624 INFO:teuthology.orchestra.run.smithi055.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2022-09-20T20:03:01.626 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2022-09-20T20:03:01.626 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-09-20T20:03:01.627 DEBUG:teuthology.parallel:result is None 2022-09-20T20:03:01.658 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q kernel --last | head -n 1 2022-09-20T20:03:01.740 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2022-09-20T20:03:01.742 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2022-09-20T20:03:01.742 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-09-20T20:03:01.743 DEBUG:teuthology.parallel:result is None 2022-09-20T20:03:01.743 INFO:teuthology.run_tasks:Running task internal.base... 2022-09-20T20:03:01.751 INFO:teuthology.task.internal:Creating test directory... 2022-09-20T20:03:01.751 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-09-20T20:03:01.754 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-09-20T20:03:01.772 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-09-20T20:03:01.780 INFO:teuthology.run_tasks:Running task internal.archive... 2022-09-20T20:03:01.793 INFO:teuthology.task.internal:Creating archive directory... 2022-09-20T20:03:01.793 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-09-20T20:03:01.812 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-09-20T20:03:01.848 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-09-20T20:03:01.856 INFO:teuthology.task.internal:Enabling coredump saving... 2022-09-20T20:03:01.856 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-09-20T20:03:01.885 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-09-20T20:03:01.921 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-20T20:03:01.924 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-20T20:03:01.933 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-20T20:03:01.937 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-20T20:03:01.938 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-09-20T20:03:01.945 INFO:teuthology.task.internal:Configuring sudo... 2022-09-20T20:03:01.946 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-09-20T20:03:01.977 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-09-20T20:03:02.006 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-09-20T20:03:02.017 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-09-20T20:03:02.017 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-09-20T20:03:02.045 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-09-20T20:03:02.063 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-20T20:03:02.142 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-20T20:03:02.235 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-20T20:03:02.284 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-20T20:03:02.329 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:03:02.330 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-09-20T20:03:02.398 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-20T20:03:02.442 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-20T20:03:02.501 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-20T20:03:02.584 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-20T20:03:02.628 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:03:02.629 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-09-20T20:03:02.695 DEBUG:teuthology.orchestra.run.smithi008:> sudo service rsyslog restart 2022-09-20T20:03:02.698 DEBUG:teuthology.orchestra.run.smithi055:> sudo service rsyslog restart 2022-09-20T20:03:02.767 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-09-20T20:03:02.789 INFO:teuthology.orchestra.run.smithi055.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-09-20T20:03:03.243 INFO:teuthology.run_tasks:Running task internal.timer... 2022-09-20T20:03:03.252 INFO:teuthology.task.internal:Starting timer... 2022-09-20T20:03:03.252 INFO:teuthology.run_tasks:Running task pcp... 2022-09-20T20:03:03.263 INFO:teuthology.run_tasks:Running task selinux... 2022-09-20T20:03:03.278 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2022-09-20T20:03:03.279 DEBUG:teuthology.orchestra.run.smithi008:> sudo service auditd rotate 2022-09-20T20:03:03.396 INFO:teuthology.orchestra.run.smithi008.stdout:Rotating logs: 2022-09-20T20:03:03.398 DEBUG:teuthology.orchestra.run.smithi055:> sudo service auditd rotate 2022-09-20T20:03:03.461 INFO:teuthology.orchestra.run.smithi055.stdout:Rotating logs: 2022-09-20T20:03:03.464 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-09-20T20:03:03.464 DEBUG:teuthology.orchestra.run.smithi008:> /usr/sbin/getenforce 2022-09-20T20:03:03.488 INFO:teuthology.orchestra.run.smithi008.stdout:Permissive 2022-09-20T20:03:03.489 DEBUG:teuthology.orchestra.run.smithi055:> /usr/sbin/getenforce 2022-09-20T20:03:03.508 INFO:teuthology.orchestra.run.smithi055.stdout:Permissive 2022-09-20T20:03:03.508 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi008.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi055.front.sepia.ceph.com': 'permissive'} 2022-09-20T20:03:03.509 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-09-20T20:03:03.560 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-20T20:03:03.561 DEBUG:teuthology.orchestra.run.smithi055:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-09-20T20:03:03.589 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-20T20:03:03.590 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-09-20T20:03:03.591 DEBUG:teuthology.orchestra.run.smithi008:> sudo /usr/sbin/setenforce permissive 2022-09-20T20:03:03.629 DEBUG:teuthology.orchestra.run.smithi055:> sudo /usr/sbin/setenforce permissive 2022-09-20T20:03:03.659 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-09-20T20:03:03.672 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2022-09-20T20:03:03.689 INFO:teuthology.repo_utils:Fetching main from origin 2022-09-20T20:03:03.732 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main to origin/main 2022-09-20T20:03:03.759 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-09-20T20:03:03.761 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi008.front.sepia.ceph.com,smithi055.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main/cephlab.yml 2022-09-20T20:10:51.212 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi008.front.sepia.ceph.com'), Remote(name='ubuntu@smithi055.front.sepia.ceph.com')] 2022-09-20T20:10:51.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2022-09-20T20:10:51.218 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-20T20:10:51.305 DEBUG:teuthology.orchestra.run.smithi008:> true 2022-09-20T20:10:51.374 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2022-09-20T20:10:51.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-20T20:10:51.485 DEBUG:teuthology.orchestra.run.smithi055:> true 2022-09-20T20:10:51.557 INFO:teuthology.run_tasks:Running task clock... 2022-09-20T20:10:51.570 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-09-20T20:10:51.571 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-09-20T20:10:51.574 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-09-20T20:10:51.576 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-09-20T20:10:51.577 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-09-20T20:10:51.609 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-09-20T20:10:51.625 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-09-20T20:10:51.631 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-09-20T20:10:51.647 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-09-20T20:10:51.701 INFO:teuthology.orchestra.run.smithi008.stderr:sudo: ntpd: command not found 2022-09-20T20:10:51.715 INFO:teuthology.orchestra.run.smithi008.stdout:506 Cannot talk to daemon 2022-09-20T20:10:51.730 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-09-20T20:10:51.735 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: ntpd: command not found 2022-09-20T20:10:51.746 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-09-20T20:10:51.747 INFO:teuthology.orchestra.run.smithi055.stdout:506 Cannot talk to daemon 2022-09-20T20:10:51.762 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-09-20T20:10:51.777 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-09-20T20:10:51.824 INFO:teuthology.orchestra.run.smithi008.stderr:bash: ntpq: command not found 2022-09-20T20:10:51.828 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-09-20T20:10:51.829 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2022-09-20T20:10:51.829 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-20T20:10:51.830 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-20T20:10:51.830 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-20T20:10:51.831 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-20T20:10:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:bash: ntpq: command not found 2022-09-20T20:10:51.855 INFO:teuthology.orchestra.run.smithi055.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-09-20T20:10:51.855 INFO:teuthology.orchestra.run.smithi055.stdout:=============================================================================== 2022-09-20T20:10:51.856 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-20T20:10:51.856 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-20T20:10:51.856 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-20T20:10:51.856 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-20T20:10:51.857 INFO:teuthology.run_tasks:Running task install... 2022-09-20T20:10:51.866 DEBUG:teuthology.task.install:project ceph 2022-09-20T20:10:51.867 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ada1013c357729fc3bf91fdc0bbe1d411f5af166'}} 2022-09-20T20:10:51.867 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ada1013c357729fc3bf91fdc0bbe1d411f5af166'} 2022-09-20T20:10:51.867 INFO:teuthology.task.install:Using flavor: default 2022-09-20T20:10:51.874 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-09-20T20:10:51.875 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2022-09-20T20:10:51.875 DEBUG:teuthology.orchestra.run.smithi008:> sudo lsb_release -is 2022-09-20T20:10:51.919 INFO:teuthology.orchestra.run.smithi008.stdout:RedHatEnterprise 2022-09-20T20:10:51.920 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-20T20:10:51.921 DEBUG:teuthology.orchestra.run.smithi055:> sudo lsb_release -is 2022-09-20T20:10:51.922 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ada1013c357729fc3bf91fdc0bbe1d411f5af166', 'tag': None, 'wait_for_package': False} 2022-09-20T20:10:51.923 DEBUG:teuthology.orchestra.run.smithi008:> sudo lsb_release -is 2022-09-20T20:10:51.965 INFO:teuthology.orchestra.run.smithi055.stdout:RedHatEnterprise 2022-09-20T20:10:51.967 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-20T20:10:51.967 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ada1013c357729fc3bf91fdc0bbe1d411f5af166', 'tag': None, 'wait_for_package': False} 2022-09-20T20:10:51.968 DEBUG:teuthology.orchestra.run.smithi055:> sudo lsb_release -is 2022-09-20T20:10:52.003 INFO:teuthology.orchestra.run.smithi008.stdout:RedHatEnterprise 2022-09-20T20:10:52.005 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-20T20:10:52.006 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ada1013c357729fc3bf91fdc0bbe1d411f5af166 2022-09-20T20:10:52.054 INFO:teuthology.orchestra.run.smithi055.stdout:RedHatEnterprise 2022-09-20T20:10:52.055 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-20T20:10:52.056 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ada1013c357729fc3bf91fdc0bbe1d411f5af166 2022-09-20T20:10:52.270 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220920.151129/ada1013c357729fc3bf91fdc0bbe1d411f5af166/centos/8/flavors/default/ 2022-09-20T20:10:52.271 INFO:teuthology.task.install.rpm:Package version is 17.0.0-15134.gada1013c 2022-09-20T20:10:52.331 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220920.151129/ada1013c357729fc3bf91fdc0bbe1d411f5af166/centos/8/flavors/default/ 2022-09-20T20:10:52.332 INFO:teuthology.task.install.rpm:Package version is 17.0.0-15134.gada1013c 2022-09-20T20:10:52.484 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220920.151129/ada1013c357729fc3bf91fdc0bbe1d411f5af166/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220920.151129/ada1013c357729fc3bf91fdc0bbe1d411f5af166/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220920.151129/ada1013c357729fc3bf91fdc0bbe1d411f5af166/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-09-20T20:10:52.485 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:10:52.485 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-09-20T20:10:52.515 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2022-09-20T20:10:52.516 DEBUG:teuthology.orchestra.run.smithi008:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ada1013c357729fc3bf91fdc0bbe1d411f5af166/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-09-20T20:10:52.520 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220920.151129/ada1013c357729fc3bf91fdc0bbe1d411f5af166/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220920.151129/ada1013c357729fc3bf91fdc0bbe1d411f5af166/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220920.151129/ada1013c357729fc3bf91fdc0bbe1d411f5af166/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-09-20T20:10:52.521 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:10:52.521 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-09-20T20:10:52.551 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2022-09-20T20:10:52.551 DEBUG:teuthology.orchestra.run.smithi055:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ada1013c357729fc3bf91fdc0bbe1d411f5af166/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-09-20T20:10:52.587 DEBUG:teuthology.orchestra.run.smithi008:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-09-20T20:10:52.621 DEBUG:teuthology.orchestra.run.smithi055:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-09-20T20:10:52.669 DEBUG:teuthology.orchestra.run.smithi008:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-09-20T20:10:52.701 DEBUG:teuthology.orchestra.run.smithi055:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-09-20T20:10:52.737 INFO:teuthology.orchestra.run.smithi008.stdout:check_obsoletes = 1 2022-09-20T20:10:52.739 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum clean all 2022-09-20T20:10:52.768 INFO:teuthology.orchestra.run.smithi055.stdout:check_obsoletes = 1 2022-09-20T20:10:52.770 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum clean all 2022-09-20T20:10:53.129 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2022-09-20T20:10:53.161 INFO:teuthology.orchestra.run.smithi055.stdout:Updating Subscription Management repositories. 2022-09-20T20:10:53.335 INFO:teuthology.orchestra.run.smithi008.stdout:52 files removed 2022-09-20T20:10:53.368 INFO:teuthology.orchestra.run.smithi055.stdout:52 files removed 2022-09-20T20:10:53.383 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2022-09-20T20:10:53.415 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2022-09-20T20:10:53.733 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2022-09-20T20:10:53.767 INFO:teuthology.orchestra.run.smithi055.stdout:Updating Subscription Management repositories. 2022-09-20T20:10:54.485 INFO:teuthology.orchestra.run.smithi008.stdout:ceph packages for x86_64 190 kB/s | 81 kB 00:00 2022-09-20T20:10:54.918 INFO:teuthology.orchestra.run.smithi008.stdout:ceph noarch packages 24 kB/s | 9.4 kB 00:00 2022-09-20T20:10:54.922 INFO:teuthology.orchestra.run.smithi055.stdout:ceph packages for x86_64 185 kB/s | 81 kB 00:00 2022-09-20T20:10:55.362 INFO:teuthology.orchestra.run.smithi008.stdout:ceph source packages 3.6 kB/s | 1.5 kB 00:00 2022-09-20T20:10:55.490 INFO:teuthology.orchestra.run.smithi055.stdout:ceph noarch packages 18 kB/s | 9.4 kB 00:00 2022-09-20T20:10:55.663 INFO:teuthology.orchestra.run.smithi008.stdout:Copr repo for python3-asyncssh owned by ceph 12 kB/s | 3.5 kB 00:00 2022-09-20T20:10:55.874 INFO:teuthology.orchestra.run.smithi055.stdout:ceph source packages 4.2 kB/s | 1.5 kB 00:00 2022-09-20T20:10:56.025 INFO:teuthology.orchestra.run.smithi055.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2022-09-20T20:10:56.897 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 11 MB/s | 13 MB 00:01 2022-09-20T20:10:57.492 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 13 MB 00:01 2022-09-20T20:10:59.914 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 497 kB/s | 24 kB 00:00 2022-09-20T20:11:00.501 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 529 kB/s | 24 kB 00:00 2022-09-20T20:11:00.824 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 52 MB 00:00 2022-09-20T20:11:01.286 INFO:teuthology.orchestra.run.smithi055.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 66 MB/s | 47 MB 00:00 2022-09-20T20:11:09.317 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 58 MB/s | 47 MB 00:00 2022-09-20T20:11:10.087 INFO:teuthology.orchestra.run.smithi055.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 63 MB/s | 52 MB 00:00 2022-09-20T20:11:20.843 INFO:teuthology.orchestra.run.smithi008.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-20T20:11:20.843 INFO:teuthology.orchestra.run.smithi008.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-20T20:11:20.860 INFO:teuthology.orchestra.run.smithi008.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2022-09-20T20:11:20.861 INFO:teuthology.orchestra.run.smithi008.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2022-09-20T20:11:20.862 INFO:teuthology.orchestra.run.smithi008.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2022-09-20T20:11:20.863 INFO:teuthology.orchestra.run.smithi008.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-09-20T20:11:20.865 INFO:teuthology.orchestra.run.smithi008.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-09-20T20:11:20.869 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2022-09-20T20:11:20.870 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-09-20T20:11:21.014 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2022-09-20T20:11:21.028 INFO:teuthology.orchestra.run.smithi008.stdout:=========================================================================================================================== 2022-09-20T20:11:21.028 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2022-09-20T20:11:21.028 INFO:teuthology.orchestra.run.smithi008.stdout:=========================================================================================================================== 2022-09-20T20:11:21.029 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2022-09-20T20:11:21.029 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-7.el8_6 rhel-8-for-x86_64-baseos-rpms 137 k 2022-09-20T20:11:21.029 INFO:teuthology.orchestra.run.smithi008.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-09-20T20:11:21.029 INFO:teuthology.orchestra.run.smithi008.stdout: ceph x86_64 2:17.0.0-15134.gada1013c.el8 ceph 6.4 k 2022-09-20T20:11:21.030 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base x86_64 2:17.0.0-15134.gada1013c.el8 ceph 5.2 M 2022-09-20T20:11:21.030 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse x86_64 2:17.0.0-15134.gada1013c.el8 ceph 843 k 2022-09-20T20:11:21.030 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-15134.gada1013c.el8 ceph 165 k 2022-09-20T20:11:21.030 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr x86_64 2:17.0.0-15134.gada1013c.el8 ceph 1.5 M 2022-09-20T20:11:21.031 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 117 k 2022-09-20T20:11:21.031 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 1.6 M 2022-09-20T20:11:21.031 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 7.4 M 2022-09-20T20:11:21.031 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 47 k 2022-09-20T20:11:21.031 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw x86_64 2:17.0.0-15134.gada1013c.el8 ceph 18 M 2022-09-20T20:11:21.032 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test x86_64 2:17.0.0-15134.gada1013c.el8 ceph 54 M 2022-09-20T20:11:21.032 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 263 k 2022-09-20T20:11:21.032 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 81 k 2022-09-20T20:11:21.032 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror x86_64 2:17.0.0-15134.gada1013c.el8 ceph 257 k 2022-09-20T20:11:21.033 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 15 k 2022-09-20T20:11:21.033 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2022-09-20T20:11:21.033 INFO:teuthology.orchestra.run.smithi008.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-09-20T20:11:21.033 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-09-20T20:11:21.034 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel x86_64 2:17.0.0-15134.gada1013c.el8 ceph 30 k 2022-09-20T20:11:21.034 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 766 k 2022-09-20T20:11:21.034 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel x86_64 2:17.0.0-15134.gada1013c.el8 ceph 139 k 2022-09-20T20:11:21.034 INFO:teuthology.orchestra.run.smithi008.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-09-20T20:11:21.035 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2022-09-20T20:11:21.035 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-09-20T20:11:21.035 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2022-09-20T20:11:21.035 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2022-09-20T20:11:21.036 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2022-09-20T20:11:21.036 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs x86_64 2:17.0.0-15134.gada1013c.el8 ceph 190 k 2022-09-20T20:11:21.036 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados x86_64 2:17.0.0-15134.gada1013c.el8 ceph 371 k 2022-09-20T20:11:21.036 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd x86_64 2:17.0.0-15134.gada1013c.el8 ceph 358 k 2022-09-20T20:11:21.036 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw x86_64 2:17.0.0-15134.gada1013c.el8 ceph 106 k 2022-09-20T20:11:21.037 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse x86_64 2:17.0.0-15134.gada1013c.el8 ceph 94 k 2022-09-20T20:11:21.037 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror x86_64 2:17.0.0-15134.gada1013c.el8 ceph 3.5 M 2022-09-20T20:11:21.037 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd x86_64 2:17.0.0-15134.gada1013c.el8 ceph 175 k 2022-09-20T20:11:21.037 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2022-09-20T20:11:21.038 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrading: 2022-09-20T20:11:21.038 INFO:teuthology.orchestra.run.smithi008.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2022-09-20T20:11:21.038 INFO:teuthology.orchestra.run.smithi008.stdout: librados2 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 3.6 M 2022-09-20T20:11:21.039 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 3.6 M 2022-09-20T20:11:21.039 INFO:teuthology.orchestra.run.smithi008.stdout: openssl x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 709 k 2022-09-20T20:11:21.039 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-libs x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 1.5 M 2022-09-20T20:11:21.039 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2022-09-20T20:11:21.040 INFO:teuthology.orchestra.run.smithi008.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-09-20T20:11:21.040 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common x86_64 2:17.0.0-15134.gada1013c.el8 ceph 24 M 2022-09-20T20:11:21.040 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 23 k 2022-09-20T20:11:21.040 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds x86_64 2:17.0.0-15134.gada1013c.el8 ceph 2.3 M 2022-09-20T20:11:21.041 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 233 k 2022-09-20T20:11:21.041 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon x86_64 2:17.0.0-15134.gada1013c.el8 ceph 3.9 M 2022-09-20T20:11:21.041 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd x86_64 2:17.0.0-15134.gada1013c.el8 ceph 17 M 2022-09-20T20:11:21.041 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 14 k 2022-09-20T20:11:21.042 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux x86_64 2:17.0.0-15134.gada1013c.el8 ceph 24 k 2022-09-20T20:11:21.042 INFO:teuthology.orchestra.run.smithi008.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-09-20T20:11:21.042 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-09-20T20:11:21.042 INFO:teuthology.orchestra.run.smithi008.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2022-09-20T20:11:21.042 INFO:teuthology.orchestra.run.smithi008.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-09-20T20:11:21.043 INFO:teuthology.orchestra.run.smithi008.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2022-09-20T20:11:21.043 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite x86_64 2:17.0.0-15134.gada1013c.el8 ceph 137 k 2022-09-20T20:11:21.043 INFO:teuthology.orchestra.run.smithi008.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2022-09-20T20:11:21.043 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2022-09-20T20:11:21.044 INFO:teuthology.orchestra.run.smithi008.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-09-20T20:11:21.044 INFO:teuthology.orchestra.run.smithi008.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2022-09-20T20:11:21.044 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2022-09-20T20:11:21.044 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-09-20T20:11:21.045 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 473 k 2022-09-20T20:11:21.045 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2022-09-20T20:11:21.045 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 6.4 M 2022-09-20T20:11:21.045 INFO:teuthology.orchestra.run.smithi008.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-09-20T20:11:21.046 INFO:teuthology.orchestra.run.smithi008.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2022-09-20T20:11:21.046 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-09-20T20:11:21.046 INFO:teuthology.orchestra.run.smithi008.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-09-20T20:11:21.046 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-09-20T20:11:21.047 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-09-20T20:11:21.047 INFO:teuthology.orchestra.run.smithi008.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-09-20T20:11:21.047 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2022-09-20T20:11:21.047 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-09-20T20:11:21.047 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-09-20T20:11:21.048 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-09-20T20:11:21.048 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-09-20T20:11:21.048 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-09-20T20:11:21.048 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-09-20T20:11:21.049 INFO:teuthology.orchestra.run.smithi008.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-09-20T20:11:21.049 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-09-20T20:11:21.049 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse x86_64 2:17.0.0-15134.gada1013c.el8 ceph 45 k 2022-09-20T20:11:21.049 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common x86_64 2:17.0.0-15134.gada1013c.el8 ceph 109 k 2022-09-20T20:11:21.050 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-09-20T20:11:21.050 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-09-20T20:11:21.050 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-09-20T20:11:21.050 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-09-20T20:11:21.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-09-20T20:11:21.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-09-20T20:11:21.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-09-20T20:11:21.051 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-09-20T20:11:21.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2022-09-20T20:11:21.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-09-20T20:11:21.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-09-20T20:11:21.052 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-09-20T20:11:21.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-09-20T20:11:21.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-09-20T20:11:21.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-09-20T20:11:21.053 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-09-20T20:11:21.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-09-20T20:11:21.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-09-20T20:11:21.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-09-20T20:11:21.054 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-09-20T20:11:21.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-09-20T20:11:21.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-09-20T20:11:21.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-09-20T20:11:21.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-09-20T20:11:21.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-09-20T20:11:21.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-09-20T20:11:21.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-09-20T20:11:21.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-09-20T20:11:21.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-09-20T20:11:21.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-09-20T20:11:21.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-09-20T20:11:21.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-09-20T20:11:21.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-09-20T20:11:21.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2022-09-20T20:11:21.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-09-20T20:11:21.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-09-20T20:11:21.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-09-20T20:11:21.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-09-20T20:11:21.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-09-20T20:11:21.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-09-20T20:11:21.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-09-20T20:11:21.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-09-20T20:11:21.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-09-20T20:11:21.060 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-09-20T20:11:21.060 INFO:teuthology.orchestra.run.smithi008.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2022-09-20T20:11:21.060 INFO:teuthology.orchestra.run.smithi008.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-09-20T20:11:21.060 INFO:teuthology.orchestra.run.smithi008.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2022-09-20T20:11:21.061 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2022-09-20T20:11:21.061 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2022-09-20T20:11:21.061 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling module streams: 2022-09-20T20:11:21.061 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql 10 2022-09-20T20:11:21.062 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:11:21.062 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2022-09-20T20:11:21.062 INFO:teuthology.orchestra.run.smithi008.stdout:=========================================================================================================================== 2022-09-20T20:11:21.062 INFO:teuthology.orchestra.run.smithi008.stdout:Install 128 Packages 2022-09-20T20:11:21.062 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrade 5 Packages 2022-09-20T20:11:21.063 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:11:21.064 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 218 M 2022-09-20T20:11:21.064 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2022-09-20T20:11:21.201 INFO:teuthology.orchestra.run.smithi008.stdout:(1/133): ceph-17.0.0-15134.gada1013c.el8.x86_64 41 kB/s | 6.4 kB 00:00 2022-09-20T20:11:21.451 INFO:teuthology.orchestra.run.smithi008.stdout:(2/133): ceph-fuse-17.0.0-15134.gada1013c.el8.x 3.3 MB/s | 843 kB 00:00 2022-09-20T20:11:21.510 INFO:teuthology.orchestra.run.smithi008.stdout:(3/133): ceph-immutable-object-cache-17.0.0-151 2.8 MB/s | 165 kB 00:00 2022-09-20T20:11:21.807 INFO:teuthology.orchestra.run.smithi055.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-20T20:11:21.808 INFO:teuthology.orchestra.run.smithi055.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-20T20:11:21.823 INFO:teuthology.orchestra.run.smithi055.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2022-09-20T20:11:21.825 INFO:teuthology.orchestra.run.smithi055.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2022-09-20T20:11:21.826 INFO:teuthology.orchestra.run.smithi055.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2022-09-20T20:11:21.827 INFO:teuthology.orchestra.run.smithi055.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-09-20T20:11:21.830 INFO:teuthology.orchestra.run.smithi055.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-09-20T20:11:21.833 INFO:teuthology.orchestra.run.smithi055.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2022-09-20T20:11:21.834 INFO:teuthology.orchestra.run.smithi055.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-09-20T20:11:21.885 INFO:teuthology.orchestra.run.smithi008.stdout:(4/133): ceph-mds-17.0.0-15134.gada1013c.el8.x8 6.0 MB/s | 2.3 MB 00:00 2022-09-20T20:11:21.952 INFO:teuthology.orchestra.run.smithi008.stdout:(5/133): ceph-base-17.0.0-15134.gada1013c.el8.x 5.7 MB/s | 5.2 MB 00:00 2022-09-20T20:11:21.981 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2022-09-20T20:11:21.995 INFO:teuthology.orchestra.run.smithi055.stdout:=========================================================================================================================== 2022-09-20T20:11:21.995 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2022-09-20T20:11:21.996 INFO:teuthology.orchestra.run.smithi055.stdout:=========================================================================================================================== 2022-09-20T20:11:21.996 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2022-09-20T20:11:21.996 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-7.el8_6 rhel-8-for-x86_64-baseos-rpms 137 k 2022-09-20T20:11:21.996 INFO:teuthology.orchestra.run.smithi055.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-09-20T20:11:21.997 INFO:teuthology.orchestra.run.smithi055.stdout: ceph x86_64 2:17.0.0-15134.gada1013c.el8 ceph 6.4 k 2022-09-20T20:11:21.997 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base x86_64 2:17.0.0-15134.gada1013c.el8 ceph 5.2 M 2022-09-20T20:11:21.997 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse x86_64 2:17.0.0-15134.gada1013c.el8 ceph 843 k 2022-09-20T20:11:21.997 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-15134.gada1013c.el8 ceph 165 k 2022-09-20T20:11:21.998 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr x86_64 2:17.0.0-15134.gada1013c.el8 ceph 1.5 M 2022-09-20T20:11:21.998 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 117 k 2022-09-20T20:11:21.998 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 1.6 M 2022-09-20T20:11:21.998 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 7.4 M 2022-09-20T20:11:21.999 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 47 k 2022-09-20T20:11:21.999 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw x86_64 2:17.0.0-15134.gada1013c.el8 ceph 18 M 2022-09-20T20:11:21.999 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test x86_64 2:17.0.0-15134.gada1013c.el8 ceph 54 M 2022-09-20T20:11:21.999 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-volume noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 263 k 2022-09-20T20:11:22.000 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 81 k 2022-09-20T20:11:22.000 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror x86_64 2:17.0.0-15134.gada1013c.el8 ceph 257 k 2022-09-20T20:11:22.000 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-top noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 15 k 2022-09-20T20:11:22.000 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2022-09-20T20:11:22.001 INFO:teuthology.orchestra.run.smithi055.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-09-20T20:11:22.001 INFO:teuthology.orchestra.run.smithi055.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-09-20T20:11:22.001 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel x86_64 2:17.0.0-15134.gada1013c.el8 ceph 30 k 2022-09-20T20:11:22.001 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 766 k 2022-09-20T20:11:22.002 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel x86_64 2:17.0.0-15134.gada1013c.el8 ceph 139 k 2022-09-20T20:11:22.002 INFO:teuthology.orchestra.run.smithi055.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-09-20T20:11:22.002 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2022-09-20T20:11:22.002 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-09-20T20:11:22.002 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2022-09-20T20:11:22.003 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2022-09-20T20:11:22.003 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2022-09-20T20:11:22.003 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs x86_64 2:17.0.0-15134.gada1013c.el8 ceph 190 k 2022-09-20T20:11:22.004 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados x86_64 2:17.0.0-15134.gada1013c.el8 ceph 371 k 2022-09-20T20:11:22.004 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd x86_64 2:17.0.0-15134.gada1013c.el8 ceph 358 k 2022-09-20T20:11:22.004 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw x86_64 2:17.0.0-15134.gada1013c.el8 ceph 106 k 2022-09-20T20:11:22.005 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse x86_64 2:17.0.0-15134.gada1013c.el8 ceph 94 k 2022-09-20T20:11:22.005 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror x86_64 2:17.0.0-15134.gada1013c.el8 ceph 3.5 M 2022-09-20T20:11:22.005 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd x86_64 2:17.0.0-15134.gada1013c.el8 ceph 175 k 2022-09-20T20:11:22.005 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2022-09-20T20:11:22.005 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrading: 2022-09-20T20:11:22.006 INFO:teuthology.orchestra.run.smithi055.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2022-09-20T20:11:22.006 INFO:teuthology.orchestra.run.smithi055.stdout: librados2 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 3.6 M 2022-09-20T20:11:22.006 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 3.6 M 2022-09-20T20:11:22.007 INFO:teuthology.orchestra.run.smithi055.stdout: openssl x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 709 k 2022-09-20T20:11:22.007 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-libs x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 1.5 M 2022-09-20T20:11:22.007 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2022-09-20T20:11:22.007 INFO:teuthology.orchestra.run.smithi055.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-09-20T20:11:22.007 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common x86_64 2:17.0.0-15134.gada1013c.el8 ceph 24 M 2022-09-20T20:11:22.008 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 23 k 2022-09-20T20:11:22.008 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds x86_64 2:17.0.0-15134.gada1013c.el8 ceph 2.3 M 2022-09-20T20:11:22.008 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 233 k 2022-09-20T20:11:22.008 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon x86_64 2:17.0.0-15134.gada1013c.el8 ceph 3.9 M 2022-09-20T20:11:22.009 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd x86_64 2:17.0.0-15134.gada1013c.el8 ceph 17 M 2022-09-20T20:11:22.009 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 14 k 2022-09-20T20:11:22.009 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux x86_64 2:17.0.0-15134.gada1013c.el8 ceph 24 k 2022-09-20T20:11:22.009 INFO:teuthology.orchestra.run.smithi055.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-09-20T20:11:22.009 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-09-20T20:11:22.010 INFO:teuthology.orchestra.run.smithi055.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2022-09-20T20:11:22.010 INFO:teuthology.orchestra.run.smithi055.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-09-20T20:11:22.010 INFO:teuthology.orchestra.run.smithi055.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2022-09-20T20:11:22.010 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite x86_64 2:17.0.0-15134.gada1013c.el8 ceph 137 k 2022-09-20T20:11:22.011 INFO:teuthology.orchestra.run.smithi055.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2022-09-20T20:11:22.011 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2022-09-20T20:11:22.011 INFO:teuthology.orchestra.run.smithi055.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-09-20T20:11:22.011 INFO:teuthology.orchestra.run.smithi055.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2022-09-20T20:11:22.012 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2022-09-20T20:11:22.012 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-09-20T20:11:22.012 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 473 k 2022-09-20T20:11:22.013 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2022-09-20T20:11:22.013 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 6.4 M 2022-09-20T20:11:22.013 INFO:teuthology.orchestra.run.smithi055.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-09-20T20:11:22.013 INFO:teuthology.orchestra.run.smithi055.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2022-09-20T20:11:22.014 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-09-20T20:11:22.014 INFO:teuthology.orchestra.run.smithi055.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-09-20T20:11:22.014 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-09-20T20:11:22.014 INFO:teuthology.orchestra.run.smithi055.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-09-20T20:11:22.015 INFO:teuthology.orchestra.run.smithi055.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-09-20T20:11:22.015 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2022-09-20T20:11:22.015 INFO:teuthology.orchestra.run.smithi055.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-09-20T20:11:22.015 INFO:teuthology.orchestra.run.smithi055.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-09-20T20:11:22.016 INFO:teuthology.orchestra.run.smithi055.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-09-20T20:11:22.016 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-09-20T20:11:22.016 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-09-20T20:11:22.016 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-09-20T20:11:22.016 INFO:teuthology.orchestra.run.smithi055.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-09-20T20:11:22.017 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-09-20T20:11:22.017 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse x86_64 2:17.0.0-15134.gada1013c.el8 ceph 45 k 2022-09-20T20:11:22.017 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common x86_64 2:17.0.0-15134.gada1013c.el8 ceph 109 k 2022-09-20T20:11:22.017 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-09-20T20:11:22.018 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-09-20T20:11:22.018 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-09-20T20:11:22.018 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-09-20T20:11:22.018 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-09-20T20:11:22.019 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-09-20T20:11:22.019 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-09-20T20:11:22.019 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-09-20T20:11:22.019 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2022-09-20T20:11:22.019 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-09-20T20:11:22.020 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-09-20T20:11:22.020 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-09-20T20:11:22.020 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-09-20T20:11:22.020 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-09-20T20:11:22.021 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-09-20T20:11:22.021 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-09-20T20:11:22.021 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-09-20T20:11:22.022 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-09-20T20:11:22.022 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-09-20T20:11:22.022 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-09-20T20:11:22.022 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-09-20T20:11:22.023 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-09-20T20:11:22.023 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-09-20T20:11:22.023 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-09-20T20:11:22.023 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-09-20T20:11:22.023 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-09-20T20:11:22.024 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-09-20T20:11:22.024 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-09-20T20:11:22.024 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-09-20T20:11:22.024 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-09-20T20:11:22.025 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-09-20T20:11:22.025 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-09-20T20:11:22.025 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-09-20T20:11:22.025 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2022-09-20T20:11:22.026 INFO:teuthology.orchestra.run.smithi055.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-09-20T20:11:22.026 INFO:teuthology.orchestra.run.smithi055.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-09-20T20:11:22.026 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-09-20T20:11:22.026 INFO:teuthology.orchestra.run.smithi055.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-09-20T20:11:22.027 INFO:teuthology.orchestra.run.smithi055.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-09-20T20:11:22.027 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-09-20T20:11:22.027 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-09-20T20:11:22.027 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-09-20T20:11:22.027 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-09-20T20:11:22.028 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-09-20T20:11:22.028 INFO:teuthology.orchestra.run.smithi055.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2022-09-20T20:11:22.028 INFO:teuthology.orchestra.run.smithi055.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-09-20T20:11:22.028 INFO:teuthology.orchestra.run.smithi055.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2022-09-20T20:11:22.029 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2022-09-20T20:11:22.029 INFO:teuthology.orchestra.run.smithi055.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2022-09-20T20:11:22.029 INFO:teuthology.orchestra.run.smithi055.stdout:Enabling module streams: 2022-09-20T20:11:22.029 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql 10 2022-09-20T20:11:22.030 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:11:22.030 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2022-09-20T20:11:22.030 INFO:teuthology.orchestra.run.smithi055.stdout:=========================================================================================================================== 2022-09-20T20:11:22.031 INFO:teuthology.orchestra.run.smithi055.stdout:Install 128 Packages 2022-09-20T20:11:22.031 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrade 5 Packages 2022-09-20T20:11:22.031 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:11:22.032 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 218 M 2022-09-20T20:11:22.032 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2022-09-20T20:11:22.202 INFO:teuthology.orchestra.run.smithi008.stdout:(6/133): ceph-mgr-17.0.0-15134.gada1013c.el8.x8 4.8 MB/s | 1.5 MB 00:00 2022-09-20T20:11:22.254 INFO:teuthology.orchestra.run.smithi055.stdout:(1/133): ceph-17.0.0-15134.gada1013c.el8.x86_64 27 kB/s | 6.4 kB 00:00 2022-09-20T20:11:22.570 INFO:teuthology.orchestra.run.smithi008.stdout:(7/133): ceph-mon-17.0.0-15134.gada1013c.el8.x8 6.3 MB/s | 3.9 MB 00:00 2022-09-20T20:11:23.104 INFO:teuthology.orchestra.run.smithi055.stdout:(2/133): ceph-fuse-17.0.0-15134.gada1013c.el8.x 992 kB/s | 843 kB 00:00 2022-09-20T20:11:23.271 INFO:teuthology.orchestra.run.smithi055.stdout:(3/133): ceph-immutable-object-cache-17.0.0-151 993 kB/s | 165 kB 00:00 2022-09-20T20:11:24.378 INFO:teuthology.orchestra.run.smithi008.stdout:(8/133): ceph-common-17.0.0-15134.gada1013c.el8 7.2 MB/s | 24 MB 00:03 2022-09-20T20:11:24.405 INFO:teuthology.orchestra.run.smithi055.stdout:(4/133): ceph-mds-17.0.0-15134.gada1013c.el8.x8 2.0 MB/s | 2.3 MB 00:01 2022-09-20T20:11:24.572 INFO:teuthology.orchestra.run.smithi055.stdout:(5/133): ceph-base-17.0.0-15134.gada1013c.el8.x 2.0 MB/s | 5.2 MB 00:02 2022-09-20T20:11:24.586 INFO:teuthology.orchestra.run.smithi008.stdout:(9/133): ceph-radosgw-17.0.0-15134.gada1013c.el 8.9 MB/s | 18 MB 00:02 2022-09-20T20:11:24.603 INFO:teuthology.orchestra.run.smithi008.stdout:(10/133): ceph-selinux-17.0.0-15134.gada1013c.e 107 kB/s | 24 kB 00:00 2022-09-20T20:11:24.720 INFO:teuthology.orchestra.run.smithi008.stdout:(11/133): cephfs-mirror-17.0.0-15134.gada1013c. 2.2 MB/s | 257 kB 00:00 2022-09-20T20:11:24.746 INFO:teuthology.orchestra.run.smithi055.stdout:(6/133): ceph-mgr-17.0.0-15134.gada1013c.el8.x8 4.5 MB/s | 1.5 MB 00:00 2022-09-20T20:11:24.812 INFO:teuthology.orchestra.run.smithi008.stdout:(12/133): libcephfs-devel-17.0.0-15134.gada1013 333 kB/s | 30 kB 00:00 2022-09-20T20:11:25.013 INFO:teuthology.orchestra.run.smithi008.stdout:(13/133): libcephfs2-17.0.0-15134.gada1013c.el8 3.7 MB/s | 766 kB 00:00 2022-09-20T20:11:25.321 INFO:teuthology.orchestra.run.smithi008.stdout:(14/133): ceph-osd-17.0.0-15134.gada1013c.el8.x 5.4 MB/s | 17 MB 00:03 2022-09-20T20:11:25.346 INFO:teuthology.orchestra.run.smithi008.stdout:(15/133): libcephsqlite-17.0.0-15134.gada1013c. 411 kB/s | 137 kB 00:00 2022-09-20T20:11:25.389 INFO:teuthology.orchestra.run.smithi055.stdout:(7/133): ceph-mon-17.0.0-15134.gada1013c.el8.x8 4.7 MB/s | 3.9 MB 00:00 2022-09-20T20:11:25.422 INFO:teuthology.orchestra.run.smithi008.stdout:(16/133): librados-devel-17.0.0-15134.gada1013c 1.4 MB/s | 139 kB 00:00 2022-09-20T20:11:25.555 INFO:teuthology.orchestra.run.smithi008.stdout:(17/133): libradosstriper1-17.0.0-15134.gada101 2.2 MB/s | 473 kB 00:00 2022-09-20T20:11:25.689 INFO:teuthology.orchestra.run.smithi008.stdout:(18/133): python3-ceph-argparse-17.0.0-15134.ga 334 kB/s | 45 kB 00:00 2022-09-20T20:11:25.839 INFO:teuthology.orchestra.run.smithi008.stdout:(19/133): python3-ceph-common-17.0.0-15134.gada 727 kB/s | 109 kB 00:00 2022-09-20T20:11:25.998 INFO:teuthology.orchestra.run.smithi008.stdout:(20/133): python3-cephfs-17.0.0-15134.gada1013c 1.2 MB/s | 190 kB 00:00 2022-09-20T20:11:26.871 INFO:teuthology.orchestra.run.smithi008.stdout:(21/133): python3-rados-17.0.0-15134.gada1013c. 425 kB/s | 371 kB 00:00 2022-09-20T20:11:26.998 INFO:teuthology.orchestra.run.smithi008.stdout:(22/133): python3-rbd-17.0.0-15134.gada1013c.el 2.8 MB/s | 358 kB 00:00 2022-09-20T20:11:27.157 INFO:teuthology.orchestra.run.smithi008.stdout:(23/133): librgw2-17.0.0-15134.gada1013c.el8.x8 3.7 MB/s | 6.4 MB 00:01 2022-09-20T20:11:27.182 INFO:teuthology.orchestra.run.smithi008.stdout:(24/133): python3-rgw-17.0.0-15134.gada1013c.el 580 kB/s | 106 kB 00:00 2022-09-20T20:11:27.257 INFO:teuthology.orchestra.run.smithi008.stdout:(25/133): rbd-fuse-17.0.0-15134.gada1013c.el8.x 944 kB/s | 94 kB 00:00 2022-09-20T20:11:27.392 INFO:teuthology.orchestra.run.smithi008.stdout:(26/133): rbd-nbd-17.0.0-15134.gada1013c.el8.x8 1.3 MB/s | 175 kB 00:00 2022-09-20T20:11:27.500 INFO:teuthology.orchestra.run.smithi008.stdout:(27/133): ceph-grafana-dashboards-17.0.0-15134. 211 kB/s | 23 kB 00:00 2022-09-20T20:11:27.625 INFO:teuthology.orchestra.run.smithi008.stdout:(28/133): ceph-mgr-cephadm-17.0.0-15134.gada101 936 kB/s | 117 kB 00:00 2022-09-20T20:11:28.109 INFO:teuthology.orchestra.run.smithi008.stdout:(29/133): rbd-mirror-17.0.0-15134.gada1013c.el8 3.7 MB/s | 3.5 MB 00:00 2022-09-20T20:11:28.176 INFO:teuthology.orchestra.run.smithi008.stdout:(30/133): ceph-mgr-dashboard-17.0.0-15134.gada1 3.0 MB/s | 1.6 MB 00:00 2022-09-20T20:11:28.335 INFO:teuthology.orchestra.run.smithi008.stdout:(31/133): ceph-mgr-modules-core-17.0.0-15134.ga 1.4 MB/s | 233 kB 00:00 2022-09-20T20:11:28.452 INFO:teuthology.orchestra.run.smithi008.stdout:(32/133): ceph-mgr-rook-17.0.0-15134.gada1013c. 403 kB/s | 47 kB 00:00 2022-09-20T20:11:28.564 INFO:teuthology.orchestra.run.smithi055.stdout:(8/133): ceph-osd-17.0.0-15134.gada1013c.el8.x8 4.4 MB/s | 17 MB 00:03 2022-09-20T20:11:28.568 INFO:teuthology.orchestra.run.smithi008.stdout:(33/133): ceph-prometheus-alerts-17.0.0-15134.g 124 kB/s | 14 kB 00:00 2022-09-20T20:11:28.647 INFO:teuthology.orchestra.run.smithi055.stdout:(9/133): ceph-selinux-17.0.0-15134.gada1013c.el 292 kB/s | 24 kB 00:00 2022-09-20T20:11:28.686 INFO:teuthology.orchestra.run.smithi008.stdout:(34/133): ceph-volume-17.0.0-15134.gada1013c.el 2.2 MB/s | 263 kB 00:00 2022-09-20T20:11:29.148 INFO:teuthology.orchestra.run.smithi055.stdout:(10/133): ceph-radosgw-17.0.0-15134.gada1013c.e 4.8 MB/s | 18 MB 00:03 2022-09-20T20:11:29.212 INFO:teuthology.orchestra.run.smithi008.stdout:(35/133): ceph-test-17.0.0-15134.gada1013c.el8. 12 MB/s | 54 MB 00:04 2022-09-20T20:11:29.231 INFO:teuthology.orchestra.run.smithi055.stdout:(11/133): cephfs-mirror-17.0.0-15134.gada1013c. 3.0 MB/s | 257 kB 00:00 2022-09-20T20:11:29.236 INFO:teuthology.orchestra.run.smithi008.stdout:(36/133): cephadm-17.0.0-15134.gada1013c.el8.no 148 kB/s | 81 kB 00:00 2022-09-20T20:11:29.286 INFO:teuthology.orchestra.run.smithi008.stdout:(37/133): cephfs-top-17.0.0-15134.gada1013c.el8 206 kB/s | 15 kB 00:00 2022-09-20T20:11:29.315 INFO:teuthology.orchestra.run.smithi055.stdout:(12/133): libcephfs-devel-17.0.0-15134.gada1013 366 kB/s | 30 kB 00:00 2022-09-20T20:11:29.576 INFO:teuthology.orchestra.run.smithi055.stdout:(13/133): libcephfs2-17.0.0-15134.gada1013c.el8 2.9 MB/s | 766 kB 00:00 2022-09-20T20:11:29.612 INFO:teuthology.orchestra.run.smithi008.stdout:(38/133): ceph-mgr-diskprediction-local-17.0.0- 4.9 MB/s | 7.4 MB 00:01 2022-09-20T20:11:29.640 INFO:teuthology.orchestra.run.smithi055.stdout:(14/133): libcephsqlite-17.0.0-15134.gada1013c. 2.1 MB/s | 137 kB 00:00 2022-09-20T20:11:29.688 INFO:teuthology.orchestra.run.smithi008.stdout:(39/133): liboath-2.6.2-3.el8.x86_64.rpm 147 kB/s | 59 kB 00:00 2022-09-20T20:11:29.707 INFO:teuthology.orchestra.run.smithi055.stdout:(15/133): librados-devel-17.0.0-15134.gada1013c 2.0 MB/s | 139 kB 00:00 2022-09-20T20:11:29.934 INFO:teuthology.orchestra.run.smithi008.stdout:(40/133): gperftools-libs-2.7-9.el8.x86_64.rpm 439 kB/s | 306 kB 00:00 2022-09-20T20:11:29.941 INFO:teuthology.orchestra.run.smithi055.stdout:(16/133): libradosstriper1-17.0.0-15134.gada101 2.0 MB/s | 473 kB 00:00 2022-09-20T20:11:29.963 INFO:teuthology.orchestra.run.smithi008.stdout:(41/133): libunwind-1.3.1-3.el8.x86_64.rpm 214 kB/s | 75 kB 00:00 2022-09-20T20:11:30.013 INFO:teuthology.orchestra.run.smithi008.stdout:(42/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 558 kB/s | 44 kB 00:00 2022-09-20T20:11:30.088 INFO:teuthology.orchestra.run.smithi008.stdout:(43/133): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2022-09-20T20:11:30.122 INFO:teuthology.orchestra.run.smithi008.stdout:(44/133): python3-cachetools-3.1.1-4.el8.noarch 304 kB/s | 33 kB 00:00 2022-09-20T20:11:30.171 INFO:teuthology.orchestra.run.smithi008.stdout:(45/133): python3-asyncssh-2.7.0-2.el8.noarch.r 985 kB/s | 476 kB 00:00 2022-09-20T20:11:30.198 INFO:teuthology.orchestra.run.smithi008.stdout:(46/133): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2022-09-20T20:11:30.256 INFO:teuthology.orchestra.run.smithi008.stdout:(47/133): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2022-09-20T20:11:30.315 INFO:teuthology.orchestra.run.smithi008.stdout:(48/133): python3-google-auth-1.1.1-10.el8.noar 694 kB/s | 81 kB 00:00 2022-09-20T20:11:30.365 INFO:teuthology.orchestra.run.smithi008.stdout:(49/133): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2022-09-20T20:11:30.424 INFO:teuthology.orchestra.run.smithi008.stdout:(50/133): python3-jaraco-functools-2.0-4.el8.no 161 kB/s | 18 kB 00:00 2022-09-20T20:11:30.457 INFO:teuthology.orchestra.run.smithi008.stdout:(51/133): python3-cherrypy-18.4.0-1.el8.noarch. 1.3 MB/s | 384 kB 00:00 2022-09-20T20:11:30.499 INFO:teuthology.orchestra.run.smithi008.stdout:(52/133): python3-logutils-0.3.5-11.el8.noarch. 650 kB/s | 49 kB 00:00 2022-09-20T20:11:30.575 INFO:teuthology.orchestra.run.smithi008.stdout:(53/133): python3-more-itertools-7.2.0-3.el8.no 501 kB/s | 59 kB 00:00 2022-09-20T20:11:30.600 INFO:teuthology.orchestra.run.smithi008.stdout:(54/133): python3-natsort-7.1.1-2.el8.noarch.rp 600 kB/s | 60 kB 00:00 2022-09-20T20:11:30.683 INFO:teuthology.orchestra.run.smithi008.stdout:(55/133): python3-portend-2.6-1.el8.noarch.rpm 187 kB/s | 16 kB 00:00 2022-09-20T20:11:30.751 INFO:teuthology.orchestra.run.smithi008.stdout:(56/133): python3-pecan-1.3.2-9.el8.noarch.rpm 1.6 MB/s | 283 kB 00:00 2022-09-20T20:11:30.776 INFO:teuthology.orchestra.run.smithi008.stdout:(57/133): python3-repoze-lru-0.7-6.el8.noarch.r 366 kB/s | 34 kB 00:00 2022-09-20T20:11:30.843 INFO:teuthology.orchestra.run.smithi008.stdout:(58/133): python3-routes-2.4.1-12.el8.noarch.rp 2.1 MB/s | 196 kB 00:00 2022-09-20T20:11:30.868 INFO:teuthology.orchestra.run.smithi008.stdout:(59/133): python3-rsa-4.8-1.el8.noarch.rpm 668 kB/s | 61 kB 00:00 2022-09-20T20:11:30.891 INFO:teuthology.orchestra.run.smithi055.stdout:(17/133): librgw2-17.0.0-15134.gada1013c.el8.x8 6.7 MB/s | 6.4 MB 00:00 2022-09-20T20:11:30.936 INFO:teuthology.orchestra.run.smithi008.stdout:(60/133): python3-kubernetes-11.0.0-6.el8.noarc 2.0 MB/s | 1.2 MB 00:00 2022-09-20T20:11:30.960 INFO:teuthology.orchestra.run.smithi008.stdout:(61/133): python3-simplegeneric-0.8.1-17.el8.no 160 kB/s | 19 kB 00:00 2022-09-20T20:11:30.978 INFO:teuthology.orchestra.run.smithi055.stdout:(18/133): python3-ceph-argparse-17.0.0-15134.ga 516 kB/s | 45 kB 00:00 2022-09-20T20:11:30.985 INFO:teuthology.orchestra.run.smithi008.stdout:(62/133): python3-singledispatch-3.4.0.3-18.el8 204 kB/s | 24 kB 00:00 2022-09-20T20:11:31.011 INFO:teuthology.orchestra.run.smithi008.stdout:(63/133): python3-tempora-1.14.1-5.el8.noarch.r 389 kB/s | 29 kB 00:00 2022-09-20T20:11:31.044 INFO:teuthology.orchestra.run.smithi008.stdout:(64/133): python3-trustme-0.6.0-4.el8.noarch.rp 471 kB/s | 27 kB 00:00 2022-09-20T20:11:31.058 INFO:teuthology.orchestra.run.smithi055.stdout:(19/133): python3-ceph-common-17.0.0-15134.gada 1.3 MB/s | 109 kB 00:00 2022-09-20T20:11:31.103 INFO:teuthology.orchestra.run.smithi008.stdout:(65/133): python3-waitress-1.2.1-2.el8.1.noarch 2.0 MB/s | 241 kB 00:00 2022-09-20T20:11:31.125 INFO:teuthology.orchestra.run.smithi055.stdout:(20/133): python3-cephfs-17.0.0-15134.gada1013c 2.8 MB/s | 190 kB 00:00 2022-09-20T20:11:31.159 INFO:teuthology.orchestra.run.smithi008.stdout:(66/133): python3-webob-1.8.5-1.el8.1.noarch.rp 1.7 MB/s | 251 kB 00:00 2022-09-20T20:11:31.187 INFO:teuthology.orchestra.run.smithi008.stdout:(67/133): python3-websocket-client-0.56.0-5.el8 430 kB/s | 61 kB 00:00 2022-09-20T20:11:31.212 INFO:teuthology.orchestra.run.smithi008.stdout:(68/133): python3-webtest-2.0.33-1.el8.noarch.r 784 kB/s | 85 kB 00:00 2022-09-20T20:11:31.217 INFO:teuthology.orchestra.run.smithi055.stdout:(21/133): python3-rados-17.0.0-15134.gada1013c. 4.0 MB/s | 371 kB 00:00 2022-09-20T20:11:31.237 INFO:teuthology.orchestra.run.smithi008.stdout:(69/133): python3-zc-lockfile-2.0-2.el8.noarch. 292 kB/s | 23 kB 00:00 2022-09-20T20:11:31.271 INFO:teuthology.orchestra.run.smithi008.stdout:(70/133): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 70 kB 00:00 2022-09-20T20:11:31.318 INFO:teuthology.orchestra.run.smithi055.stdout:(22/133): python3-rbd-17.0.0-15134.gada1013c.el 3.5 MB/s | 358 kB 00:00 2022-09-20T20:11:31.330 INFO:teuthology.orchestra.run.smithi008.stdout:(71/133): pcre2-devel-10.32-2.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2022-09-20T20:11:31.363 INFO:teuthology.orchestra.run.smithi008.stdout:(72/133): fuse-2.9.7-15.el8.x86_64.rpm 902 kB/s | 83 kB 00:00 2022-09-20T20:11:31.385 INFO:teuthology.orchestra.run.smithi055.stdout:(23/133): python3-rgw-17.0.0-15134.gada1013c.el 1.6 MB/s | 106 kB 00:00 2022-09-20T20:11:31.422 INFO:teuthology.orchestra.run.smithi008.stdout:(73/133): libsepol-devel-2.9-3.el8.x86_64.rpm 947 kB/s | 87 kB 00:00 2022-09-20T20:11:31.447 INFO:teuthology.orchestra.run.smithi008.stdout:(74/133): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.6 MB/s | 220 kB 00:00 2022-09-20T20:11:31.451 INFO:teuthology.orchestra.run.smithi055.stdout:(24/133): rbd-fuse-17.0.0-15134.gada1013c.el8.x 1.4 MB/s | 94 kB 00:00 2022-09-20T20:11:31.498 INFO:teuthology.orchestra.run.smithi008.stdout:(75/133): thrift-0.13.0-2.el8.x86_64.rpm 5.6 MB/s | 1.7 MB 00:00 2022-09-20T20:11:31.523 INFO:teuthology.orchestra.run.smithi008.stdout:(76/133): libverto-devel-0.3.0-5.el8.x86_64.rpm 241 kB/s | 18 kB 00:00 2022-09-20T20:11:31.557 INFO:teuthology.orchestra.run.smithi008.stdout:(77/133): libselinux-devel-2.9-5.el8.x86_64.rpm 1.5 MB/s | 200 kB 00:00 2022-09-20T20:11:31.582 INFO:teuthology.orchestra.run.smithi008.stdout:(78/133): librabbitmq-0.9.0-3.el8.x86_64.rpm 559 kB/s | 47 kB 00:00 2022-09-20T20:11:31.607 INFO:teuthology.orchestra.run.smithi008.stdout:(79/133): python3-oauthlib-2.1.0-1.el8.noarch.r 3.1 MB/s | 155 kB 00:00 2022-09-20T20:11:31.666 INFO:teuthology.orchestra.run.smithi008.stdout:(80/133): python3-cryptography-3.2.1-5.el8.x86_ 3.9 MB/s | 559 kB 00:00 2022-09-20T20:11:31.691 INFO:teuthology.orchestra.run.smithi008.stdout:(81/133): python3-pycparser-2.14-14.el8.noarch. 1.0 MB/s | 109 kB 00:00 2022-09-20T20:11:31.725 INFO:teuthology.orchestra.run.smithi008.stdout:(82/133): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.7 MB/s | 560 kB 00:00 2022-09-20T20:11:31.750 INFO:teuthology.orchestra.run.smithi008.stdout:(83/133): python3-jwt-1.6.1-2.el8.noarch.rpm 745 kB/s | 43 kB 00:00 2022-09-20T20:11:31.784 INFO:teuthology.orchestra.run.smithi008.stdout:(84/133): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.4 MB/s | 171 kB 00:00 2022-09-20T20:11:31.817 INFO:teuthology.orchestra.run.smithi008.stdout:(85/133): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 626 kB/s | 58 kB 00:00 2022-09-20T20:11:31.843 INFO:teuthology.orchestra.run.smithi008.stdout:(86/133): elfutils-libelf-devel-0.186-1.el8.x86 649 kB/s | 60 kB 00:00 2022-09-20T20:11:31.893 INFO:teuthology.orchestra.run.smithi008.stdout:(87/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.2 MB/s | 238 kB 00:00 2022-09-20T20:11:31.935 INFO:teuthology.orchestra.run.smithi008.stdout:(88/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 159 kB/s | 19 kB 00:00 2022-09-20T20:11:31.960 INFO:teuthology.orchestra.run.smithi008.stdout:(89/133): NetworkManager-initscripts-updown-1.3 2.1 MB/s | 137 kB 00:00 2022-09-20T20:11:31.986 INFO:teuthology.orchestra.run.smithi008.stdout:(90/133): libuuid-devel-2.32.1-35.el8.x86_64.rp 689 kB/s | 98 kB 00:00 2022-09-20T20:11:32.019 INFO:teuthology.orchestra.run.smithi008.stdout:(91/133): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2022-09-20T20:11:32.044 INFO:teuthology.orchestra.run.smithi008.stdout:(92/133): python3-requests-oauthlib-1.0.0-1.el8 516 kB/s | 43 kB 00:00 2022-09-20T20:11:32.060 INFO:teuthology.orchestra.run.smithi055.stdout:(25/133): rbd-mirror-17.0.0-15134.gada1013c.el8 5.7 MB/s | 3.5 MB 00:00 2022-09-20T20:11:32.070 INFO:teuthology.orchestra.run.smithi008.stdout:(93/133): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 864 kB/s | 72 kB 00:00 2022-09-20T20:11:32.127 INFO:teuthology.orchestra.run.smithi055.stdout:(26/133): rbd-nbd-17.0.0-15134.gada1013c.el8.x8 2.6 MB/s | 175 kB 00:00 2022-09-20T20:11:32.136 INFO:teuthology.orchestra.run.smithi008.stdout:(94/133): libcom_err-devel-1.45.6-4.el8.x86_64. 332 kB/s | 39 kB 00:00 2022-09-20T20:11:32.170 INFO:teuthology.orchestra.run.smithi008.stdout:(95/133): keyutils-libs-devel-1.5.10-9.el8.x86_ 486 kB/s | 48 kB 00:00 2022-09-20T20:11:32.194 INFO:teuthology.orchestra.run.smithi055.stdout:(27/133): ceph-grafana-dashboards-17.0.0-15134. 342 kB/s | 23 kB 00:00 2022-09-20T20:11:32.221 INFO:teuthology.orchestra.run.smithi008.stdout:(96/133): libgfortran-8.5.0-10.1.el8_6.x86_64.r 7.4 MB/s | 644 kB 00:00 2022-09-20T20:11:32.254 INFO:teuthology.orchestra.run.smithi008.stdout:(97/133): postgresql-contrib-10.21-2.module+el8 9.6 MB/s | 808 kB 00:00 2022-09-20T20:11:32.261 INFO:teuthology.orchestra.run.smithi055.stdout:(28/133): ceph-mgr-cephadm-17.0.0-15134.gada101 1.7 MB/s | 117 kB 00:00 2022-09-20T20:11:32.305 INFO:teuthology.orchestra.run.smithi008.stdout:(98/133): openssl-devel-1.1.1k-7.el8_6.x86_64.r 8.9 MB/s | 2.3 MB 00:00 2022-09-20T20:11:32.374 INFO:teuthology.orchestra.run.smithi008.stdout:(99/133): bison-3.0.4-10.el8.x86_64.rpm 4.4 MB/s | 688 kB 00:00 2022-09-20T20:11:32.430 INFO:teuthology.orchestra.run.smithi008.stdout:(100/133): postgresql-10.21-2.module+el8.6.0+15 8.6 MB/s | 1.5 MB 00:00 2022-09-20T20:11:32.481 INFO:teuthology.orchestra.run.smithi008.stdout:(101/133): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2022-09-20T20:11:32.547 INFO:teuthology.orchestra.run.smithi008.stdout:(102/133): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2022-09-20T20:11:32.573 INFO:teuthology.orchestra.run.smithi008.stdout:(103/133): python3-markupsafe-0.23-19.el8.x86_6 424 kB/s | 39 kB 00:00 2022-09-20T20:11:32.586 INFO:teuthology.orchestra.run.smithi055.stdout:(29/133): ceph-mgr-dashboard-17.0.0-15134.gada1 5.1 MB/s | 1.6 MB 00:00 2022-09-20T20:11:32.632 INFO:teuthology.orchestra.run.smithi008.stdout:(104/133): python3-prettytable-0.7.2-14.el8.noa 526 kB/s | 44 kB 00:00 2022-09-20T20:11:32.665 INFO:teuthology.orchestra.run.smithi008.stdout:(105/133): librdkafka-0.11.4-3.el8.x86_64.rpm 3.8 MB/s | 354 kB 00:00 2022-09-20T20:11:32.740 INFO:teuthology.orchestra.run.smithi008.stdout:(106/133): postgresql-server-10.21-2.module+el8 14 MB/s | 5.1 MB 00:00 2022-09-20T20:11:32.782 INFO:teuthology.orchestra.run.smithi008.stdout:(107/133): python3-jinja2-2.10.1-3.el8.noarch.r 3.5 MB/s | 538 kB 00:00 2022-09-20T20:11:32.816 INFO:teuthology.orchestra.run.smithi008.stdout:(108/133): libtool-2.4.6-25.el8.x86_64.rpm 4.6 MB/s | 709 kB 00:00 2022-09-20T20:11:32.883 INFO:teuthology.orchestra.run.smithi008.stdout:(109/133): python3-numpy-f2py-1.14.3-10.el8.x86 1.5 MB/s | 225 kB 00:00 2022-09-20T20:11:32.925 INFO:teuthology.orchestra.run.smithi008.stdout:(110/133): python3-mako-1.0.6-13.el8.noarch.rpm 1.4 MB/s | 157 kB 00:00 2022-09-20T20:11:32.967 INFO:teuthology.orchestra.run.smithi008.stdout:(111/133): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2022-09-20T20:11:33.009 INFO:teuthology.orchestra.run.smithi008.stdout:(112/133): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2022-09-20T20:11:33.118 INFO:teuthology.orchestra.run.smithi008.stdout:(113/133): openblas-threads-0.3.15-3.el8.x86_64 15 MB/s | 4.9 MB 00:00 2022-09-20T20:11:33.151 INFO:teuthology.orchestra.run.smithi008.stdout:(114/133): flex-2.6.1-9.el8.x86_64.rpm 2.2 MB/s | 320 kB 00:00 2022-09-20T20:11:33.227 INFO:teuthology.orchestra.run.smithi008.stdout:(115/133): python3-babel-2.5.1-7.el8.noarch.rpm 14 MB/s | 4.8 MB 00:00 2022-09-20T20:11:33.252 INFO:teuthology.orchestra.run.smithi008.stdout:(116/133): jq-1.6-3.el8.x86_64.rpm 2.0 MB/s | 202 kB 00:00 2022-09-20T20:11:33.302 INFO:teuthology.orchestra.run.smithi008.stdout:(117/133): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2022-09-20T20:11:33.361 INFO:teuthology.orchestra.run.smithi008.stdout:(118/133): python3-pytz-2017.2-9.el8.noarch.rpm 931 kB/s | 54 kB 00:00 2022-09-20T20:11:33.408 INFO:teuthology.orchestra.run.smithi008.stdout:(119/133): python3-pyasn1-0.3.7-6.el8.noarch.rp 3.0 MB/s | 126 kB 00:00 2022-09-20T20:11:33.470 INFO:teuthology.orchestra.run.smithi008.stdout:(120/133): openblas-0.3.15-3.el8.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2022-09-20T20:11:33.503 INFO:teuthology.orchestra.run.smithi008.stdout:(121/133): python3-jsonpointer-1.10-11.el8.noar 199 kB/s | 20 kB 00:00 2022-09-20T20:11:33.529 INFO:teuthology.orchestra.run.smithi008.stdout:(122/133): libpq-13.5-1.el8.x86_64.rpm 3.4 MB/s | 198 kB 00:00 2022-09-20T20:11:33.604 INFO:teuthology.orchestra.run.smithi008.stdout:(123/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.5 MB/s | 259 kB 00:00 2022-09-20T20:11:33.621 INFO:teuthology.orchestra.run.smithi008.stdout:(124/133): oniguruma-6.8.2-2.el8.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2022-09-20T20:11:33.654 INFO:teuthology.orchestra.run.smithi008.stdout:(125/133): python3-jsonpatch-1.21-2.el8.noarch. 529 kB/s | 27 kB 00:00 2022-09-20T20:11:33.680 INFO:teuthology.orchestra.run.smithi008.stdout:(126/133): uuid-1.6.2-43.el8.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2022-09-20T20:11:33.713 INFO:teuthology.orchestra.run.smithi008.stdout:(127/133): python3-pyasn1-modules-0.3.7-6.el8.n 1.8 MB/s | 110 kB 00:00 2022-09-20T20:11:33.762 INFO:teuthology.orchestra.run.smithi055.stdout:(30/133): ceph-mgr-diskprediction-local-17.0.0- 6.3 MB/s | 7.4 MB 00:01 2022-09-20T20:11:33.871 INFO:teuthology.orchestra.run.smithi055.stdout:(31/133): ceph-mgr-modules-core-17.0.0-15134.ga 2.1 MB/s | 233 kB 00:00 2022-09-20T20:11:33.905 INFO:teuthology.orchestra.run.smithi008.stdout:(128/133): python3-scipy-1.0.0-21.module+el8.5. 20 MB/s | 14 MB 00:00 2022-09-20T20:11:33.947 INFO:teuthology.orchestra.run.smithi008.stdout:(129/133): openssl-1.1.1k-7.el8_6.x86_64.rpm 17 MB/s | 709 kB 00:00 2022-09-20T20:11:33.979 INFO:teuthology.orchestra.run.smithi055.stdout:(32/133): ceph-mgr-rook-17.0.0-15134.gada1013c. 435 kB/s | 47 kB 00:00 2022-09-20T20:11:33.997 INFO:teuthology.orchestra.run.smithi008.stdout:(130/133): openssl-libs-1.1.1k-7.el8_6.x86_64.r 29 MB/s | 1.5 MB 00:00 2022-09-20T20:11:34.040 INFO:teuthology.orchestra.run.smithi008.stdout:(131/133): iproute-5.15.0-4.el8_6.1.x86_64.rpm 19 MB/s | 798 kB 00:00 2022-09-20T20:11:34.079 INFO:teuthology.orchestra.run.smithi055.stdout:(33/133): ceph-prometheus-alerts-17.0.0-15134.g 144 kB/s | 14 kB 00:00 2022-09-20T20:11:34.380 INFO:teuthology.orchestra.run.smithi055.stdout:(34/133): ceph-volume-17.0.0-15134.gada1013c.el 876 kB/s | 263 kB 00:00 2022-09-20T20:11:34.556 INFO:teuthology.orchestra.run.smithi008.stdout:(132/133): librbd1-17.0.0-15134.gada1013c.el8.x 4.2 MB/s | 3.6 MB 00:00 2022-09-20T20:11:34.630 INFO:teuthology.orchestra.run.smithi055.stdout:(35/133): ceph-common-17.0.0-15134.gada1013c.el 1.9 MB/s | 24 MB 00:12 2022-09-20T20:11:34.655 INFO:teuthology.orchestra.run.smithi055.stdout:(36/133): cephadm-17.0.0-15134.gada1013c.el8.no 295 kB/s | 81 kB 00:00 2022-09-20T20:11:34.706 INFO:teuthology.orchestra.run.smithi055.stdout:(37/133): cephfs-top-17.0.0-15134.gada1013c.el8 206 kB/s | 15 kB 00:00 2022-09-20T20:11:34.781 INFO:teuthology.orchestra.run.smithi008.stdout:(133/133): librados2-17.0.0-15134.gada1013c.el8 3.3 MB/s | 3.6 MB 00:01 2022-09-20T20:11:34.784 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2022-09-20T20:11:34.785 INFO:teuthology.orchestra.run.smithi008.stdout:Total 16 MB/s | 218 MB 00:13 2022-09-20T20:11:34.864 INFO:teuthology.orchestra.run.smithi055.stdout:(38/133): liboath-2.6.2-3.el8.x86_64.rpm 371 kB/s | 59 kB 00:00 2022-09-20T20:11:34.890 INFO:teuthology.orchestra.run.smithi055.stdout:(39/133): gperftools-libs-2.7-9.el8.x86_64.rpm 1.3 MB/s | 306 kB 00:00 2022-09-20T20:11:35.098 INFO:teuthology.orchestra.run.smithi055.stdout:(40/133): libunwind-1.3.1-3.el8.x86_64.rpm 321 kB/s | 75 kB 00:00 2022-09-20T20:11:35.132 INFO:teuthology.orchestra.run.smithi055.stdout:(41/133): python3-asyncssh-2.7.0-2.el8.noarch.r 1.9 MB/s | 476 kB 00:00 2022-09-20T20:11:35.157 INFO:teuthology.orchestra.run.smithi055.stdout:(42/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 743 kB/s | 44 kB 00:00 2022-09-20T20:11:35.191 INFO:teuthology.orchestra.run.smithi055.stdout:(43/133): python3-beautifulsoup4-4.6.3-2.el8.1. 3.1 MB/s | 185 kB 00:00 2022-09-20T20:11:35.216 INFO:teuthology.orchestra.run.smithi055.stdout:(44/133): python3-cachetools-3.1.1-4.el8.noarch 564 kB/s | 33 kB 00:00 2022-09-20T20:11:35.241 INFO:teuthology.orchestra.run.smithi055.stdout:(45/133): python3-certifi-2018.10.15-7.el8.noar 324 kB/s | 16 kB 00:00 2022-09-20T20:11:35.300 INFO:teuthology.orchestra.run.smithi055.stdout:(46/133): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2022-09-20T20:11:35.350 INFO:teuthology.orchestra.run.smithi055.stdout:(47/133): python3-cherrypy-18.4.0-1.el8.noarch. 3.5 MB/s | 384 kB 00:00 2022-09-20T20:11:35.384 INFO:teuthology.orchestra.run.smithi055.stdout:(48/133): python3-google-auth-1.1.1-10.el8.noar 973 kB/s | 81 kB 00:00 2022-09-20T20:11:35.409 INFO:teuthology.orchestra.run.smithi055.stdout:(49/133): python3-jaraco-6.2-6.el8.noarch.rpm 190 kB/s | 11 kB 00:00 2022-09-20T20:11:35.443 INFO:teuthology.orchestra.run.smithi055.stdout:(50/133): python3-jaraco-functools-2.0-4.el8.no 300 kB/s | 18 kB 00:00 2022-09-20T20:11:35.510 INFO:teuthology.orchestra.run.smithi055.stdout:(51/133): python3-logutils-0.3.5-11.el8.noarch. 732 kB/s | 49 kB 00:00 2022-09-20T20:11:35.577 INFO:teuthology.orchestra.run.smithi055.stdout:(52/133): python3-more-itertools-7.2.0-3.el8.no 882 kB/s | 59 kB 00:00 2022-09-20T20:11:35.644 INFO:teuthology.orchestra.run.smithi055.stdout:(53/133): python3-kubernetes-11.0.0-6.el8.noarc 5.0 MB/s | 1.2 MB 00:00 2022-09-20T20:11:35.669 INFO:teuthology.orchestra.run.smithi055.stdout:(54/133): python3-natsort-7.1.1-2.el8.noarch.rp 656 kB/s | 60 kB 00:00 2022-09-20T20:11:35.685 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2022-09-20T20:11:35.719 INFO:teuthology.orchestra.run.smithi055.stdout:(55/133): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2022-09-20T20:11:35.753 INFO:teuthology.orchestra.run.smithi055.stdout:(56/133): python3-portend-2.6-1.el8.noarch.rpm 187 kB/s | 16 kB 00:00 2022-09-20T20:11:35.804 INFO:teuthology.orchestra.run.smithi055.stdout:(57/133): python3-repoze-lru-0.7-6.el8.noarch.r 401 kB/s | 34 kB 00:00 2022-09-20T20:11:35.837 INFO:teuthology.orchestra.run.smithi055.stdout:(58/133): python3-routes-2.4.1-12.el8.noarch.rp 2.3 MB/s | 196 kB 00:00 2022-09-20T20:11:35.862 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2022-09-20T20:11:35.863 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2022-09-20T20:11:35.887 INFO:teuthology.orchestra.run.smithi055.stdout:(59/133): python3-rsa-4.8-1.el8.noarch.rpm 737 kB/s | 61 kB 00:00 2022-09-20T20:11:35.913 INFO:teuthology.orchestra.run.smithi055.stdout:(60/133): python3-simplegeneric-0.8.1-17.el8.no 248 kB/s | 19 kB 00:00 2022-09-20T20:11:35.955 INFO:teuthology.orchestra.run.smithi055.stdout:(61/133): python3-singledispatch-3.4.0.3-18.el8 357 kB/s | 24 kB 00:00 2022-09-20T20:11:35.988 INFO:teuthology.orchestra.run.smithi055.stdout:(62/133): python3-tempora-1.14.1-5.el8.noarch.r 389 kB/s | 29 kB 00:00 2022-09-20T20:11:36.047 INFO:teuthology.orchestra.run.smithi055.stdout:(63/133): python3-trustme-0.6.0-4.el8.noarch.rp 299 kB/s | 27 kB 00:00 2022-09-20T20:11:36.072 INFO:teuthology.orchestra.run.smithi055.stdout:(64/133): python3-waitress-1.2.1-2.el8.1.noarch 2.8 MB/s | 241 kB 00:00 2022-09-20T20:11:36.122 INFO:teuthology.orchestra.run.smithi055.stdout:(65/133): python3-webob-1.8.5-1.el8.1.noarch.rp 3.3 MB/s | 251 kB 00:00 2022-09-20T20:11:36.140 INFO:teuthology.orchestra.run.smithi055.stdout:(66/133): python3-websocket-client-0.56.0-5.el8 916 kB/s | 61 kB 00:00 2022-09-20T20:11:36.206 INFO:teuthology.orchestra.run.smithi055.stdout:(67/133): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2022-09-20T20:11:36.223 INFO:teuthology.orchestra.run.smithi055.stdout:(68/133): python3-zc-lockfile-2.0-2.el8.noarch. 274 kB/s | 23 kB 00:00 2022-09-20T20:11:36.249 INFO:teuthology.orchestra.run.smithi055.stdout:(69/133): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2022-09-20T20:11:36.307 INFO:teuthology.orchestra.run.smithi055.stdout:(70/133): postgresql-contrib-10.21-2.module+el8 14 MB/s | 808 kB 00:00 2022-09-20T20:11:36.358 INFO:teuthology.orchestra.run.smithi055.stdout:(71/133): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2022-09-20T20:11:36.416 INFO:teuthology.orchestra.run.smithi055.stdout:(72/133): postgresql-10.21-2.module+el8.6.0+153 26 MB/s | 1.5 MB 00:00 2022-09-20T20:11:36.500 INFO:teuthology.orchestra.run.smithi055.stdout:(73/133): python3-numpy-1.14.3-10.el8.x86_64.rp 45 MB/s | 3.7 MB 00:00 2022-09-20T20:11:36.608 INFO:teuthology.orchestra.run.smithi055.stdout:(74/133): postgresql-server-10.21-2.module+el8. 47 MB/s | 5.1 MB 00:00 2022-09-20T20:11:36.650 INFO:teuthology.orchestra.run.smithi055.stdout:(75/133): thrift-0.13.0-2.el8.x86_64.rpm 3.9 MB/s | 1.7 MB 00:00 2022-09-20T20:11:36.701 INFO:teuthology.orchestra.run.smithi055.stdout:(76/133): python3-markupsafe-0.23-19.el8.x86_64 796 kB/s | 39 kB 00:00 2022-09-20T20:11:37.094 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2022-09-20T20:11:37.098 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2022-09-20T20:11:37.201 INFO:teuthology.orchestra.run.smithi055.stdout:(77/133): ceph-test-17.0.0-15134.gada1013c.el8. 6.3 MB/s | 54 MB 00:08 2022-09-20T20:11:37.243 INFO:teuthology.orchestra.run.smithi055.stdout:(78/133): python3-werkzeug-0.12.2-4.el8.noarch. 721 kB/s | 457 kB 00:00 2022-09-20T20:11:37.268 INFO:teuthology.orchestra.run.smithi055.stdout:(79/133): python3-prettytable-0.7.2-14.el8.noar 77 kB/s | 44 kB 00:00 2022-09-20T20:11:37.310 INFO:teuthology.orchestra.run.smithi055.stdout:(80/133): librdkafka-0.11.4-3.el8.x86_64.rpm 3.2 MB/s | 354 kB 00:00 2022-09-20T20:11:37.352 INFO:teuthology.orchestra.run.smithi055.stdout:(81/133): python3-jinja2-2.10.1-3.el8.noarch.rp 4.8 MB/s | 538 kB 00:00 2022-09-20T20:11:37.385 INFO:teuthology.orchestra.run.smithi055.stdout:(82/133): libtool-2.4.6-25.el8.x86_64.rpm 6.0 MB/s | 709 kB 00:00 2022-09-20T20:11:37.411 INFO:teuthology.orchestra.run.smithi055.stdout:(83/133): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2022-09-20T20:11:37.470 INFO:teuthology.orchestra.run.smithi055.stdout:(84/133): python3-mako-1.0.6-13.el8.noarch.rpm 1.9 MB/s | 157 kB 00:00 2022-09-20T20:11:37.511 INFO:teuthology.orchestra.run.smithi055.stdout:(85/133): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2022-09-20T20:11:37.554 INFO:teuthology.orchestra.run.smithi055.stdout:(86/133): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2022-09-20T20:11:37.629 INFO:teuthology.orchestra.run.smithi055.stdout:(87/133): openblas-threads-0.3.15-3.el8.x86_64. 18 MB/s | 4.9 MB 00:00 2022-09-20T20:11:37.662 INFO:teuthology.orchestra.run.smithi055.stdout:(88/133): flex-2.6.1-9.el8.x86_64.rpm 2.9 MB/s | 320 kB 00:00 2022-09-20T20:11:37.729 INFO:teuthology.orchestra.run.smithi055.stdout:(89/133): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2022-09-20T20:11:37.763 INFO:teuthology.orchestra.run.smithi055.stdout:(90/133): jq-1.6-3.el8.x86_64.rpm 2.0 MB/s | 202 kB 00:00 2022-09-20T20:11:37.822 INFO:teuthology.orchestra.run.smithi055.stdout:(91/133): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2022-09-20T20:11:37.864 INFO:teuthology.orchestra.run.smithi055.stdout:(92/133): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2022-09-20T20:11:37.939 INFO:teuthology.orchestra.run.smithi055.stdout:(93/133): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2022-09-20T20:11:37.973 INFO:teuthology.orchestra.run.smithi055.stdout:(94/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2022-09-20T20:11:37.998 INFO:teuthology.orchestra.run.smithi055.stdout:(95/133): python3-jsonpointer-1.10-11.el8.noarc 342 kB/s | 20 kB 00:00 2022-09-20T20:11:38.040 INFO:teuthology.orchestra.run.smithi055.stdout:(96/133): libpq-13.5-1.el8.x86_64.rpm 2.9 MB/s | 198 kB 00:00 2022-09-20T20:11:38.065 INFO:teuthology.orchestra.run.smithi055.stdout:(97/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.8 MB/s | 259 kB 00:00 2022-09-20T20:11:38.099 INFO:teuthology.orchestra.run.smithi055.stdout:(98/133): oniguruma-6.8.2-2.el8.x86_64.rpm 3.1 MB/s | 187 kB 00:00 2022-09-20T20:11:38.142 INFO:teuthology.orchestra.run.smithi055.stdout:(99/133): python3-jsonpatch-1.21-2.el8.noarch.r 349 kB/s | 27 kB 00:00 2022-09-20T20:11:38.182 INFO:teuthology.orchestra.run.smithi055.stdout:(100/133): python3-pyasn1-modules-0.3.7-6.el8.n 2.7 MB/s | 110 kB 00:00 2022-09-20T20:11:38.200 INFO:teuthology.orchestra.run.smithi055.stdout:(101/133): uuid-1.6.2-43.el8.x86_64.rpm 637 kB/s | 64 kB 00:00 2022-09-20T20:11:38.241 INFO:teuthology.orchestra.run.smithi055.stdout:(102/133): fuse-2.9.7-15.el8.x86_64.rpm 2.0 MB/s | 83 kB 00:00 2022-09-20T20:11:38.267 INFO:teuthology.orchestra.run.smithi055.stdout:(103/133): pcre2-devel-10.32-2.el8.x86_64.rpm 7.0 MB/s | 605 kB 00:00 2022-09-20T20:11:38.300 INFO:teuthology.orchestra.run.smithi055.stdout:(104/133): libsepol-devel-2.9-3.el8.x86_64.rpm 1.4 MB/s | 87 kB 00:00 2022-09-20T20:11:38.326 INFO:teuthology.orchestra.run.smithi055.stdout:(105/133): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.8 MB/s | 220 kB 00:00 2022-09-20T20:11:38.468 INFO:teuthology.orchestra.run.smithi055.stdout:(106/133): python3-scipy-1.0.0-21.module+el8.5. 19 MB/s | 14 MB 00:00 2022-09-20T20:11:38.501 INFO:teuthology.orchestra.run.smithi055.stdout:(107/133): libselinux-devel-2.9-5.el8.x86_64.rp 997 kB/s | 200 kB 00:00 2022-09-20T20:11:38.527 INFO:teuthology.orchestra.run.smithi055.stdout:(108/133): libverto-devel-0.3.0-5.el8.x86_64.rp 90 kB/s | 18 kB 00:00 2022-09-20T20:11:38.552 INFO:teuthology.orchestra.run.smithi055.stdout:(109/133): librabbitmq-0.9.0-3.el8.x86_64.rpm 560 kB/s | 47 kB 00:00 2022-09-20T20:11:38.594 INFO:teuthology.orchestra.run.smithi055.stdout:(110/133): python3-cryptography-3.2.1-5.el8.x86 5.9 MB/s | 559 kB 00:00 2022-09-20T20:11:38.619 INFO:teuthology.orchestra.run.smithi055.stdout:(111/133): python3-oauthlib-2.1.0-1.el8.noarch. 1.6 MB/s | 155 kB 00:00 2022-09-20T20:11:38.644 INFO:teuthology.orchestra.run.smithi055.stdout:(112/133): python3-pycparser-2.14-14.el8.noarch 1.2 MB/s | 109 kB 00:00 2022-09-20T20:11:38.686 INFO:teuthology.orchestra.run.smithi055.stdout:(113/133): krb5-devel-1.18.2-14.el8.x86_64.rpm 5.9 MB/s | 560 kB 00:00 2022-09-20T20:11:38.712 INFO:teuthology.orchestra.run.smithi055.stdout:(114/133): python3-jwt-1.6.1-2.el8.noarch.rpm 649 kB/s | 43 kB 00:00 2022-09-20T20:11:38.737 INFO:teuthology.orchestra.run.smithi055.stdout:(115/133): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.4 MB/s | 171 kB 00:00 2022-09-20T20:11:38.779 INFO:teuthology.orchestra.run.smithi055.stdout:(116/133): zlib-devel-1.2.11-18.el8_5.x86_64.rp 625 kB/s | 58 kB 00:00 2022-09-20T20:11:38.804 INFO:teuthology.orchestra.run.smithi055.stdout:(117/133): elfutils-libelf-devel-0.186-1.el8.x8 649 kB/s | 60 kB 00:00 2022-09-20T20:11:38.855 INFO:teuthology.orchestra.run.smithi055.stdout:(118/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.0 MB/s | 238 kB 00:00 2022-09-20T20:11:38.888 INFO:teuthology.orchestra.run.smithi055.stdout:(119/133): libaio-devel-0.3.112-1.el8.x86_64.rp 172 kB/s | 19 kB 00:00 2022-09-20T20:11:38.922 INFO:teuthology.orchestra.run.smithi055.stdout:(120/133): libuuid-devel-2.32.1-35.el8.x86_64.r 845 kB/s | 98 kB 00:00 2022-09-20T20:11:38.947 INFO:teuthology.orchestra.run.smithi055.stdout:(121/133): NetworkManager-initscripts-updown-1. 1.5 MB/s | 137 kB 00:00 2022-09-20T20:11:38.972 INFO:teuthology.orchestra.run.smithi055.stdout:(122/133): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2022-09-20T20:11:38.997 INFO:teuthology.orchestra.run.smithi055.stdout:(123/133): python3-requests-oauthlib-1.0.0-1.el 576 kB/s | 43 kB 00:00 2022-09-20T20:11:39.023 INFO:teuthology.orchestra.run.smithi055.stdout:(124/133): xfsprogs-devel-5.0.0-10.el8.x86_64.r 958 kB/s | 72 kB 00:00 2022-09-20T20:11:39.048 INFO:teuthology.orchestra.run.smithi055.stdout:(125/133): libcom_err-devel-1.45.6-4.el8.x86_64 512 kB/s | 39 kB 00:00 2022-09-20T20:11:39.073 INFO:teuthology.orchestra.run.smithi055.stdout:(126/133): keyutils-libs-devel-1.5.10-9.el8.x86 982 kB/s | 48 kB 00:00 2022-09-20T20:11:39.107 INFO:teuthology.orchestra.run.smithi055.stdout:(127/133): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2022-09-20T20:11:39.166 INFO:teuthology.orchestra.run.smithi055.stdout:(128/133): openssl-devel-1.1.1k-7.el8_6.x86_64. 14 MB/s | 2.3 MB 00:00 2022-09-20T20:11:39.224 INFO:teuthology.orchestra.run.smithi055.stdout:(129/133): openssl-1.1.1k-7.el8_6.x86_64.rpm 12 MB/s | 709 kB 00:00 2022-09-20T20:11:39.283 INFO:teuthology.orchestra.run.smithi055.stdout:(130/133): openssl-libs-1.1.1k-7.el8_6.x86_64.r 25 MB/s | 1.5 MB 00:00 2022-09-20T20:11:39.325 INFO:teuthology.orchestra.run.smithi055.stdout:(131/133): iproute-5.15.0-4.el8_6.1.x86_64.rpm 19 MB/s | 798 kB 00:00 2022-09-20T20:11:39.775 INFO:teuthology.orchestra.run.smithi055.stdout:(132/133): librados2-17.0.0-15134.gada1013c.el8 5.2 MB/s | 3.6 MB 00:00 2022-09-20T20:11:40.000 INFO:teuthology.orchestra.run.smithi055.stdout:(133/133): librbd1-17.0.0-15134.gada1013c.el8.x 4.0 MB/s | 3.6 MB 00:00 2022-09-20T20:11:40.003 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2022-09-20T20:11:40.003 INFO:teuthology.orchestra.run.smithi055.stdout:Total 12 MB/s | 218 MB 00:17 2022-09-20T20:11:40.887 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2022-09-20T20:11:41.063 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2022-09-20T20:11:41.063 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2022-09-20T20:11:42.292 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2022-09-20T20:11:42.296 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2022-09-20T20:11:42.944 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2022-09-20T20:11:43.179 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/138 2022-09-20T20:11:43.424 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/138 2022-09-20T20:11:43.606 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/138 2022-09-20T20:11:43.779 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/138 2022-09-20T20:11:43.949 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 4/138 2022-09-20T20:11:44.099 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 5/138 2022-09-20T20:11:44.200 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 5/138 2022-09-20T20:11:44.358 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/138 2022-09-20T20:11:44.804 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/138 2022-09-20T20:11:45.041 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librados2-2:17.0.0-15134.gada1013c.el8.x86_64 7/138 2022-09-20T20:11:45.452 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:17.0.0-15134.gada1013c.el8.x86_64 7/138 2022-09-20T20:11:45.778 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librbd1-2:17.0.0-15134.gada1013c.el8.x86_64 8/138 2022-09-20T20:11:46.106 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:17.0.0-15134.gada1013c.el8.x86_64 8/138 2022-09-20T20:11:46.332 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs2-2:17.0.0-15134.gada1013c.el8.x86_64 9/138 2022-09-20T20:11:46.417 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephfs2-2:17.0.0-15134.gada1013c.el8.x86_64 9/138 2022-09-20T20:11:46.616 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rados-2:17.0.0-15134.gada1013c.el8.x86_6 10/138 2022-09-20T20:11:46.859 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libpq-13.5-1.el8.x86_64 11/138 2022-09-20T20:11:47.045 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/138 2022-09-20T20:11:47.405 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/138 2022-09-20T20:11:47.494 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2022-09-20T20:11:47.637 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 14/138 2022-09-20T20:11:47.807 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephsqlite-2:17.0.0-15134.gada1013c.el8.x86_6 15/138 2022-09-20T20:11:47.847 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/138 2022-09-20T20:11:47.914 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephsqlite-2:17.0.0-15134.gada1013c.el8.x86_6 15/138 2022-09-20T20:11:48.057 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libradosstriper1-2:17.0.0-15134.gada1013c.el8.x8 16/138 2022-09-20T20:11:48.075 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/138 2022-09-20T20:11:48.135 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libradosstriper1-2:17.0.0-15134.gada1013c.el8.x8 16/138 2022-09-20T20:11:48.248 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/138 2022-09-20T20:11:48.328 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 17/138 2022-09-20T20:11:48.458 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/138 2022-09-20T20:11:48.606 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 18/138 2022-09-20T20:11:48.608 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/138 2022-09-20T20:11:48.671 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/138 2022-09-20T20:11:48.813 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/138 2022-09-20T20:11:48.911 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 5/138 2022-09-20T20:11:49.005 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 20/138 2022-09-20T20:11:49.075 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/138 2022-09-20T20:11:49.107 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 21/138 2022-09-20T20:11:49.275 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 21/138 2022-09-20T20:11:49.432 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 22/138 2022-09-20T20:11:49.489 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/138 2022-09-20T20:11:49.716 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librados2-2:17.0.0-15134.gada1013c.el8.x86_64 7/138 2022-09-20T20:11:50.091 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 22/138 2022-09-20T20:11:50.131 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-2:17.0.0-15134.gada1013c.el8.x86_64 7/138 2022-09-20T20:11:50.307 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 23/138 2022-09-20T20:11:50.317 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librbd1-2:17.0.0-15134.gada1013c.el8.x86_64 8/138 2022-09-20T20:11:50.448 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-2:17.0.0-15134.gada1013c.el8.x86_64 8/138 2022-09-20T20:11:50.650 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs2-2:17.0.0-15134.gada1013c.el8.x86_64 9/138 2022-09-20T20:11:50.735 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephfs2-2:17.0.0-15134.gada1013c.el8.x86_64 9/138 2022-09-20T20:11:50.941 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 23/138 2022-09-20T20:11:51.082 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-0.3.15-3.el8.x86_64 24/138 2022-09-20T20:11:51.150 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rados-2:17.0.0-15134.gada1013c.el8.x86_6 10/138 2022-09-20T20:11:51.395 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libpq-13.5-1.el8.x86_64 11/138 2022-09-20T20:11:51.563 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/138 2022-09-20T20:11:51.848 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 24/138 2022-09-20T20:11:51.990 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/138 2022-09-20T20:11:52.166 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/138 2022-09-20T20:11:52.187 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 14/138 2022-09-20T20:11:52.383 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephsqlite-2:17.0.0-15134.gada1013c.el8.x86_6 15/138 2022-09-20T20:11:52.417 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/138 2022-09-20T20:11:52.491 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephsqlite-2:17.0.0-15134.gada1013c.el8.x86_6 15/138 2022-09-20T20:11:52.638 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-common-2:17.0.0-15134.gada1013c.el8 27/138 2022-09-20T20:11:52.674 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libradosstriper1-2:17.0.0-15134.gada1013c.el8.x8 16/138 2022-09-20T20:11:52.745 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libradosstriper1-2:17.0.0-15134.gada1013c.el8.x8 16/138 2022-09-20T20:11:52.751 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-argparse-2:17.0.0-15134.gada1013c.e 28/138 2022-09-20T20:11:52.914 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 17/138 2022-09-20T20:11:53.016 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 18/138 2022-09-20T20:11:53.029 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cephfs-2:17.0.0-15134.gada1013c.el8.x86_ 29/138 2022-09-20T20:11:53.169 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 18/138 2022-09-20T20:11:53.248 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/138 2022-09-20T20:11:53.283 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 19/138 2022-09-20T20:11:53.926 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 19/138 2022-09-20T20:11:54.082 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 20/138 2022-09-20T20:11:54.707 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 20/138 2022-09-20T20:11:54.874 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-0.3.15-3.el8.x86_64 21/138 2022-09-20T20:11:55.092 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/138 2022-09-20T20:11:55.437 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 31/138 2022-09-20T20:11:55.595 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 21/138 2022-09-20T20:11:55.864 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 22/138 2022-09-20T20:11:56.064 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 23/138 2022-09-20T20:11:56.348 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/138 2022-09-20T20:11:56.420 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 32/138 2022-09-20T20:11:56.601 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/138 2022-09-20T20:11:56.776 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/138 2022-09-20T20:11:56.835 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/138 2022-09-20T20:11:57.014 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-common-2:17.0.0-15134.gada1013c.el8 27/138 2022-09-20T20:11:57.144 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-argparse-2:17.0.0-15134.gada1013c.e 28/138 2022-09-20T20:11:57.185 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/138 2022-09-20T20:11:57.413 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rsa-4.8-1.el8.noarch 35/138 2022-09-20T20:11:57.421 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cephfs-2:17.0.0-15134.gada1013c.el8.x86_ 29/138 2022-09-20T20:11:57.626 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/138 2022-09-20T20:11:57.854 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rbd-2:17.0.0-15134.gada1013c.el8.x86_64 37/138 2022-09-20T20:11:58.105 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librados-devel-2:17.0.0-15134.gada1013c.el8.x86_ 38/138 2022-09-20T20:11:58.334 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 39/138 2022-09-20T20:11:58.369 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 30/138 2022-09-20T20:11:58.523 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/138 2022-09-20T20:11:58.597 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/138 2022-09-20T20:11:58.721 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/138 2022-09-20T20:11:58.799 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 41/138 2022-09-20T20:11:58.862 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 41/138 2022-09-20T20:11:58.973 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/138 2022-09-20T20:11:59.084 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : jq-1.6-3.el8.x86_64 42/138 2022-09-20T20:11:59.140 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2022-09-20T20:11:59.256 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 43/138 2022-09-20T20:11:59.538 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 44/138 2022-09-20T20:11:59.790 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : automake-1.16.1-7.el8.noarch 45/138 2022-09-20T20:11:59.945 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 46/138 2022-09-20T20:12:00.069 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 47/138 2022-09-20T20:12:00.253 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 48/138 2022-09-20T20:12:00.464 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 49/138 2022-09-20T20:12:00.699 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 50/138 2022-09-20T20:12:00.956 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/138 2022-09-20T20:12:00.987 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2022-09-20T20:12:01.293 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 34/138 2022-09-20T20:12:01.400 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/138 2022-09-20T20:12:01.504 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rsa-4.8-1.el8.noarch 35/138 2022-09-20T20:12:01.702 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/138 2022-09-20T20:12:01.725 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/138 2022-09-20T20:12:01.930 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rbd-2:17.0.0-15134.gada1013c.el8.x86_64 37/138 2022-09-20T20:12:01.935 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/138 2022-09-20T20:12:02.139 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librados-devel-2:17.0.0-15134.gada1013c.el8.x86_ 38/138 2022-09-20T20:12:02.207 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/138 2022-09-20T20:12:02.371 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 39/138 2022-09-20T20:12:02.470 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/138 2022-09-20T20:12:02.495 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 40/138 2022-09-20T20:12:02.678 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 41/138 2022-09-20T20:12:02.882 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/138 2022-09-20T20:12:02.904 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/138 2022-09-20T20:12:03.108 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 43/138 2022-09-20T20:12:03.164 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/138 2022-09-20T20:12:03.315 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 44/138 2022-09-20T20:12:03.315 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/138 2022-09-20T20:12:03.550 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/138 2022-09-20T20:12:03.710 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 61/138 2022-09-20T20:12:03.732 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 45/138 2022-09-20T20:12:04.068 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 62/138 2022-09-20T20:12:04.074 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 46/138 2022-09-20T20:12:04.270 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 63/138 2022-09-20T20:12:04.281 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 47/138 2022-09-20T20:12:04.551 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 64/138 2022-09-20T20:12:04.583 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 48/138 2022-09-20T20:12:04.830 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 49/138 2022-09-20T20:12:04.930 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/138 2022-09-20T20:12:05.158 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 50/138 2022-09-20T20:12:05.191 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/138 2022-09-20T20:12:05.348 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 51/138 2022-09-20T20:12:05.408 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fuse-2.9.7-15.el8.x86_64 67/138 2022-09-20T20:12:05.508 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 52/138 2022-09-20T20:12:05.598 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 68/138 2022-09-20T20:12:05.762 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 69/138 2022-09-20T20:12:05.767 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 53/138 2022-09-20T20:12:05.927 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 54/138 2022-09-20T20:12:06.045 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 70/138 2022-09-20T20:12:06.238 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 71/138 2022-09-20T20:12:06.261 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/138 2022-09-20T20:12:06.435 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 72/138 2022-09-20T20:12:06.462 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/138 2022-09-20T20:12:06.631 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 73/138 2022-09-20T20:12:06.731 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 57/138 2022-09-20T20:12:06.859 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 74/138 2022-09-20T20:12:06.974 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 58/138 2022-09-20T20:12:07.078 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 75/138 2022-09-20T20:12:07.217 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 59/138 2022-09-20T20:12:07.284 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 76/138 2022-09-20T20:12:07.433 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : fuse-2.9.7-15.el8.x86_64 60/138 2022-09-20T20:12:07.450 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 77/138 2022-09-20T20:12:07.614 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/138 2022-09-20T20:12:07.619 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 78/138 2022-09-20T20:12:07.701 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/138 2022-09-20T20:12:07.863 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 79/138 2022-09-20T20:12:07.930 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 62/138 2022-09-20T20:12:08.016 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 62/138 2022-09-20T20:12:08.084 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/138 2022-09-20T20:12:08.214 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : jq-1.6-3.el8.x86_64 63/138 2022-09-20T20:12:08.253 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 81/138 2022-09-20T20:12:08.381 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 64/138 2022-09-20T20:12:08.488 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-portend-2.6-1.el8.noarch 82/138 2022-09-20T20:12:08.653 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 65/138 2022-09-20T20:12:08.680 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/138 2022-09-20T20:12:08.873 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : automake-1.16.1-7.el8.noarch 66/138 2022-09-20T20:12:08.888 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 84/138 2022-09-20T20:12:09.009 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 67/138 2022-09-20T20:12:09.107 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 85/138 2022-09-20T20:12:09.198 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 68/138 2022-09-20T20:12:09.387 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 69/138 2022-09-20T20:12:09.669 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 70/138 2022-09-20T20:12:09.880 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 71/138 2022-09-20T20:12:10.086 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 72/138 2022-09-20T20:12:10.234 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 73/138 2022-09-20T20:12:10.239 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 86/138 2022-09-20T20:12:10.418 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 74/138 2022-09-20T20:12:10.535 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 87/138 2022-09-20T20:12:10.603 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 75/138 2022-09-20T20:12:10.793 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 76/138 2022-09-20T20:12:10.797 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 88/138 2022-09-20T20:12:10.951 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 77/138 2022-09-20T20:12:11.095 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 78/138 2022-09-20T20:12:11.132 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 89/138 2022-09-20T20:12:11.304 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 79/138 2022-09-20T20:12:11.447 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 90/138 2022-09-20T20:12:11.576 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/138 2022-09-20T20:12:11.631 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 91/138 2022-09-20T20:12:11.753 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 81/138 2022-09-20T20:12:11.988 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-portend-2.6-1.el8.noarch 82/138 2022-09-20T20:12:12.205 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/138 2022-09-20T20:12:12.380 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 84/138 2022-09-20T20:12:12.538 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 92/138 2022-09-20T20:12:12.582 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 85/138 2022-09-20T20:12:12.712 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librgw2-2:17.0.0-15134.gada1013c.el8.x86_64 93/138 2022-09-20T20:12:12.791 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librgw2-2:17.0.0-15134.gada1013c.el8.x86_64 93/138 2022-09-20T20:12:12.971 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rgw-2:17.0.0-15134.gada1013c.el8.x86_64 94/138 2022-09-20T20:12:13.741 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 86/138 2022-09-20T20:12:14.003 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 87/138 2022-09-20T20:12:14.273 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 88/138 2022-09-20T20:12:14.568 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 89/138 2022-09-20T20:12:14.831 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 90/138 2022-09-20T20:12:15.040 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 91/138 2022-09-20T20:12:15.823 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 92/138 2022-09-20T20:12:15.972 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librgw2-2:17.0.0-15134.gada1013c.el8.x86_64 93/138 2022-09-20T20:12:16.044 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librgw2-2:17.0.0-15134.gada1013c.el8.x86_64 93/138 2022-09-20T20:12:16.230 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rgw-2:17.0.0-15134.gada1013c.el8.x86_64 94/138 2022-09-20T20:12:17.071 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 95/138 2022-09-20T20:12:18.095 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 95/138 2022-09-20T20:12:18.688 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 95/138 2022-09-20T20:12:18.958 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-base-2:17.0.0-15134.gada1013c.el8.x86_64 96/138 2022-09-20T20:12:19.026 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-base-2:17.0.0-15134.gada1013c.el8.x86_64 96/138 2022-09-20T20:12:19.145 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-selinux-2:17.0.0-15134.gada1013c.el8.x86_64 97/138 2022-09-20T20:12:20.238 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 95/138 2022-09-20T20:12:20.463 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 95/138 2022-09-20T20:12:21.051 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 95/138 2022-09-20T20:12:21.335 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-base-2:17.0.0-15134.gada1013c.el8.x86_64 96/138 2022-09-20T20:12:21.404 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-base-2:17.0.0-15134.gada1013c.el8.x86_64 96/138 2022-09-20T20:12:21.907 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-selinux-2:17.0.0-15134.gada1013c.el8.x86_64 97/138 2022-09-20T20:12:38.622 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-selinux-2:17.0.0-15134.gada1013c.el8.x86_64 97/138 2022-09-20T20:12:38.623 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /sys 2022-09-20T20:12:38.623 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /proc 2022-09-20T20:12:38.624 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2022-09-20T20:12:38.624 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /run 2022-09-20T20:12:38.625 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /mnt 2022-09-20T20:12:38.625 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /var/tmp 2022-09-20T20:12:38.626 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /home 2022-09-20T20:12:38.626 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /tmp 2022-09-20T20:12:38.627 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2022-09-20T20:12:38.627 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:12:39.026 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-volume-2:17.0.0-15134.gada1013c.el8.noarch 98/138 2022-09-20T20:12:40.604 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-volume-2:17.0.0-15134.gada1013c.el8.noarch 98/138 2022-09-20T20:12:40.797 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-osd-2:17.0.0-15134.gada1013c.el8.x86_64 99/138 2022-09-20T20:12:41.026 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-osd-2:17.0.0-15134.gada1013c.el8.x86_64 99/138 2022-09-20T20:12:41.217 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mds-2:17.0.0-15134.gada1013c.el8.x86_64 100/138 2022-09-20T20:12:41.545 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-selinux-2:17.0.0-15134.gada1013c.el8.x86_64 97/138 2022-09-20T20:12:41.546 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /sys 2022-09-20T20:12:41.546 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /proc 2022-09-20T20:12:41.546 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /dev 2022-09-20T20:12:41.547 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /run 2022-09-20T20:12:41.547 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /mnt 2022-09-20T20:12:41.547 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /var/tmp 2022-09-20T20:12:41.547 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /home 2022-09-20T20:12:41.548 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /tmp 2022-09-20T20:12:41.548 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /dev 2022-09-20T20:12:41.548 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:12:41.620 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mds-2:17.0.0-15134.gada1013c.el8.x86_64 100/138 2022-09-20T20:12:41.792 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mon-2:17.0.0-15134.gada1013c.el8.x86_64 101/138 2022-09-20T20:12:41.810 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mon-2:17.0.0-15134.gada1013c.el8.x86_64 101/138 2022-09-20T20:12:41.918 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-volume-2:17.0.0-15134.gada1013c.el8.noarch 98/138 2022-09-20T20:12:43.492 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephadm-2:17.0.0-15134.gada1013c.el8.noarch 102/138 2022-09-20T20:12:43.498 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-volume-2:17.0.0-15134.gada1013c.el8.noarch 98/138 2022-09-20T20:12:43.682 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-osd-2:17.0.0-15134.gada1013c.el8.x86_64 99/138 2022-09-20T20:12:43.682 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephadm-2:17.0.0-15134.gada1013c.el8.noarch 102/138 2022-09-20T20:12:43.798 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-15134.gada1013c. 103/138 2022-09-20T20:12:43.911 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-osd-2:17.0.0-15134.gada1013c.el8.x86_64 99/138 2022-09-20T20:12:44.029 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-15134.gada1013c 104/138 2022-09-20T20:12:44.110 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mds-2:17.0.0-15134.gada1013c.el8.x86_64 100/138 2022-09-20T20:12:44.191 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-15134.gada1013c.el8.no 105/138 2022-09-20T20:12:44.404 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-15134.gada1013c.el8.no 105/138 2022-09-20T20:12:44.514 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mds-2:17.0.0-15134.gada1013c.el8.x86_64 100/138 2022-09-20T20:12:44.659 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mon-2:17.0.0-15134.gada1013c.el8.x86_64 101/138 2022-09-20T20:12:44.677 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mon-2:17.0.0-15134.gada1013c.el8.x86_64 101/138 2022-09-20T20:12:44.687 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-15134.gada1013c.el8. 106/138 2022-09-20T20:12:45.714 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-15134.gada1013c.el8. 106/138 2022-09-20T20:12:45.891 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-15134.gad 107/138 2022-09-20T20:12:45.987 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-15134.gad 107/138 2022-09-20T20:12:46.298 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephadm-2:17.0.0-15134.gada1013c.el8.noarch 102/138 2022-09-20T20:12:46.356 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-15134.gada1013c.e 108/138 2022-09-20T20:12:46.476 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephadm-2:17.0.0-15134.gada1013c.el8.noarch 102/138 2022-09-20T20:12:46.521 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-2:17.0.0-15134.gada1013c.el8.x86_64 109/138 2022-09-20T20:12:46.558 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-2:17.0.0-15134.gada1013c.el8.x86_64 109/138 2022-09-20T20:12:46.574 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-15134.gada1013c. 103/138 2022-09-20T20:12:46.725 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-rook-2:17.0.0-15134.gada1013c.el8.noarc 110/138 2022-09-20T20:12:46.737 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-15134.gada1013c.el8.noarc 110/138 2022-09-20T20:12:46.766 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-15134.gada1013c 104/138 2022-09-20T20:12:46.951 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-15134.gada1013c.el8.no 105/138 2022-09-20T20:12:47.161 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-15134.gada1013c.el8.no 105/138 2022-09-20T20:12:47.422 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-15134.gada1013c.el8. 106/138 2022-09-20T20:12:48.454 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-15134.gada1013c.el8. 106/138 2022-09-20T20:12:48.520 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-2:17.0.0-15134.gada1013c.el8.x86_64 111/138 2022-09-20T20:12:48.625 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-15134.gad 107/138 2022-09-20T20:12:48.720 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-15134.gad 107/138 2022-09-20T20:12:48.743 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-radosgw-2:17.0.0-15134.gada1013c.el8.x86_64 112/138 2022-09-20T20:12:48.778 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-15134.gada1013c.el8.x86_64 112/138 2022-09-20T20:12:48.908 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-15134.gada1 113/138 2022-09-20T20:12:48.952 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-15134.gada1 113/138 2022-09-20T20:12:49.091 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-mirror-2:17.0.0-15134.gada1013c.el8.x86_6 114/138 2022-09-20T20:12:49.116 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-15134.gada1013c.e 108/138 2022-09-20T20:12:49.289 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-2:17.0.0-15134.gada1013c.el8.x86_64 109/138 2022-09-20T20:12:49.324 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-2:17.0.0-15134.gada1013c.el8.x86_64 109/138 2022-09-20T20:12:49.460 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-15134.gada1013c.el8.x86_6 114/138 2022-09-20T20:12:49.484 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-rook-2:17.0.0-15134.gada1013c.el8.noarc 110/138 2022-09-20T20:12:49.496 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-15134.gada1013c.el8.noarc 110/138 2022-09-20T20:12:49.600 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 115/138 2022-09-20T20:12:51.253 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-2:17.0.0-15134.gada1013c.el8.x86_64 111/138 2022-09-20T20:12:51.480 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-radosgw-2:17.0.0-15134.gada1013c.el8.x86_64 112/138 2022-09-20T20:12:51.515 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-15134.gada1013c.el8.x86_64 112/138 2022-09-20T20:12:51.676 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-15134.gada1 113/138 2022-09-20T20:12:51.719 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-15134.gada1 113/138 2022-09-20T20:12:51.925 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-mirror-2:17.0.0-15134.gada1013c.el8.x86_6 114/138 2022-09-20T20:12:52.293 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-15134.gada1013c.el8.x86_6 114/138 2022-09-20T20:12:52.468 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 115/138 2022-09-20T20:12:55.005 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 115/138 2022-09-20T20:12:55.326 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-test-2:17.0.0-15134.gada1013c.el8.x86_64 116/138 2022-09-20T20:12:56.208 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 117/138 2022-09-20T20:12:56.477 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/138 2022-09-20T20:12:56.671 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 119/138 2022-09-20T20:12:56.807 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libtool-2.4.6-25.el8.x86_64 120/138 2022-09-20T20:12:57.010 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 120/138 2022-09-20T20:12:57.253 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 121/138 2022-09-20T20:12:57.386 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs-devel-2:17.0.0-15134.gada1013c.el8.x86 122/138 2022-09-20T20:12:57.549 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 123/138 2022-09-20T20:12:57.866 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: rbd-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 115/138 2022-09-20T20:12:58.189 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-test-2:17.0.0-15134.gada1013c.el8.x86_64 116/138 2022-09-20T20:12:58.458 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libtool-2.4.6-25.el8.x86_64 117/138 2022-09-20T20:12:58.661 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 117/138 2022-09-20T20:12:58.994 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 118/138 2022-09-20T20:12:59.781 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/138 2022-09-20T20:12:59.859 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 119/138 2022-09-20T20:13:00.037 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 124/138 2022-09-20T20:13:00.055 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/138 2022-09-20T20:13:00.110 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 120/138 2022-09-20T20:13:00.329 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 121/138 2022-09-20T20:13:00.349 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-top-2:17.0.0-15134.gada1013c.el8.noarch 125/138 2022-09-20T20:13:00.487 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs-devel-2:17.0.0-15134.gada1013c.el8.x86 122/138 2022-09-20T20:13:00.531 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 126/138 2022-09-20T20:13:00.634 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 123/138 2022-09-20T20:13:00.830 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-nbd-2:17.0.0-15134.gada1013c.el8.x86_64 127/138 2022-09-20T20:13:01.224 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : openssl-1:1.1.1k-7.el8_6.x86_64 128/138 2022-09-20T20:13:01.536 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 129/138 2022-09-20T20:13:01.781 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/138 2022-09-20T20:13:01.861 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/138 2022-09-20T20:13:02.022 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/138 2022-09-20T20:13:02.036 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/138 2022-09-20T20:13:02.214 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-7.el8 132/138 2022-09-20T20:13:02.223 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-7.el8 132/138 2022-09-20T20:13:02.370 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 133/138 2022-09-20T20:13:02.517 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 134/138 2022-09-20T20:13:02.517 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 135/138 2022-09-20T20:13:02.752 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 135/138 2022-09-20T20:13:02.752 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 136/138 2022-09-20T20:13:02.777 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/138 2022-09-20T20:13:03.011 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 124/138 2022-09-20T20:13:03.030 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/138 2022-09-20T20:13:03.034 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 136/138 2022-09-20T20:13:03.034 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 137/138 2022-09-20T20:13:03.325 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-top-2:17.0.0-15134.gada1013c.el8.noarch 125/138 2022-09-20T20:13:03.347 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 137/138 2022-09-20T20:13:03.515 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 126/138 2022-09-20T20:13:03.522 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 138/138 2022-09-20T20:13:03.789 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-nbd-2:17.0.0-15134.gada1013c.el8.x86_64 127/138 2022-09-20T20:13:04.143 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 138/138 2022-09-20T20:13:04.143 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-2:17.0.0-15134.gada1013c.el8.x86_64 1/138 2022-09-20T20:13:04.143 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-base-2:17.0.0-15134.gada1013c.el8.x86_64 2/138 2022-09-20T20:13:04.143 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 3/138 2022-09-20T20:13:04.144 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 4/138 2022-09-20T20:13:04.144 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-15134.gada1 5/138 2022-09-20T20:13:04.144 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mds-2:17.0.0-15134.gada1013c.el8.x86_64 6/138 2022-09-20T20:13:04.144 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-2:17.0.0-15134.gada1013c.el8.x86_64 7/138 2022-09-20T20:13:04.145 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mon-2:17.0.0-15134.gada1013c.el8.x86_64 8/138 2022-09-20T20:13:04.145 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-osd-2:17.0.0-15134.gada1013c.el8.x86_64 9/138 2022-09-20T20:13:04.145 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-radosgw-2:17.0.0-15134.gada1013c.el8.x86_64 10/138 2022-09-20T20:13:04.145 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-selinux-2:17.0.0-15134.gada1013c.el8.x86_64 11/138 2022-09-20T20:13:04.146 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-test-2:17.0.0-15134.gada1013c.el8.x86_64 12/138 2022-09-20T20:13:04.146 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-mirror-2:17.0.0-15134.gada1013c.el8.x86_6 13/138 2022-09-20T20:13:04.146 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs-devel-2:17.0.0-15134.gada1013c.el8.x86 14/138 2022-09-20T20:13:04.146 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs2-2:17.0.0-15134.gada1013c.el8.x86_64 15/138 2022-09-20T20:13:04.147 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephsqlite-2:17.0.0-15134.gada1013c.el8.x86_6 16/138 2022-09-20T20:13:04.147 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados-devel-2:17.0.0-15134.gada1013c.el8.x86_ 17/138 2022-09-20T20:13:04.147 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libradosstriper1-2:17.0.0-15134.gada1013c.el8.x8 18/138 2022-09-20T20:13:04.147 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librgw2-2:17.0.0-15134.gada1013c.el8.x86_64 19/138 2022-09-20T20:13:04.148 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-argparse-2:17.0.0-15134.gada1013c.e 20/138 2022-09-20T20:13:04.148 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-common-2:17.0.0-15134.gada1013c.el8 21/138 2022-09-20T20:13:04.148 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cephfs-2:17.0.0-15134.gada1013c.el8.x86_ 22/138 2022-09-20T20:13:04.148 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rados-2:17.0.0-15134.gada1013c.el8.x86_6 23/138 2022-09-20T20:13:04.149 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rbd-2:17.0.0-15134.gada1013c.el8.x86_64 24/138 2022-09-20T20:13:04.149 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rgw-2:17.0.0-15134.gada1013c.el8.x86_64 25/138 2022-09-20T20:13:04.149 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 26/138 2022-09-20T20:13:04.149 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 27/138 2022-09-20T20:13:04.161 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-nbd-2:17.0.0-15134.gada1013c.el8.x86_64 28/138 2022-09-20T20:13:04.162 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-15134.gada1013c 29/138 2022-09-20T20:13:04.162 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-15134.gada1013c.el8.no 30/138 2022-09-20T20:13:04.162 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-15134.gada1013c.el8. 31/138 2022-09-20T20:13:04.162 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-15134.gad 32/138 2022-09-20T20:13:04.163 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-15134.gada1013c.e 33/138 2022-09-20T20:13:04.163 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-rook-2:17.0.0-15134.gada1013c.el8.noarc 34/138 2022-09-20T20:13:04.163 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-15134.gada1013c. 35/138 2022-09-20T20:13:04.163 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-volume-2:17.0.0-15134.gada1013c.el8.noarch 36/138 2022-09-20T20:13:04.164 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephadm-2:17.0.0-15134.gada1013c.el8.noarch 37/138 2022-09-20T20:13:04.164 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-top-2:17.0.0-15134.gada1013c.el8.noarch 38/138 2022-09-20T20:13:04.164 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/138 2022-09-20T20:13:04.164 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/138 2022-09-20T20:13:04.165 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/138 2022-09-20T20:13:04.165 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/138 2022-09-20T20:13:04.165 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/138 2022-09-20T20:13:04.165 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/138 2022-09-20T20:13:04.166 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/138 2022-09-20T20:13:04.166 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/138 2022-09-20T20:13:04.166 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/138 2022-09-20T20:13:04.166 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/138 2022-09-20T20:13:04.167 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/138 2022-09-20T20:13:04.167 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/138 2022-09-20T20:13:04.167 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/138 2022-09-20T20:13:04.167 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/138 2022-09-20T20:13:04.168 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/138 2022-09-20T20:13:04.168 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/138 2022-09-20T20:13:04.168 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/138 2022-09-20T20:13:04.168 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/138 2022-09-20T20:13:04.168 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/138 2022-09-20T20:13:04.169 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/138 2022-09-20T20:13:04.169 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/138 2022-09-20T20:13:04.169 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/138 2022-09-20T20:13:04.169 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/138 2022-09-20T20:13:04.170 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/138 2022-09-20T20:13:04.170 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/138 2022-09-20T20:13:04.170 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/138 2022-09-20T20:13:04.170 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/138 2022-09-20T20:13:04.171 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/138 2022-09-20T20:13:04.171 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/138 2022-09-20T20:13:04.171 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/138 2022-09-20T20:13:04.171 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/138 2022-09-20T20:13:04.172 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/138 2022-09-20T20:13:04.172 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/138 2022-09-20T20:13:04.172 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 72/138 2022-09-20T20:13:04.172 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 73/138 2022-09-20T20:13:04.173 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 74/138 2022-09-20T20:13:04.173 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/138 2022-09-20T20:13:04.173 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 76/138 2022-09-20T20:13:04.173 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 77/138 2022-09-20T20:13:04.174 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 78/138 2022-09-20T20:13:04.174 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 79/138 2022-09-20T20:13:04.174 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 80/138 2022-09-20T20:13:04.174 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 81/138 2022-09-20T20:13:04.175 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 82/138 2022-09-20T20:13:04.175 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 83/138 2022-09-20T20:13:04.175 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 84/138 2022-09-20T20:13:04.175 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 85/138 2022-09-20T20:13:04.176 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 86/138 2022-09-20T20:13:04.176 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/138 2022-09-20T20:13:04.176 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 88/138 2022-09-20T20:13:04.176 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 89/138 2022-09-20T20:13:04.177 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-7.el8 90/138 2022-09-20T20:13:04.177 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 91/138 2022-09-20T20:13:04.177 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 92/138 2022-09-20T20:13:04.177 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 93/138 2022-09-20T20:13:04.177 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/138 2022-09-20T20:13:04.178 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 95/138 2022-09-20T20:13:04.178 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 96/138 2022-09-20T20:13:04.178 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 97/138 2022-09-20T20:13:04.178 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 98/138 2022-09-20T20:13:04.179 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : bison-3.0.4-10.el8.x86_64 99/138 2022-09-20T20:13:04.179 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 100/138 2022-09-20T20:13:04.179 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 101/138 2022-09-20T20:13:04.179 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 102/138 2022-09-20T20:13:04.180 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 103/138 2022-09-20T20:13:04.180 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 104/138 2022-09-20T20:13:04.180 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 105/138 2022-09-20T20:13:04.180 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 106/138 2022-09-20T20:13:04.181 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 107/138 2022-09-20T20:13:04.181 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/138 2022-09-20T20:13:04.181 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 109/138 2022-09-20T20:13:04.181 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 110/138 2022-09-20T20:13:04.181 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 111/138 2022-09-20T20:13:04.182 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 112/138 2022-09-20T20:13:04.182 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 113/138 2022-09-20T20:13:04.182 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 114/138 2022-09-20T20:13:04.182 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flex-2.6.1-9.el8.x86_64 115/138 2022-09-20T20:13:04.183 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 116/138 2022-09-20T20:13:04.183 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : jq-1.6-3.el8.x86_64 117/138 2022-09-20T20:13:04.183 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 118/138 2022-09-20T20:13:04.183 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : automake-1.16.1-7.el8.noarch 119/138 2022-09-20T20:13:04.184 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 120/138 2022-09-20T20:13:04.184 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 121/138 2022-09-20T20:13:04.184 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 122/138 2022-09-20T20:13:04.184 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libpq-13.5-1.el8.x86_64 123/138 2022-09-20T20:13:04.184 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 124/138 2022-09-20T20:13:04.185 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 125/138 2022-09-20T20:13:04.185 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 126/138 2022-09-20T20:13:04.185 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 127/138 2022-09-20T20:13:04.185 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 128/138 2022-09-20T20:13:04.186 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:17.0.0-15134.gada1013c.el8.x86_64 129/138 2022-09-20T20:13:04.186 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/138 2022-09-20T20:13:04.186 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:17.0.0-15134.gada1013c.el8.x86_64 131/138 2022-09-20T20:13:04.186 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/138 2022-09-20T20:13:04.187 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-1:1.1.1k-7.el8_6.x86_64 133/138 2022-09-20T20:13:04.187 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 134/138 2022-09-20T20:13:04.187 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-libs-1:1.1.1k-7.el8_6.x86_64 135/138 2022-09-20T20:13:04.187 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 136/138 2022-09-20T20:13:04.188 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 137/138 2022-09-20T20:13:04.188 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : openssl-1:1.1.1k-7.el8_6.x86_64 128/138 2022-09-20T20:13:04.409 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 129/138 2022-09-20T20:13:04.574 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-7.el8 130/138 2022-09-20T20:13:04.582 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-7.el8 130/138 2022-09-20T20:13:04.728 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/138 2022-09-20T20:13:04.965 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/138 2022-09-20T20:13:05.046 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/138 2022-09-20T20:13:05.249 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : bison-3.0.4-10.el8.x86_64 133/138 2022-09-20T20:13:05.265 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 133/138 2022-09-20T20:13:05.434 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 134/138 2022-09-20T20:13:05.435 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 135/138 2022-09-20T20:13:05.619 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 135/138 2022-09-20T20:13:05.620 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 136/138 2022-09-20T20:13:05.844 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 136/138 2022-09-20T20:13:05.844 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 137/138 2022-09-20T20:13:06.129 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 137/138 2022-09-20T20:13:06.185 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 138/138 2022-09-20T20:13:06.185 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2022-09-20T20:13:06.323 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 138/138 2022-09-20T20:13:06.466 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:06.467 INFO:teuthology.orchestra.run.smithi008.stdout:Upgraded: 2022-09-20T20:13:06.467 INFO:teuthology.orchestra.run.smithi008.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2022-09-20T20:13:06.467 INFO:teuthology.orchestra.run.smithi008.stdout: librados2-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.468 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.468 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-1:1.1.1k-7.el8_6.x86_64 2022-09-20T20:13:06.468 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-libs-1:1.1.1k-7.el8_6.x86_64 2022-09-20T20:13:06.468 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2022-09-20T20:13:06.468 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-initscripts-updown-1:1.36.0-7.el8_6.noarch 2022-09-20T20:13:06.469 INFO:teuthology.orchestra.run.smithi008.stdout: automake-1.16.1-7.el8.noarch 2022-09-20T20:13:06.469 INFO:teuthology.orchestra.run.smithi008.stdout: bison-3.0.4-10.el8.x86_64 2022-09-20T20:13:06.469 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.469 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.470 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.470 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.470 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:06.470 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.471 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.471 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.471 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:06.471 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:06.472 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:06.472 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:06.472 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:06.472 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.472 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.473 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:06.473 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.473 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.473 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.474 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:06.474 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:06.474 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.474 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:06.475 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2022-09-20T20:13:06.475 INFO:teuthology.orchestra.run.smithi008.stdout: flex-2.6.1-9.el8.x86_64 2022-09-20T20:13:06.475 INFO:teuthology.orchestra.run.smithi008.stdout: fuse-2.9.7-15.el8.x86_64 2022-09-20T20:13:06.475 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-09-20T20:13:06.476 INFO:teuthology.orchestra.run.smithi008.stdout: jq-1.6-3.el8.x86_64 2022-09-20T20:13:06.476 INFO:teuthology.orchestra.run.smithi008.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-09-20T20:13:06.476 INFO:teuthology.orchestra.run.smithi008.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-09-20T20:13:06.476 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-09-20T20:13:06.477 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.477 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.477 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.477 INFO:teuthology.orchestra.run.smithi008.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2022-09-20T20:13:06.477 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2022-09-20T20:13:06.478 INFO:teuthology.orchestra.run.smithi008.stdout: liboath-2.6.2-3.el8.x86_64 2022-09-20T20:13:06.478 INFO:teuthology.orchestra.run.smithi008.stdout: libpq-13.5-1.el8.x86_64 2022-09-20T20:13:06.478 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2022-09-20T20:13:06.478 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-09-20T20:13:06.479 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.479 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.479 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-09-20T20:13:06.479 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.479 INFO:teuthology.orchestra.run.smithi008.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-09-20T20:13:06.480 INFO:teuthology.orchestra.run.smithi008.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-09-20T20:13:06.480 INFO:teuthology.orchestra.run.smithi008.stdout: libtool-2.4.6-25.el8.x86_64 2022-09-20T20:13:06.480 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind-1.3.1-3.el8.x86_64 2022-09-20T20:13:06.480 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2022-09-20T20:13:06.481 INFO:teuthology.orchestra.run.smithi008.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-09-20T20:13:06.481 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-09-20T20:13:06.481 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-09-20T20:13:06.481 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-0.3.15-3.el8.x86_64 2022-09-20T20:13:06.482 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-09-20T20:13:06.482 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2022-09-20T20:13:06.482 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-09-20T20:13:06.482 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-09-20T20:13:06.483 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-09-20T20:13:06.483 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-09-20T20:13:06.483 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-09-20T20:13:06.483 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-09-20T20:13:06.483 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-09-20T20:13:06.484 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel-2.5.1-7.el8.noarch 2022-09-20T20:13:06.484 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-09-20T20:13:06.484 INFO:teuthology.orchestra.run.smithi008.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-09-20T20:13:06.484 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-09-20T20:13:06.485 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.485 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.485 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.485 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-09-20T20:13:06.485 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-09-20T20:13:06.486 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-09-20T20:13:06.486 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-09-20T20:13:06.486 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-09-20T20:13:06.487 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-09-20T20:13:06.487 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-6.2-6.el8.noarch 2022-09-20T20:13:06.487 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-09-20T20:13:06.487 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-09-20T20:13:06.487 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-09-20T20:13:06.488 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-09-20T20:13:06.488 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-09-20T20:13:06.488 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-09-20T20:13:06.488 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-09-20T20:13:06.489 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako-1.0.6-13.el8.noarch 2022-09-20T20:13:06.489 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-09-20T20:13:06.489 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-09-20T20:13:06.489 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-09-20T20:13:06.490 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-09-20T20:13:06.490 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-09-20T20:13:06.490 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-09-20T20:13:06.490 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-09-20T20:13:06.491 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend-2.6-1.el8.noarch 2022-09-20T20:13:06.491 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-09-20T20:13:06.491 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-09-20T20:13:06.491 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-09-20T20:13:06.491 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-09-20T20:13:06.492 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser-2.14-14.el8.noarch 2022-09-20T20:13:06.492 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz-2017.2-9.el8.noarch 2022-09-20T20:13:06.492 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.492 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.493 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-09-20T20:13:06.493 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-09-20T20:13:06.493 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.493 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes-2.4.1-12.el8.noarch 2022-09-20T20:13:06.493 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa-4.8-1.el8.noarch 2022-09-20T20:13:06.494 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2022-09-20T20:13:06.494 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-09-20T20:13:06.494 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-09-20T20:13:06.494 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-09-20T20:13:06.495 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-09-20T20:13:06.495 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-09-20T20:13:06.495 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-09-20T20:13:06.495 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-09-20T20:13:06.495 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-09-20T20:13:06.496 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-09-20T20:13:06.496 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-09-20T20:13:06.496 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.496 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.497 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:06.497 INFO:teuthology.orchestra.run.smithi008.stdout: socat-1.7.4.1-1.el8.x86_64 2022-09-20T20:13:06.497 INFO:teuthology.orchestra.run.smithi008.stdout: thrift-0.13.0-2.el8.x86_64 2022-09-20T20:13:06.497 INFO:teuthology.orchestra.run.smithi008.stdout: uuid-1.6.2-43.el8.x86_64 2022-09-20T20:13:06.498 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-09-20T20:13:06.498 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2022-09-20T20:13:06.498 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2022-09-20T20:13:06.499 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:06.499 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2022-09-20T20:13:06.653 DEBUG:teuthology.parallel:result is None 2022-09-20T20:13:06.917 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 138/138 2022-09-20T20:13:06.918 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-2:17.0.0-15134.gada1013c.el8.x86_64 1/138 2022-09-20T20:13:06.918 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-base-2:17.0.0-15134.gada1013c.el8.x86_64 2/138 2022-09-20T20:13:06.919 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 3/138 2022-09-20T20:13:06.919 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 4/138 2022-09-20T20:13:06.919 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-15134.gada1 5/138 2022-09-20T20:13:06.919 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mds-2:17.0.0-15134.gada1013c.el8.x86_64 6/138 2022-09-20T20:13:06.920 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-2:17.0.0-15134.gada1013c.el8.x86_64 7/138 2022-09-20T20:13:06.920 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mon-2:17.0.0-15134.gada1013c.el8.x86_64 8/138 2022-09-20T20:13:06.920 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-osd-2:17.0.0-15134.gada1013c.el8.x86_64 9/138 2022-09-20T20:13:06.920 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-radosgw-2:17.0.0-15134.gada1013c.el8.x86_64 10/138 2022-09-20T20:13:06.920 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-selinux-2:17.0.0-15134.gada1013c.el8.x86_64 11/138 2022-09-20T20:13:06.921 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-test-2:17.0.0-15134.gada1013c.el8.x86_64 12/138 2022-09-20T20:13:06.921 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-mirror-2:17.0.0-15134.gada1013c.el8.x86_6 13/138 2022-09-20T20:13:06.921 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs-devel-2:17.0.0-15134.gada1013c.el8.x86 14/138 2022-09-20T20:13:06.921 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs2-2:17.0.0-15134.gada1013c.el8.x86_64 15/138 2022-09-20T20:13:06.922 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephsqlite-2:17.0.0-15134.gada1013c.el8.x86_6 16/138 2022-09-20T20:13:06.922 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados-devel-2:17.0.0-15134.gada1013c.el8.x86_ 17/138 2022-09-20T20:13:06.922 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libradosstriper1-2:17.0.0-15134.gada1013c.el8.x8 18/138 2022-09-20T20:13:06.922 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librgw2-2:17.0.0-15134.gada1013c.el8.x86_64 19/138 2022-09-20T20:13:06.923 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-argparse-2:17.0.0-15134.gada1013c.e 20/138 2022-09-20T20:13:06.923 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-common-2:17.0.0-15134.gada1013c.el8 21/138 2022-09-20T20:13:06.923 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cephfs-2:17.0.0-15134.gada1013c.el8.x86_ 22/138 2022-09-20T20:13:06.923 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rados-2:17.0.0-15134.gada1013c.el8.x86_6 23/138 2022-09-20T20:13:06.923 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rbd-2:17.0.0-15134.gada1013c.el8.x86_64 24/138 2022-09-20T20:13:06.924 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rgw-2:17.0.0-15134.gada1013c.el8.x86_64 25/138 2022-09-20T20:13:06.924 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 26/138 2022-09-20T20:13:06.924 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 27/138 2022-09-20T20:13:06.935 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-nbd-2:17.0.0-15134.gada1013c.el8.x86_64 28/138 2022-09-20T20:13:06.936 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-15134.gada1013c 29/138 2022-09-20T20:13:06.936 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-15134.gada1013c.el8.no 30/138 2022-09-20T20:13:06.936 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-15134.gada1013c.el8. 31/138 2022-09-20T20:13:06.936 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-15134.gad 32/138 2022-09-20T20:13:06.937 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-15134.gada1013c.e 33/138 2022-09-20T20:13:06.937 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-rook-2:17.0.0-15134.gada1013c.el8.noarc 34/138 2022-09-20T20:13:06.937 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-15134.gada1013c. 35/138 2022-09-20T20:13:06.937 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-volume-2:17.0.0-15134.gada1013c.el8.noarch 36/138 2022-09-20T20:13:06.937 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephadm-2:17.0.0-15134.gada1013c.el8.noarch 37/138 2022-09-20T20:13:06.938 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-top-2:17.0.0-15134.gada1013c.el8.noarch 38/138 2022-09-20T20:13:06.938 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/138 2022-09-20T20:13:06.938 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/138 2022-09-20T20:13:06.938 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/138 2022-09-20T20:13:06.939 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/138 2022-09-20T20:13:06.939 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/138 2022-09-20T20:13:06.939 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/138 2022-09-20T20:13:06.939 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/138 2022-09-20T20:13:06.940 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/138 2022-09-20T20:13:06.940 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/138 2022-09-20T20:13:06.940 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/138 2022-09-20T20:13:06.940 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/138 2022-09-20T20:13:06.940 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/138 2022-09-20T20:13:06.941 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/138 2022-09-20T20:13:06.941 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/138 2022-09-20T20:13:06.941 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/138 2022-09-20T20:13:06.941 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/138 2022-09-20T20:13:06.941 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/138 2022-09-20T20:13:06.942 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/138 2022-09-20T20:13:06.942 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/138 2022-09-20T20:13:06.942 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/138 2022-09-20T20:13:06.942 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/138 2022-09-20T20:13:06.943 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/138 2022-09-20T20:13:06.943 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/138 2022-09-20T20:13:06.943 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/138 2022-09-20T20:13:06.943 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/138 2022-09-20T20:13:06.943 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/138 2022-09-20T20:13:06.944 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/138 2022-09-20T20:13:06.944 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/138 2022-09-20T20:13:06.944 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/138 2022-09-20T20:13:06.944 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/138 2022-09-20T20:13:06.945 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/138 2022-09-20T20:13:06.945 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/138 2022-09-20T20:13:06.945 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/138 2022-09-20T20:13:06.945 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 72/138 2022-09-20T20:13:06.945 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : bison-3.0.4-10.el8.x86_64 73/138 2022-09-20T20:13:06.946 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 74/138 2022-09-20T20:13:06.946 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 75/138 2022-09-20T20:13:06.946 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 76/138 2022-09-20T20:13:06.946 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/138 2022-09-20T20:13:06.947 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 78/138 2022-09-20T20:13:06.947 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 79/138 2022-09-20T20:13:06.947 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 80/138 2022-09-20T20:13:06.947 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 81/138 2022-09-20T20:13:06.948 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 82/138 2022-09-20T20:13:06.948 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 83/138 2022-09-20T20:13:06.948 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 84/138 2022-09-20T20:13:06.948 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 85/138 2022-09-20T20:13:06.948 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 86/138 2022-09-20T20:13:06.949 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 87/138 2022-09-20T20:13:06.949 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 88/138 2022-09-20T20:13:06.949 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flex-2.6.1-9.el8.x86_64 89/138 2022-09-20T20:13:06.949 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 90/138 2022-09-20T20:13:06.950 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : jq-1.6-3.el8.x86_64 91/138 2022-09-20T20:13:06.950 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 92/138 2022-09-20T20:13:06.950 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : automake-1.16.1-7.el8.noarch 93/138 2022-09-20T20:13:06.950 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 94/138 2022-09-20T20:13:06.951 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 95/138 2022-09-20T20:13:06.951 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 96/138 2022-09-20T20:13:06.951 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libpq-13.5-1.el8.x86_64 97/138 2022-09-20T20:13:06.951 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 98/138 2022-09-20T20:13:06.951 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 99/138 2022-09-20T20:13:06.952 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 100/138 2022-09-20T20:13:06.952 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 101/138 2022-09-20T20:13:06.952 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/138 2022-09-20T20:13:06.952 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 103/138 2022-09-20T20:13:06.953 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 104/138 2022-09-20T20:13:06.953 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 105/138 2022-09-20T20:13:06.953 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/138 2022-09-20T20:13:06.953 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 107/138 2022-09-20T20:13:06.954 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 108/138 2022-09-20T20:13:06.954 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 109/138 2022-09-20T20:13:06.954 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 110/138 2022-09-20T20:13:06.954 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 111/138 2022-09-20T20:13:06.954 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 112/138 2022-09-20T20:13:06.955 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 113/138 2022-09-20T20:13:06.955 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 114/138 2022-09-20T20:13:06.955 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 115/138 2022-09-20T20:13:06.955 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 116/138 2022-09-20T20:13:06.956 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 117/138 2022-09-20T20:13:06.956 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/138 2022-09-20T20:13:06.956 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 119/138 2022-09-20T20:13:06.956 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 120/138 2022-09-20T20:13:06.957 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-7.el8 121/138 2022-09-20T20:13:06.957 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 122/138 2022-09-20T20:13:06.957 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 123/138 2022-09-20T20:13:06.957 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 124/138 2022-09-20T20:13:06.957 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/138 2022-09-20T20:13:06.958 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 126/138 2022-09-20T20:13:06.958 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 127/138 2022-09-20T20:13:06.958 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 128/138 2022-09-20T20:13:06.958 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-2:17.0.0-15134.gada1013c.el8.x86_64 129/138 2022-09-20T20:13:06.959 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/138 2022-09-20T20:13:06.959 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-2:17.0.0-15134.gada1013c.el8.x86_64 131/138 2022-09-20T20:13:06.959 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/138 2022-09-20T20:13:06.959 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-1:1.1.1k-7.el8_6.x86_64 133/138 2022-09-20T20:13:06.960 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 134/138 2022-09-20T20:13:06.960 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-libs-1:1.1.1k-7.el8_6.x86_64 135/138 2022-09-20T20:13:06.960 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 136/138 2022-09-20T20:13:06.960 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 137/138 2022-09-20T20:13:08.891 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 138/138 2022-09-20T20:13:08.891 INFO:teuthology.orchestra.run.smithi055.stdout:Installed products updated. 2022-09-20T20:13:09.134 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:09.134 INFO:teuthology.orchestra.run.smithi055.stdout:Upgraded: 2022-09-20T20:13:09.134 INFO:teuthology.orchestra.run.smithi055.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2022-09-20T20:13:09.135 INFO:teuthology.orchestra.run.smithi055.stdout: librados2-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.135 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.135 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-1:1.1.1k-7.el8_6.x86_64 2022-09-20T20:13:09.135 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-libs-1:1.1.1k-7.el8_6.x86_64 2022-09-20T20:13:09.135 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2022-09-20T20:13:09.136 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-initscripts-updown-1:1.36.0-7.el8_6.noarch 2022-09-20T20:13:09.136 INFO:teuthology.orchestra.run.smithi055.stdout: automake-1.16.1-7.el8.noarch 2022-09-20T20:13:09.136 INFO:teuthology.orchestra.run.smithi055.stdout: bison-3.0.4-10.el8.x86_64 2022-09-20T20:13:09.136 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.137 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.137 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.137 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.137 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:09.137 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.138 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.138 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.138 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:09.138 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:09.139 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:09.139 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:09.139 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:09.139 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.139 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.140 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:09.140 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.140 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.140 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.140 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-volume-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:09.141 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:09.141 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.141 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-top-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:13:09.141 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2022-09-20T20:13:09.142 INFO:teuthology.orchestra.run.smithi055.stdout: flex-2.6.1-9.el8.x86_64 2022-09-20T20:13:09.142 INFO:teuthology.orchestra.run.smithi055.stdout: fuse-2.9.7-15.el8.x86_64 2022-09-20T20:13:09.142 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-09-20T20:13:09.142 INFO:teuthology.orchestra.run.smithi055.stdout: jq-1.6-3.el8.x86_64 2022-09-20T20:13:09.142 INFO:teuthology.orchestra.run.smithi055.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-09-20T20:13:09.143 INFO:teuthology.orchestra.run.smithi055.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-09-20T20:13:09.143 INFO:teuthology.orchestra.run.smithi055.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-09-20T20:13:09.143 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.143 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.144 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.144 INFO:teuthology.orchestra.run.smithi055.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2022-09-20T20:13:09.144 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2022-09-20T20:13:09.144 INFO:teuthology.orchestra.run.smithi055.stdout: liboath-2.6.2-3.el8.x86_64 2022-09-20T20:13:09.144 INFO:teuthology.orchestra.run.smithi055.stdout: libpq-13.5-1.el8.x86_64 2022-09-20T20:13:09.145 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2022-09-20T20:13:09.145 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-09-20T20:13:09.145 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.145 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.145 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-09-20T20:13:09.146 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.146 INFO:teuthology.orchestra.run.smithi055.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-09-20T20:13:09.146 INFO:teuthology.orchestra.run.smithi055.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-09-20T20:13:09.146 INFO:teuthology.orchestra.run.smithi055.stdout: libtool-2.4.6-25.el8.x86_64 2022-09-20T20:13:09.147 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind-1.3.1-3.el8.x86_64 2022-09-20T20:13:09.147 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2022-09-20T20:13:09.147 INFO:teuthology.orchestra.run.smithi055.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-09-20T20:13:09.147 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-09-20T20:13:09.147 INFO:teuthology.orchestra.run.smithi055.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-09-20T20:13:09.148 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-0.3.15-3.el8.x86_64 2022-09-20T20:13:09.148 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-09-20T20:13:09.148 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2022-09-20T20:13:09.148 INFO:teuthology.orchestra.run.smithi055.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-09-20T20:13:09.149 INFO:teuthology.orchestra.run.smithi055.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-09-20T20:13:09.149 INFO:teuthology.orchestra.run.smithi055.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-09-20T20:13:09.149 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-09-20T20:13:09.149 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-09-20T20:13:09.149 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-09-20T20:13:09.150 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-09-20T20:13:09.150 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel-2.5.1-7.el8.noarch 2022-09-20T20:13:09.150 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-09-20T20:13:09.150 INFO:teuthology.orchestra.run.smithi055.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-09-20T20:13:09.151 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-09-20T20:13:09.151 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.151 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.151 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.151 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-09-20T20:13:09.152 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-09-20T20:13:09.152 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-09-20T20:13:09.152 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-09-20T20:13:09.152 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-09-20T20:13:09.152 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-09-20T20:13:09.153 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-6.2-6.el8.noarch 2022-09-20T20:13:09.153 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-09-20T20:13:09.153 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-09-20T20:13:09.153 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-09-20T20:13:09.154 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-09-20T20:13:09.154 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-09-20T20:13:09.154 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-09-20T20:13:09.154 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-09-20T20:13:09.154 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako-1.0.6-13.el8.noarch 2022-09-20T20:13:09.155 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-09-20T20:13:09.155 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-09-20T20:13:09.155 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-09-20T20:13:09.155 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-09-20T20:13:09.155 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-09-20T20:13:09.156 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-09-20T20:13:09.156 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-09-20T20:13:09.156 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend-2.6-1.el8.noarch 2022-09-20T20:13:09.156 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-09-20T20:13:09.157 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-09-20T20:13:09.157 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-09-20T20:13:09.157 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-09-20T20:13:09.157 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pycparser-2.14-14.el8.noarch 2022-09-20T20:13:09.157 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz-2017.2-9.el8.noarch 2022-09-20T20:13:09.158 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.158 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.158 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-09-20T20:13:09.158 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-09-20T20:13:09.159 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.159 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes-2.4.1-12.el8.noarch 2022-09-20T20:13:09.159 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa-4.8-1.el8.noarch 2022-09-20T20:13:09.159 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2022-09-20T20:13:09.159 INFO:teuthology.orchestra.run.smithi055.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-09-20T20:13:09.160 INFO:teuthology.orchestra.run.smithi055.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-09-20T20:13:09.160 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-09-20T20:13:09.160 INFO:teuthology.orchestra.run.smithi055.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-09-20T20:13:09.160 INFO:teuthology.orchestra.run.smithi055.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-09-20T20:13:09.161 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-09-20T20:13:09.161 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-09-20T20:13:09.161 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-09-20T20:13:09.161 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-09-20T20:13:09.161 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-09-20T20:13:09.162 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.162 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.162 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:13:09.162 INFO:teuthology.orchestra.run.smithi055.stdout: socat-1.7.4.1-1.el8.x86_64 2022-09-20T20:13:09.162 INFO:teuthology.orchestra.run.smithi055.stdout: thrift-0.13.0-2.el8.x86_64 2022-09-20T20:13:09.163 INFO:teuthology.orchestra.run.smithi055.stdout: uuid-1.6.2-43.el8.x86_64 2022-09-20T20:13:09.163 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-09-20T20:13:09.163 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2022-09-20T20:13:09.164 INFO:teuthology.orchestra.run.smithi055.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2022-09-20T20:13:09.164 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:09.164 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2022-09-20T20:13:09.317 DEBUG:teuthology.parallel:result is None 2022-09-20T20:13:09.318 DEBUG:teuthology.orchestra.run.smithi008:> sudo lsb_release -is 2022-09-20T20:13:09.386 INFO:teuthology.orchestra.run.smithi008.stdout:RedHatEnterprise 2022-09-20T20:13:09.388 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-20T20:13:09.389 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ada1013c357729fc3bf91fdc0bbe1d411f5af166 2022-09-20T20:13:09.580 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-09-20T20:13:09.608 INFO:teuthology.orchestra.run.smithi008.stdout:17.0.0-15134.gada1013c.el8 2022-09-20T20:13:09.609 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-15134.gada1013c.el8 2022-09-20T20:13:09.609 INFO:teuthology.task.install:The correct ceph version 17.0.0-15134.gada1013c is installed. 2022-09-20T20:13:09.610 DEBUG:teuthology.orchestra.run.smithi055:> sudo lsb_release -is 2022-09-20T20:13:09.670 INFO:teuthology.orchestra.run.smithi055.stdout:RedHatEnterprise 2022-09-20T20:13:09.671 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-09-20T20:13:09.672 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ada1013c357729fc3bf91fdc0bbe1d411f5af166 2022-09-20T20:13:09.887 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-09-20T20:13:09.911 INFO:teuthology.orchestra.run.smithi055.stdout:17.0.0-15134.gada1013c.el8 2022-09-20T20:13:09.911 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-15134.gada1013c.el8 2022-09-20T20:13:09.912 INFO:teuthology.task.install:The correct ceph version 17.0.0-15134.gada1013c is installed. 2022-09-20T20:13:09.912 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-09-20T20:13:09.913 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:09.913 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-09-20T20:13:09.946 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:09.947 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-09-20T20:13:09.979 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-09-20T20:13:09.979 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:09.980 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/daemon-helper 2022-09-20T20:13:10.017 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-09-20T20:13:10.087 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:10.088 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/daemon-helper 2022-09-20T20:13:10.115 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-09-20T20:13:10.182 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-09-20T20:13:10.183 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:10.183 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/adjust-ulimits 2022-09-20T20:13:10.213 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-09-20T20:13:10.282 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:10.282 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/adjust-ulimits 2022-09-20T20:13:10.309 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-09-20T20:13:10.376 INFO:teuthology.run_tasks:Running task ceph... 2022-09-20T20:13:10.436 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2022-09-20T20:13:10.437 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 777 /var/log/ceph 2022-09-20T20:13:10.440 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 777 /var/log/ceph 2022-09-20T20:13:10.468 INFO:tasks.ceph:Disabling ceph logrotate... 2022-09-20T20:13:10.469 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/logrotate.d/ceph 2022-09-20T20:13:10.511 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/logrotate.d/ceph 2022-09-20T20:13:10.538 INFO:tasks.ceph:Creating extra log directories... 2022-09-20T20:13:10.538 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-09-20T20:13:10.580 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-09-20T20:13:10.613 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2022-09-20T20:13:10.614 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2022-09-20T20:13:10.614 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2022-09-20T20:13:10.615 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:10.615 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-09-20T20:13:10.664 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-09-20T20:13:10.781 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-09-20T20:13:10.810 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:10.811 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-09-20T20:13:10.829 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-09-20T20:13:10.943 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-09-20T20:13:10.977 INFO:tasks.ceph:Creating ceph cluster ceph... 2022-09-20T20:13:10.977 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'MDS_FAILED', 'MDS_DAMAGE'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2022-09-20T20:13:10.978 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2022-09-20_19:41:25-fs:functional-wip-pdonnell-testing-20220920.151129-distro-default-smithi/7039474', 'branch': 'wip-pdonnell-testing-20220920.151129', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7039474', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2022-09-20_19:41:25-fs:functional-wip-pdonnell-testing-20220920.151129-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20220920.151129'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'MDS_FAILED', 'MDS_DAMAGE'], 'sha1': 'ada1013c357729fc3bf91fdc0bbe1d411f5af166'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ada1013c357729fc3bf91fdc0bbe1d411f5af166'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20220920.151129', 'sha1': '7874f3907d0b2e2027e668918a6854269060504f'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 50, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'ada1013c357729fc3bf91fdc0bbe1d411f5af166', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-pdonnell-testing-20220920.151129', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_7874f3907d0b2e2027e668918a6854269060504f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': '7874f3907d0b2e2027e668918a6854269060504f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi008.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDLgOG79UlSPojUvsXMAdJKtxnK8pUkfrR6/98kX770g/U15z4vI5dh/pxom/CGgt/4zv7ThmAm1HzeyodrPcmqAP8vUEtVAJBfY2fH61uKwXADHCLUlRyaQo99MoikBbln1s0W3I/CJgObOY4iJWic2FMmft25BqtJqX5J3Mgv2Y2/vynyAUWcyIumgCGYR+r6LeiMK1gPUcRF6Aea06sDcGZK63dhFszd0XJlh0y9tasYIrRZriiS55m4QWv0EMLaUsInflrrsxOEQg+Hgq7AlrbX7255tFZ9FCy4gOBhdjIRf2GRIW8eMRCmcyL8cN8QH3LqGVMuseGe2Yqwz9JlIth3Lm7pPVnct+HcFiOiGGKmIZ01fcvs6lsfwzBzWixND1NL1aGicCw1nCtUW5PgBB5IcgDsWGgAAS6BWt1/FAKgemQbpMTpQN/j6oQFVNKIUIlRupCEqslOVJcV7PQUuonRMQDFBjgNmZb6tFN1ARU6xg/36pyWC1BHvLt4eQ8=', 'smithi055.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0ybvTUkYqxKf7p+YrbwPIFOMzGEFxu7x4d8q7BJsgWqDJGjzDUK7ULkwNgPxoumVBHwH6co8Cv5+oZ400ZvfHDKwt46H00/8mrKtQ6woEhXka6zOFtnDa2IFa9Y3EpQMOumhroSPRw6ouibdwHrodYtPPY69+y1R6AqT6V2JHK1JTs6Q0Slp7LLODIqoI1fRn/E00INXdCreq9dzxFKUrdmybyVuczzF1k6sw9i/6BjF4KWd4kVsr5+iBgFlGQ/y+ndwFvJ0Y4UVqIi/9ulFiq910+xCneV5T2/R2jb5hqfNfPCHZ8BODgWmg+2TnSQft0tpEXS/TLUw3IFiXGwYUNIYMlJLcHX+534OnFqi6Su/H+gz4uuC8liFSO0HJuAoDqlt6/S8qQQQI+2PPPFtef4PobshJb3SmxKBOBbUTQdKxgduLPFtw4PX8BAIaCtaylMg1CvthvroU14KSFVGtrHSzzcsUEUW589IkxwkAhRBaShmv6gOxZw9p3zA0cnk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ada1013c357729fc3bf91fdc0bbe1d411f5af166'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_recovery_pool']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b58f2c18636eb10faa77ed3614abd00cb85dfc2c', 'timestamp': '2022-09-20_19:41:25', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.20382'} 2022-09-20T20:13:10.979 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-09-20T20:13:10.982 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-09-20T20:13:11.028 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m0777 -- /var/run/ceph 2022-09-20T20:13:11.039 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/run/ceph 2022-09-20T20:13:11.095 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:11.096 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/scratch_devs of=/dev/stdout 2022-09-20T20:13:11.122 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-09-20T20:13:11.123 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-09-20T20:13:11.179 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-09-20T20:13:11.180 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-20T20:13:11.180 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 359265 Links: 1 2022-09-20T20:13:11.180 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-20T20:13:11.180 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2022-09-20T20:13:11.180 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2022-09-20 20:13:03.791084434 +0000 2022-09-20T20:13:11.181 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2022-09-20 20:10:15.172976868 +0000 2022-09-20T20:13:11.181 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2022-09-20 20:10:15.172976868 +0000 2022-09-20T20:13:11.181 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2022-09-20T20:13:11.189 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2022-09-20T20:13:11.190 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2022-09-20T20:13:11.190 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000104706 s, 4.9 MB/s 2022-09-20T20:13:11.193 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-09-20T20:13:11.251 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-09-20T20:13:11.251 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-20T20:13:11.251 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 357642 Links: 1 2022-09-20T20:13:11.251 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-20T20:13:11.252 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2022-09-20T20:13:11.252 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2022-09-20 20:13:03.792084423 +0000 2022-09-20T20:13:11.252 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2022-09-20 20:10:15.708971426 +0000 2022-09-20T20:13:11.252 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2022-09-20 20:10:15.708971426 +0000 2022-09-20T20:13:11.253 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2022-09-20T20:13:11.261 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2022-09-20T20:13:11.261 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2022-09-20T20:13:11.261 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000105077 s, 4.9 MB/s 2022-09-20T20:13:11.264 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-09-20T20:13:11.321 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-09-20T20:13:11.322 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-20T20:13:11.322 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 363771 Links: 1 2022-09-20T20:13:11.322 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-20T20:13:11.322 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2022-09-20T20:13:11.323 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2022-09-20 20:13:03.792084423 +0000 2022-09-20T20:13:11.323 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2022-09-20 20:10:16.326965151 +0000 2022-09-20T20:13:11.323 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2022-09-20 20:10:16.326965151 +0000 2022-09-20T20:13:11.323 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2022-09-20T20:13:11.331 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2022-09-20T20:13:11.331 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2022-09-20T20:13:11.332 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 9.7998e-05 s, 5.2 MB/s 2022-09-20T20:13:11.334 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-09-20T20:13:11.391 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-09-20T20:13:11.391 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-20T20:13:11.392 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 6h/6d Inode: 357833 Links: 1 2022-09-20T20:13:11.392 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-20T20:13:11.392 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2022-09-20T20:13:11.392 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2022-09-20 20:13:03.792084423 +0000 2022-09-20T20:13:11.393 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2022-09-20 20:10:16.867959658 +0000 2022-09-20T20:13:11.393 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2022-09-20 20:10:16.867959658 +0000 2022-09-20T20:13:11.393 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: - 2022-09-20T20:13:11.401 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2022-09-20T20:13:11.401 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2022-09-20T20:13:11.402 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.00010239 s, 5.0 MB/s 2022-09-20T20:13:11.404 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-09-20T20:13:11.405 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:11.405 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/scratch_devs of=/dev/stdout 2022-09-20T20:13:11.424 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-09-20T20:13:11.424 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-09-20T20:13:11.481 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-09-20T20:13:11.482 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-20T20:13:11.482 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 354127 Links: 1 2022-09-20T20:13:11.482 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-20T20:13:11.482 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2022-09-20T20:13:11.483 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2022-09-20 20:13:06.567683531 +0000 2022-09-20T20:13:11.483 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2022-09-20 20:10:14.470707195 +0000 2022-09-20T20:13:11.483 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2022-09-20 20:10:14.470707195 +0000 2022-09-20T20:13:11.483 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: - 2022-09-20T20:13:11.492 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2022-09-20T20:13:11.492 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2022-09-20T20:13:11.492 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000304525 s, 1.7 MB/s 2022-09-20T20:13:11.495 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-09-20T20:13:11.552 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-09-20T20:13:11.553 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-20T20:13:11.553 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 361514 Links: 1 2022-09-20T20:13:11.553 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-20T20:13:11.554 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2022-09-20T20:13:11.554 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2022-09-20 20:13:06.567683531 +0000 2022-09-20T20:13:11.554 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2022-09-20 20:10:15.016696698 +0000 2022-09-20T20:13:11.554 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2022-09-20 20:10:15.016696698 +0000 2022-09-20T20:13:11.554 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: - 2022-09-20T20:13:11.563 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2022-09-20T20:13:11.563 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2022-09-20T20:13:11.563 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000251314 s, 2.0 MB/s 2022-09-20T20:13:11.566 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-09-20T20:13:11.623 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-09-20T20:13:11.624 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-20T20:13:11.624 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 362603 Links: 1 2022-09-20T20:13:11.624 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-20T20:13:11.624 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2022-09-20T20:13:11.624 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2022-09-20 20:13:06.567683531 +0000 2022-09-20T20:13:11.625 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2022-09-20 20:10:15.569686066 +0000 2022-09-20T20:13:11.625 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2022-09-20 20:10:15.569686066 +0000 2022-09-20T20:13:11.625 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: - 2022-09-20T20:13:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2022-09-20T20:13:11.634 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2022-09-20T20:13:11.634 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000273085 s, 1.9 MB/s 2022-09-20T20:13:11.636 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-09-20T20:13:11.695 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-09-20T20:13:11.695 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-20T20:13:11.695 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 361627 Links: 1 2022-09-20T20:13:11.695 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-20T20:13:11.696 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2022-09-20T20:13:11.697 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2022-09-20 20:13:06.567683531 +0000 2022-09-20T20:13:11.697 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2022-09-20 20:10:16.135675184 +0000 2022-09-20T20:13:11.697 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2022-09-20 20:10:16.135675184 +0000 2022-09-20T20:13:11.697 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: - 2022-09-20T20:13:11.705 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2022-09-20T20:13:11.705 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2022-09-20T20:13:11.705 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000278131 s, 1.8 MB/s 2022-09-20T20:13:11.708 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-09-20T20:13:11.708 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi008.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-09-20T20:13:11.708 INFO:tasks.ceph:Generating config... 2022-09-20T20:13:11.710 INFO:tasks.ceph:[client] client mount timeout = 600 2022-09-20T20:13:11.711 INFO:tasks.ceph:[client] debug client = 20 2022-09-20T20:13:11.711 INFO:tasks.ceph:[client] debug ms = 1 2022-09-20T20:13:11.711 INFO:tasks.ceph:[client] pid file = 2022-09-20T20:13:11.712 INFO:tasks.ceph:[client] rados mon op timeout = 900 2022-09-20T20:13:11.712 INFO:tasks.ceph:[client] rados osd op timeout = 900 2022-09-20T20:13:11.712 INFO:tasks.ceph:[global] ms die on skipped message = False 2022-09-20T20:13:11.713 INFO:tasks.ceph:[mds] debug mds = 20 2022-09-20T20:13:11.713 INFO:tasks.ceph:[mds] debug mds balancer = 20 2022-09-20T20:13:11.713 INFO:tasks.ceph:[mds] debug ms = 1 2022-09-20T20:13:11.714 INFO:tasks.ceph:[mds] mds debug frag = True 2022-09-20T20:13:11.714 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2022-09-20T20:13:11.714 INFO:tasks.ceph:[mds] mds op complaint time = 180 2022-09-20T20:13:11.715 INFO:tasks.ceph:[mds] mds verify scatter = True 2022-09-20T20:13:11.715 INFO:tasks.ceph:[mds] osd op complaint time = 180 2022-09-20T20:13:11.715 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2022-09-20T20:13:11.716 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2022-09-20T20:13:11.716 INFO:tasks.ceph:[mgr] debug mgr = 20 2022-09-20T20:13:11.716 INFO:tasks.ceph:[mgr] debug ms = 1 2022-09-20T20:13:11.717 INFO:tasks.ceph:[mon] debug mon = 20 2022-09-20T20:13:11.717 INFO:tasks.ceph:[mon] debug ms = 1 2022-09-20T20:13:11.717 INFO:tasks.ceph:[mon] debug paxos = 20 2022-09-20T20:13:11.717 INFO:tasks.ceph:[mon] mon op complaint time = 120 2022-09-20T20:13:11.718 INFO:tasks.ceph:[osd] bdev async discard = True 2022-09-20T20:13:11.718 INFO:tasks.ceph:[osd] bdev enable discard = True 2022-09-20T20:13:11.718 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2022-09-20T20:13:11.719 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2022-09-20T20:13:11.719 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2022-09-20T20:13:11.719 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2022-09-20T20:13:11.720 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2022-09-20T20:13:11.720 INFO:tasks.ceph:[osd] debug ms = 1 2022-09-20T20:13:11.720 INFO:tasks.ceph:[osd] debug osd = 20 2022-09-20T20:13:11.721 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2022-09-20T20:13:11.721 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2022-09-20T20:13:11.721 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2022-09-20T20:13:11.722 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2022-09-20T20:13:11.722 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2022-09-20T20:13:11.722 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2022-09-20T20:13:11.722 INFO:tasks.ceph:[osd] osd op complaint time = 180 2022-09-20T20:13:11.723 INFO:tasks.ceph:Setting up mon.a... 2022-09-20T20:13:11.723 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2022-09-20T20:13:11.772 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.keyring 2022-09-20T20:13:11.775 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2022-09-20T20:13:11.821 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-09-20T20:13:11.849 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.8'), ('mon.b', '172.21.15.55'), ('mon.c', '[v2:172.21.15.55:3301,v1:172.21.15.55:6790]')] 2022-09-20T20:13:11.850 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.8,172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2022-09-20T20:13:11.851 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:11.851 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2022-09-20T20:13:11.906 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.8 --add b 172.21.15.55 --addv c '[v2:172.21.15.55:3301,v1:172.21.15.55:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:13:11.994 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:13:11.995 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: generated fsid e2fce34f-6561-47ef-8379-911f2b368662 2022-09-20T20:13:11.995 INFO:teuthology.orchestra.run.smithi008.stdout:setting min_mon_release = octopus 2022-09-20T20:13:11.995 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 0 2022-09-20T20:13:11.995 INFO:teuthology.orchestra.run.smithi008.stdout:fsid e2fce34f-6561-47ef-8379-911f2b368662 2022-09-20T20:13:11.996 INFO:teuthology.orchestra.run.smithi008.stdout:last_changed 2022-09-20T20:13:11.994144+0000 2022-09-20T20:13:11.996 INFO:teuthology.orchestra.run.smithi008.stdout:created 2022-09-20T20:13:11.994144+0000 2022-09-20T20:13:11.996 INFO:teuthology.orchestra.run.smithi008.stdout:min_mon_release 15 (octopus) 2022-09-20T20:13:11.996 INFO:teuthology.orchestra.run.smithi008.stdout:election_strategy: 1 2022-09-20T20:13:11.997 INFO:teuthology.orchestra.run.smithi008.stdout:0: [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] mon.a 2022-09-20T20:13:11.997 INFO:teuthology.orchestra.run.smithi008.stdout:1: [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] mon.b 2022-09-20T20:13:11.997 INFO:teuthology.orchestra.run.smithi008.stdout:2: [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] mon.c 2022-09-20T20:13:11.997 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2022-09-20T20:13:11.999 DEBUG:teuthology.orchestra.run.smithi008:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2022-09-20T20:13:12.016 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e2fce34f-6561-47ef-8379-911f2b368662... 2022-09-20T20:13:12.017 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-09-20T20:13:12.059 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-09-20T20:13:12.134 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2022-09-20T20:13:12.134 INFO:teuthology.orchestra.run.smithi008.stdout: chdir = "" 2022-09-20T20:13:12.135 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-09-20T20:13:12.135 INFO:teuthology.orchestra.run.smithi008.stdout: auth supported = cephx 2022-09-20T20:13:12.135 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.135 INFO:teuthology.orchestra.run.smithi008.stdout: filestore xattr use omap = true 2022-09-20T20:13:12.136 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.136 INFO:teuthology.orchestra.run.smithi008.stdout: mon clock drift allowed = 1.000 2022-09-20T20:13:12.136 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.136 INFO:teuthology.orchestra.run.smithi008.stdout: osd crush chooseleaf type = 0 2022-09-20T20:13:12.137 INFO:teuthology.orchestra.run.smithi008.stdout: auth debug = true 2022-09-20T20:13:12.137 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.137 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on old message = true 2022-09-20T20:13:12.137 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on bug = true 2022-09-20T20:13:12.137 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.138 INFO:teuthology.orchestra.run.smithi008.stdout: mon max pg per osd = 10000 # >= luminous 2022-09-20T20:13:12.138 INFO:teuthology.orchestra.run.smithi008.stdout: mon pg warn max object skew = 0 2022-09-20T20:13:12.138 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.138 INFO:teuthology.orchestra.run.smithi008.stdout: # disable pg_autoscaler by default for new pools 2022-09-20T20:13:12.139 INFO:teuthology.orchestra.run.smithi008.stdout: osd_pool_default_pg_autoscale_mode = off 2022-09-20T20:13:12.139 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.139 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default size = 2 2022-09-20T20:13:12.139 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.140 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow primary affinity = true 2022-09-20T20:13:12.140 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd allow pg remap = true 2022-09-20T20:13:12.140 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on legacy crush tunables = false 2022-09-20T20:13:12.140 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on crush straw calc version zero = false 2022-09-20T20:13:12.140 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on no sortbitwise = false 2022-09-20T20:13:12.141 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on osd down out interval zero = false 2022-09-20T20:13:12.141 INFO:teuthology.orchestra.run.smithi008.stdout: mon warn on too few osds = false 2022-09-20T20:13:12.141 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-09-20T20:13:12.141 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_pool_no_redundancy = false 2022-09-20T20:13:12.141 INFO:teuthology.orchestra.run.smithi008.stdout: mon_allow_pool_size_one = true 2022-09-20T20:13:12.142 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.142 INFO:teuthology.orchestra.run.smithi008.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-09-20T20:13:12.142 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.142 INFO:teuthology.orchestra.run.smithi008.stdout: osd default data pool replay window = 5 2022-09-20T20:13:12.143 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.143 INFO:teuthology.orchestra.run.smithi008.stdout: mon allow pool delete = true 2022-09-20T20:13:12.143 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.143 INFO:teuthology.orchestra.run.smithi008.stdout: mon cluster log file level = debug 2022-09-20T20:13:12.143 INFO:teuthology.orchestra.run.smithi008.stdout: debug asserts on shutdown = true 2022-09-20T20:13:12.144 INFO:teuthology.orchestra.run.smithi008.stdout: mon health detail to clog = false 2022-09-20T20:13:12.144 INFO:teuthology.orchestra.run.smithi008.stdout: mon host = "172.21.15.8,172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790]" 2022-09-20T20:13:12.144 INFO:teuthology.orchestra.run.smithi008.stdout: ms die on skipped message = False 2022-09-20T20:13:12.144 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = e2fce34f-6561-47ef-8379-911f2b368662 2022-09-20T20:13:12.145 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.145 INFO:teuthology.orchestra.run.smithi008.stdout:[osd] 2022-09-20T20:13:12.145 INFO:teuthology.orchestra.run.smithi008.stdout: osd journal size = 100 2022-09-20T20:13:12.145 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.145 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub load threshold = 5.0 2022-09-20T20:13:12.146 INFO:teuthology.orchestra.run.smithi008.stdout: osd scrub max interval = 600 2022-09-20T20:13:12.146 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.146 INFO:teuthology.orchestra.run.smithi008.stdout: osd recover clone overlap = true 2022-09-20T20:13:12.146 INFO:teuthology.orchestra.run.smithi008.stdout: osd recovery max chunk = 1048576 2022-09-20T20:13:12.147 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.147 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug shutdown = true 2022-09-20T20:13:12.147 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug op order = true 2022-09-20T20:13:12.147 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug verify stray on activate = true 2022-09-20T20:13:12.148 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.148 INFO:teuthology.orchestra.run.smithi008.stdout: osd open classes on start = true 2022-09-20T20:13:12.148 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug pg log writeout = true 2022-09-20T20:13:12.148 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.148 INFO:teuthology.orchestra.run.smithi008.stdout: osd deep scrub update digest min age = 30 2022-09-20T20:13:12.149 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.149 INFO:teuthology.orchestra.run.smithi008.stdout: osd map max advance = 10 2022-09-20T20:13:12.149 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.149 INFO:teuthology.orchestra.run.smithi008.stdout: journal zero on create = true 2022-09-20T20:13:12.150 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.150 INFO:teuthology.orchestra.run.smithi008.stdout: filestore ondisk finisher threads = 3 2022-09-20T20:13:12.150 INFO:teuthology.orchestra.run.smithi008.stdout: filestore apply finisher threads = 3 2022-09-20T20:13:12.150 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.150 INFO:teuthology.orchestra.run.smithi008.stdout: bdev debug aio = true 2022-09-20T20:13:12.151 INFO:teuthology.orchestra.run.smithi008.stdout: osd debug misdirected ops = true 2022-09-20T20:13:12.151 INFO:teuthology.orchestra.run.smithi008.stdout: bdev async discard = True 2022-09-20T20:13:12.151 INFO:teuthology.orchestra.run.smithi008.stdout: bdev enable discard = True 2022-09-20T20:13:12.151 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore allocator = bitmap 2022-09-20T20:13:12.151 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore block size = 96636764160 2022-09-20T20:13:12.152 INFO:teuthology.orchestra.run.smithi008.stdout: bluestore fsck on mount = True 2022-09-20T20:13:12.152 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluefs = 1/20 2022-09-20T20:13:12.152 INFO:teuthology.orchestra.run.smithi008.stdout: debug bluestore = 1/20 2022-09-20T20:13:12.152 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2022-09-20T20:13:12.153 INFO:teuthology.orchestra.run.smithi008.stdout: debug osd = 20 2022-09-20T20:13:12.153 INFO:teuthology.orchestra.run.smithi008.stdout: debug rocksdb = 4/10 2022-09-20T20:13:12.153 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd backfillfull_ratio = 0.85 2022-09-20T20:13:12.153 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd full ratio = 0.9 2022-09-20T20:13:12.154 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd nearfull ratio = 0.8 2022-09-20T20:13:12.154 INFO:teuthology.orchestra.run.smithi008.stdout: osd failsafe full ratio = 0.95 2022-09-20T20:13:12.154 INFO:teuthology.orchestra.run.smithi008.stdout: osd objectstore = bluestore 2022-09-20T20:13:12.154 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2022-09-20T20:13:12.154 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.155 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr] 2022-09-20T20:13:12.155 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2022-09-20T20:13:12.155 INFO:teuthology.orchestra.run.smithi008.stdout: debug mgr = 20 2022-09-20T20:13:12.155 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2022-09-20T20:13:12.155 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2022-09-20T20:13:12.156 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2022-09-20T20:13:12.156 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2022-09-20T20:13:12.156 INFO:teuthology.orchestra.run.smithi008.stdout: mgr/telemetry/nag = false 2022-09-20T20:13:12.156 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.156 INFO:teuthology.orchestra.run.smithi008.stdout:[mon] 2022-09-20T20:13:12.157 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2022-09-20T20:13:12.157 INFO:teuthology.orchestra.run.smithi008.stdout: debug mon = 20 2022-09-20T20:13:12.157 INFO:teuthology.orchestra.run.smithi008.stdout: debug paxos = 20 2022-09-20T20:13:12.157 INFO:teuthology.orchestra.run.smithi008.stdout: debug auth = 20 2022-09-20T20:13:12.158 INFO:teuthology.orchestra.run.smithi008.stdout: mon data avail warn = 5 2022-09-20T20:13:12.158 INFO:teuthology.orchestra.run.smithi008.stdout: mon mgr mkfs grace = 240 2022-09-20T20:13:12.158 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min pgs per osd = 4 2022-09-20T20:13:12.158 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd reporter subtree level = osd 2022-09-20T20:13:12.159 INFO:teuthology.orchestra.run.smithi008.stdout: mon osd prime pg temp = true 2022-09-20T20:13:12.159 INFO:teuthology.orchestra.run.smithi008.stdout: mon reweight min bytes per osd = 10 2022-09-20T20:13:12.159 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.159 INFO:teuthology.orchestra.run.smithi008.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-09-20T20:13:12.159 INFO:teuthology.orchestra.run.smithi008.stdout: auth mon ticket ttl = 660 # 11m 2022-09-20T20:13:12.160 INFO:teuthology.orchestra.run.smithi008.stdout: auth service ticket ttl = 240 # 4m 2022-09-20T20:13:12.160 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.160 INFO:teuthology.orchestra.run.smithi008.stdout: # don't complain about insecure global_id in the test suite 2022-09-20T20:13:12.160 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-09-20T20:13:12.160 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-09-20T20:13:12.161 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.161 INFO:teuthology.orchestra.run.smithi008.stdout: # 1m isn't quite enough 2022-09-20T20:13:12.161 INFO:teuthology.orchestra.run.smithi008.stdout: mon_down_mkfs_grace = 2m 2022-09-20T20:13:12.161 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.161 INFO:teuthology.orchestra.run.smithi008.stdout: mon_warn_on_filestore_osds = false 2022-09-20T20:13:12.162 INFO:teuthology.orchestra.run.smithi008.stdout: mon op complaint time = 120 2022-09-20T20:13:12.162 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:12.162 INFO:teuthology.orchestra.run.smithi008.stdout:[client] 2022-09-20T20:13:12.162 INFO:teuthology.orchestra.run.smithi008.stdout: rgw cache enabled = true 2022-09-20T20:13:12.163 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable ops log = true 2022-09-20T20:13:12.163 INFO:teuthology.orchestra.run.smithi008.stdout: rgw enable usage log = true 2022-09-20T20:13:12.163 INFO:teuthology.orchestra.run.smithi008.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-09-20T20:13:12.163 INFO:teuthology.orchestra.run.smithi008.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-09-20T20:13:12.163 INFO:teuthology.orchestra.run.smithi008.stdout: client mount timeout = 600 2022-09-20T20:13:12.164 INFO:teuthology.orchestra.run.smithi008.stdout: debug client = 20 2022-09-20T20:13:12.164 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2022-09-20T20:13:12.164 INFO:teuthology.orchestra.run.smithi008.stdout: pid file = "" 2022-09-20T20:13:12.164 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2022-09-20T20:13:12.165 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2022-09-20T20:13:12.165 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.a] 2022-09-20T20:13:12.165 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.b] 2022-09-20T20:13:12.165 INFO:teuthology.orchestra.run.smithi008.stdout:[mon.c] 2022-09-20T20:13:12.165 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2022-09-20T20:13:12.166 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2022-09-20T20:13:12.166 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2022-09-20T20:13:12.166 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d] 2022-09-20T20:13:12.166 INFO:teuthology.orchestra.run.smithi008.stdout:[mds] 2022-09-20T20:13:12.167 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds = 20 2022-09-20T20:13:12.167 INFO:teuthology.orchestra.run.smithi008.stdout: debug mds balancer = 20 2022-09-20T20:13:12.167 INFO:teuthology.orchestra.run.smithi008.stdout: debug ms = 1 2022-09-20T20:13:12.167 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug frag = True 2022-09-20T20:13:12.167 INFO:teuthology.orchestra.run.smithi008.stdout: mds debug scatterstat = True 2022-09-20T20:13:12.168 INFO:teuthology.orchestra.run.smithi008.stdout: mds op complaint time = 180 2022-09-20T20:13:12.168 INFO:teuthology.orchestra.run.smithi008.stdout: mds verify scatter = True 2022-09-20T20:13:12.168 INFO:teuthology.orchestra.run.smithi008.stdout: osd op complaint time = 180 2022-09-20T20:13:12.168 INFO:teuthology.orchestra.run.smithi008.stdout: rados mon op timeout = 900 2022-09-20T20:13:12.168 INFO:teuthology.orchestra.run.smithi008.stdout: rados osd op timeout = 900 2022-09-20T20:13:12.179 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2022-09-20T20:13:12.180 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2022-09-20T20:13:12.180 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-09-20T20:13:12.180 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2022-09-20T20:13:12.181 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.181 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2022-09-20T20:13:12.181 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.181 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2022-09-20T20:13:12.181 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.182 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2022-09-20T20:13:12.182 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2022-09-20T20:13:12.182 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.182 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2022-09-20T20:13:12.183 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2022-09-20T20:13:12.183 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.183 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2022-09-20T20:13:12.183 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2022-09-20T20:13:12.184 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.184 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2022-09-20T20:13:12.184 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2022-09-20T20:13:12.184 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.184 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2022-09-20T20:13:12.185 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.185 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2022-09-20T20:13:12.185 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2022-09-20T20:13:12.185 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2022-09-20T20:13:12.186 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2022-09-20T20:13:12.186 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2022-09-20T20:13:12.186 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2022-09-20T20:13:12.186 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2022-09-20T20:13:12.186 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-09-20T20:13:12.187 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2022-09-20T20:13:12.187 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2022-09-20T20:13:12.187 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.187 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-09-20T20:13:12.188 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.188 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2022-09-20T20:13:12.188 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.188 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2022-09-20T20:13:12.188 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.189 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2022-09-20T20:13:12.189 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2022-09-20T20:13:12.189 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2022-09-20T20:13:12.189 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.8,172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790]" 2022-09-20T20:13:12.190 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2022-09-20T20:13:12.190 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = e2fce34f-6561-47ef-8379-911f2b368662 2022-09-20T20:13:12.190 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.190 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2022-09-20T20:13:12.190 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2022-09-20T20:13:12.191 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.191 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2022-09-20T20:13:12.191 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2022-09-20T20:13:12.191 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.192 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2022-09-20T20:13:12.192 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2022-09-20T20:13:12.192 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.192 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2022-09-20T20:13:12.192 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2022-09-20T20:13:12.193 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2022-09-20T20:13:12.193 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.193 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2022-09-20T20:13:12.193 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2022-09-20T20:13:12.194 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.194 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2022-09-20T20:13:12.194 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.194 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2022-09-20T20:13:12.194 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.195 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2022-09-20T20:13:12.195 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.195 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2022-09-20T20:13:12.195 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2022-09-20T20:13:12.196 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.196 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2022-09-20T20:13:12.196 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2022-09-20T20:13:12.196 INFO:teuthology.orchestra.run.smithi055.stdout: bdev async discard = True 2022-09-20T20:13:12.196 INFO:teuthology.orchestra.run.smithi055.stdout: bdev enable discard = True 2022-09-20T20:13:12.197 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore allocator = bitmap 2022-09-20T20:13:12.197 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2022-09-20T20:13:12.197 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2022-09-20T20:13:12.197 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 1/20 2022-09-20T20:13:12.197 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 1/20 2022-09-20T20:13:12.198 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2022-09-20T20:13:12.198 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2022-09-20T20:13:12.198 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 4/10 2022-09-20T20:13:12.198 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2022-09-20T20:13:12.199 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2022-09-20T20:13:12.199 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2022-09-20T20:13:12.199 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2022-09-20T20:13:12.199 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2022-09-20T20:13:12.200 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2022-09-20T20:13:12.200 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.200 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2022-09-20T20:13:12.200 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2022-09-20T20:13:12.200 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2022-09-20T20:13:12.201 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2022-09-20T20:13:12.201 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2022-09-20T20:13:12.201 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2022-09-20T20:13:12.201 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2022-09-20T20:13:12.201 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2022-09-20T20:13:12.202 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.202 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2022-09-20T20:13:12.202 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2022-09-20T20:13:12.202 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2022-09-20T20:13:12.203 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2022-09-20T20:13:12.203 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2022-09-20T20:13:12.203 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2022-09-20T20:13:12.203 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2022-09-20T20:13:12.204 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2022-09-20T20:13:12.204 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2022-09-20T20:13:12.204 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2022-09-20T20:13:12.204 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2022-09-20T20:13:12.204 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.205 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-09-20T20:13:12.205 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2022-09-20T20:13:12.205 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2022-09-20T20:13:12.205 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.206 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2022-09-20T20:13:12.206 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-09-20T20:13:12.206 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-09-20T20:13:12.206 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.206 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2022-09-20T20:13:12.207 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2022-09-20T20:13:12.207 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.207 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2022-09-20T20:13:12.207 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2022-09-20T20:13:12.208 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-09-20T20:13:12.208 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2022-09-20T20:13:12.208 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2022-09-20T20:13:12.208 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2022-09-20T20:13:12.208 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2022-09-20T20:13:12.209 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-09-20T20:13:12.209 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-09-20T20:13:12.209 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2022-09-20T20:13:12.209 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2022-09-20T20:13:12.210 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2022-09-20T20:13:12.210 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2022-09-20T20:13:12.210 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2022-09-20T20:13:12.210 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2022-09-20T20:13:12.211 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2022-09-20T20:13:12.211 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2022-09-20T20:13:12.211 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2022-09-20T20:13:12.211 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2022-09-20T20:13:12.211 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2022-09-20T20:13:12.212 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2022-09-20T20:13:12.212 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2022-09-20T20:13:12.212 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2022-09-20T20:13:12.212 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2022-09-20T20:13:12.213 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2022-09-20T20:13:12.213 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2022-09-20T20:13:12.213 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2022-09-20T20:13:12.213 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = True 2022-09-20T20:13:12.213 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2022-09-20T20:13:12.214 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = True 2022-09-20T20:13:12.214 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2022-09-20T20:13:12.214 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2022-09-20T20:13:12.214 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2022-09-20T20:13:12.216 INFO:tasks.ceph:Creating admin key on mon.a... 2022-09-20T20:13:12.216 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2022-09-20T20:13:12.274 INFO:tasks.ceph:Copying monmap to all nodes... 2022-09-20T20:13:12.275 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:12.275 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2022-09-20T20:13:12.292 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:12.293 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2022-09-20T20:13:12.349 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi008.front.sepia.ceph.com 2022-09-20T20:13:12.350 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:12.350 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.keyring 2022-09-20T20:13:12.350 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-09-20T20:13:12.427 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:12.427 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:13:12.484 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi055.front.sepia.ceph.com 2022-09-20T20:13:12.485 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:12.485 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.keyring 2022-09-20T20:13:12.486 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-09-20T20:13:12.526 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:12.527 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:13:12.585 INFO:tasks.ceph:Setting up mon nodes... 2022-09-20T20:13:12.586 INFO:tasks.ceph:Setting up mgr nodes... 2022-09-20T20:13:12.586 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2022-09-20T20:13:12.641 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2022-09-20T20:13:12.644 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2022-09-20T20:13:12.705 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2022-09-20T20:13:12.708 INFO:tasks.ceph:Setting up mds nodes... 2022-09-20T20:13:12.709 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2022-09-20T20:13:12.764 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2022-09-20T20:13:12.766 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2022-09-20T20:13:12.794 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2022-09-20T20:13:12.889 INFO:teuthology.orchestra.run.smithi008.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2022-09-20T20:13:12.892 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2022-09-20T20:13:12.920 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2022-09-20T20:13:12.979 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2022-09-20T20:13:12.981 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2022-09-20T20:13:13.010 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2022-09-20T20:13:13.105 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2022-09-20T20:13:13.108 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2022-09-20T20:13:13.136 INFO:tasks.ceph_client:Setting up client nodes... 2022-09-20T20:13:13.137 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-09-20T20:13:13.182 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.client.0.keyring 2022-09-20T20:13:13.195 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2022-09-20T20:13:13.280 INFO:teuthology.orchestra.run.smithi008.stdout:creating /etc/ceph/ceph.client.2.keyring 2022-09-20T20:13:13.293 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2022-09-20T20:13:13.339 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.1.keyring 2022-09-20T20:13:13.352 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2022-09-20T20:13:13.396 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.3.keyring 2022-09-20T20:13:13.410 INFO:tasks.ceph:Running mkfs on osd nodes... 2022-09-20T20:13:13.411 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi008.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-09-20T20:13:13.412 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2022-09-20T20:13:13.440 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-09-20T20:13:13.440 INFO:tasks.ceph:role: osd.0 2022-09-20T20:13:13.441 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi008.front.sepia.ceph.com 2022-09-20T20:13:13.441 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-09-20T20:13:13.507 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-09-20T20:13:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-20T20:13:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-20T20:13:13.508 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-09-20T20:13:13.509 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-20T20:13:13.509 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2022-09-20T20:13:13.510 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-20T20:13:13.510 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-20T20:13:13.511 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-20T20:13:13.511 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-20T20:13:13.530 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2022-09-20T20:13:13.532 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2022-09-20T20:13:13.532 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2022-09-20T20:13:13.613 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2022-09-20T20:13:13.687 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2022-09-20T20:13:13.755 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-09-20T20:13:13.755 INFO:tasks.ceph:role: osd.1 2022-09-20T20:13:13.756 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi008.front.sepia.ceph.com 2022-09-20T20:13:13.756 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-09-20T20:13:13.822 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-09-20T20:13:13.823 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-20T20:13:13.823 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-20T20:13:13.823 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-09-20T20:13:13.824 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-20T20:13:13.824 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2022-09-20T20:13:13.825 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-20T20:13:13.825 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-20T20:13:13.826 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-20T20:13:13.826 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-20T20:13:13.844 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2022-09-20T20:13:13.846 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2022-09-20T20:13:13.846 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2022-09-20T20:13:13.927 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2022-09-20T20:13:13.999 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2022-09-20T20:13:14.067 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-09-20T20:13:14.067 INFO:tasks.ceph:role: osd.2 2022-09-20T20:13:14.068 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi008.front.sepia.ceph.com 2022-09-20T20:13:14.068 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-09-20T20:13:14.134 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-09-20T20:13:14.134 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-20T20:13:14.135 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-20T20:13:14.135 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-09-20T20:13:14.135 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-20T20:13:14.135 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2022-09-20T20:13:14.136 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-20T20:13:14.136 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-20T20:13:14.136 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-20T20:13:14.137 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-20T20:13:14.156 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2022-09-20T20:13:14.158 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2022-09-20T20:13:14.159 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2022-09-20T20:13:14.238 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2022-09-20T20:13:14.309 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2022-09-20T20:13:14.376 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-09-20T20:13:14.377 INFO:tasks.ceph:role: osd.3 2022-09-20T20:13:14.377 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi008.front.sepia.ceph.com 2022-09-20T20:13:14.378 DEBUG:teuthology.orchestra.run.smithi008:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-09-20T20:13:14.443 INFO:teuthology.orchestra.run.smithi008.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-09-20T20:13:14.443 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-20T20:13:14.443 INFO:teuthology.orchestra.run.smithi008.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-20T20:13:14.444 INFO:teuthology.orchestra.run.smithi008.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-09-20T20:13:14.444 INFO:teuthology.orchestra.run.smithi008.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-20T20:13:14.444 INFO:teuthology.orchestra.run.smithi008.stdout: = sunit=0 swidth=0 blks 2022-09-20T20:13:14.444 INFO:teuthology.orchestra.run.smithi008.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-20T20:13:14.445 INFO:teuthology.orchestra.run.smithi008.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-20T20:13:14.445 INFO:teuthology.orchestra.run.smithi008.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-20T20:13:14.445 INFO:teuthology.orchestra.run.smithi008.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-20T20:13:14.466 INFO:teuthology.orchestra.run.smithi008.stdout:Discarding blocks...Done. 2022-09-20T20:13:14.468 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi008.front.sepia.ceph.com -o noatime 2022-09-20T20:13:14.468 DEBUG:teuthology.orchestra.run.smithi008:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2022-09-20T20:13:14.548 DEBUG:teuthology.orchestra.run.smithi008:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2022-09-20T20:13:14.619 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:13:14.707 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:14.705+0000 7fdd6737e5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2022-09-20T20:13:14.708 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:14.705+0000 7fdd6737e5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2022-09-20T20:13:14.708 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:14.705+0000 7fdd6737e5c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-09-20T20:13:14.708 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:14.705+0000 7fdd6737e5c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-09-20T20:13:14.708 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:14.706+0000 7fdd6737e5c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-09-20T20:13:14.709 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:14.706+0000 7fdd6737e5c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2022-09-20T20:13:17.576 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-09-20T20:13:17.610 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:13:17.704 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:17.701+0000 7f5c971135c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2022-09-20T20:13:17.704 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:17.702+0000 7f5c971135c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2022-09-20T20:13:17.704 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:17.702+0000 7f5c971135c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-09-20T20:13:17.705 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:17.702+0000 7f5c971135c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-09-20T20:13:17.705 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:17.702+0000 7f5c971135c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-09-20T20:13:17.705 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:17.702+0000 7f5c971135c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2022-09-20T20:13:20.575 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-09-20T20:13:20.608 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:13:20.702 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:20.700+0000 7f116f8c55c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2022-09-20T20:13:20.703 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:20.700+0000 7f116f8c55c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2022-09-20T20:13:20.703 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:20.700+0000 7f116f8c55c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-09-20T20:13:20.703 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:20.700+0000 7f116f8c55c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-09-20T20:13:20.704 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:20.700+0000 7f116f8c55c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-09-20T20:13:20.704 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:20.701+0000 7f116f8c55c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2022-09-20T20:13:23.570 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-09-20T20:13:23.604 DEBUG:teuthology.orchestra.run.smithi008:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:13:23.699 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:23.696+0000 7f68750aa5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2022-09-20T20:13:23.699 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:23.696+0000 7f68750aa5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2022-09-20T20:13:23.700 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:23.696+0000 7f68750aa5c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-09-20T20:13:23.700 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:23.696+0000 7f68750aa5c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-09-20T20:13:23.701 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:23.696+0000 7f68750aa5c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-09-20T20:13:23.701 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:23.696+0000 7f68750aa5c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2022-09-20T20:13:26.562 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-09-20T20:13:26.595 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2022-09-20T20:13:26.629 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-09-20T20:13:26.630 INFO:tasks.ceph:role: osd.4 2022-09-20T20:13:26.630 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com 2022-09-20T20:13:26.630 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-09-20T20:13:26.730 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-09-20T20:13:26.731 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-20T20:13:26.731 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-20T20:13:26.731 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-09-20T20:13:26.732 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-20T20:13:26.732 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2022-09-20T20:13:26.732 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-20T20:13:26.732 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-20T20:13:26.733 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-20T20:13:26.733 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-20T20:13:28.034 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2022-09-20T20:13:28.036 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2022-09-20T20:13:28.036 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2022-09-20T20:13:28.087 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2022-09-20T20:13:28.121 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2022-09-20T20:13:28.191 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-09-20T20:13:28.192 INFO:tasks.ceph:role: osd.5 2022-09-20T20:13:28.192 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com 2022-09-20T20:13:28.192 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-09-20T20:13:28.290 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-09-20T20:13:28.290 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-20T20:13:28.291 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-20T20:13:28.291 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-09-20T20:13:28.291 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-20T20:13:28.291 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2022-09-20T20:13:28.292 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-20T20:13:28.292 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-20T20:13:28.292 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-20T20:13:28.292 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-20T20:13:29.590 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2022-09-20T20:13:29.592 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2022-09-20T20:13:29.593 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2022-09-20T20:13:29.642 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2022-09-20T20:13:29.676 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2022-09-20T20:13:29.745 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-09-20T20:13:29.746 INFO:tasks.ceph:role: osd.6 2022-09-20T20:13:29.746 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com 2022-09-20T20:13:29.747 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-09-20T20:13:29.843 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-09-20T20:13:29.843 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-20T20:13:29.844 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-20T20:13:29.844 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-09-20T20:13:29.844 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-20T20:13:29.844 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2022-09-20T20:13:29.844 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-20T20:13:29.845 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-20T20:13:29.845 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-20T20:13:29.845 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-20T20:13:31.159 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2022-09-20T20:13:31.159 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2022-09-20T20:13:31.160 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2022-09-20T20:13:31.208 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2022-09-20T20:13:31.242 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2022-09-20T20:13:31.311 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-09-20T20:13:31.312 INFO:tasks.ceph:role: osd.7 2022-09-20T20:13:31.312 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com 2022-09-20T20:13:31.312 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-09-20T20:13:31.408 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-09-20T20:13:31.409 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-20T20:13:31.409 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-20T20:13:31.409 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-09-20T20:13:31.410 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-20T20:13:31.410 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2022-09-20T20:13:31.410 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-20T20:13:31.411 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-20T20:13:31.411 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-20T20:13:31.411 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-20T20:13:32.694 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2022-09-20T20:13:32.696 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2022-09-20T20:13:32.697 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2022-09-20T20:13:32.745 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2022-09-20T20:13:32.780 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:13:32.872 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:32.870+0000 7f4c2a45a5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2022-09-20T20:13:32.872 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:32.870+0000 7f4c2a45a5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2022-09-20T20:13:32.872 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:32.870+0000 7f4c2a45a5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-09-20T20:13:32.873 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:32.870+0000 7f4c2a45a5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-09-20T20:13:32.873 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:32.870+0000 7f4c2a45a5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-09-20T20:13:32.873 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:32.871+0000 7f4c2a45a5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2022-09-20T20:13:35.743 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-09-20T20:13:35.775 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:13:35.870 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:35.869+0000 7fb9e8c7f5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2022-09-20T20:13:35.871 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:35.869+0000 7fb9e8c7f5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2022-09-20T20:13:35.871 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:35.869+0000 7fb9e8c7f5c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-09-20T20:13:35.871 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:35.869+0000 7fb9e8c7f5c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-09-20T20:13:35.871 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:35.869+0000 7fb9e8c7f5c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-09-20T20:13:35.872 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:35.870+0000 7fb9e8c7f5c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2022-09-20T20:13:38.744 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-09-20T20:13:38.778 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:13:38.873 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:38.871+0000 7fa0e4ccd5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2022-09-20T20:13:38.874 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:38.872+0000 7fa0e4ccd5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2022-09-20T20:13:38.874 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:38.872+0000 7fa0e4ccd5c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-09-20T20:13:38.874 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:38.872+0000 7fa0e4ccd5c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-09-20T20:13:38.874 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:38.872+0000 7fa0e4ccd5c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-09-20T20:13:38.875 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:38.873+0000 7fa0e4ccd5c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2022-09-20T20:13:40.981 DEBUG:teuthology.orchestra.run.smithi008:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-20T20:13:40.984 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-20T20:13:41.743 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2022-09-20T20:13:41.776 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:13:41.871 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:41.869+0000 7f910c9b45c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2022-09-20T20:13:41.871 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:41.869+0000 7f910c9b45c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2022-09-20T20:13:41.871 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:41.869+0000 7f910c9b45c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-09-20T20:13:41.872 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:41.869+0000 7f910c9b45c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-09-20T20:13:41.872 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:41.869+0000 7f910c9b45c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-09-20T20:13:41.872 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:41.870+0000 7f910c9b45c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2022-09-20T20:13:44.773 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2022-09-20T20:13:44.806 INFO:tasks.ceph:Reading keys from all nodes... 2022-09-20T20:13:44.806 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:44.807 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2022-09-20T20:13:44.840 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:44.841 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2022-09-20T20:13:44.911 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:44.912 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2022-09-20T20:13:44.983 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:44.984 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2022-09-20T20:13:45.053 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:45.054 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2022-09-20T20:13:45.123 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:45.124 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2022-09-20T20:13:45.193 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:45.193 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2022-09-20T20:13:45.263 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:45.263 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2022-09-20T20:13:45.297 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:45.297 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2022-09-20T20:13:45.369 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:45.370 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2022-09-20T20:13:45.441 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:45.441 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2022-09-20T20:13:45.513 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:45.513 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2022-09-20T20:13:45.584 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:45.585 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2022-09-20T20:13:45.654 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:45.655 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2022-09-20T20:13:45.723 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:45.724 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2022-09-20T20:13:45.745 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:45.745 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2022-09-20T20:13:45.805 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:45.806 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2022-09-20T20:13:45.825 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:45.826 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2022-09-20T20:13:45.884 INFO:tasks.ceph:Adding keys to all mons... 2022-09-20T20:13:45.884 DEBUG:teuthology.orchestra.run.smithi008:> sudo tee -a /etc/ceph/ceph.keyring 2022-09-20T20:13:45.887 DEBUG:teuthology.orchestra.run.smithi055:> sudo tee -a /etc/ceph/ceph.keyring 2022-09-20T20:13:45.927 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr.y] 2022-09-20T20:13:45.928 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDYHipjJ8M4JhAARHv1VW9nsUFP40miBz+uUw== 2022-09-20T20:13:45.928 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a] 2022-09-20T20:13:45.928 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDYHipjdVWGLRAA6OjZalkZdt2+2iIobZuCtg== 2022-09-20T20:13:45.929 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c] 2022-09-20T20:13:45.929 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDYHipj+0j7NBAA0lhRvaO3oopj4ceYHv39xw== 2022-09-20T20:13:45.929 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.0] 2022-09-20T20:13:45.929 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDaHipjlO4hKhAApbWupzu/ujY0BkoXnyUsog== 2022-09-20T20:13:45.930 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.1] 2022-09-20T20:13:45.930 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDdHipj6bzlKRAAJOilIiZxcMrhvd4WLPgb5A== 2022-09-20T20:13:45.930 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.2] 2022-09-20T20:13:45.930 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDgHipj/3TRKRAAP6IEgWGCYmQMqJpKv5reBA== 2022-09-20T20:13:45.931 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.3] 2022-09-20T20:13:45.931 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDjHipjxeuNKRAAdwv8YgxvqxpO1si06JFbXA== 2022-09-20T20:13:45.931 INFO:teuthology.orchestra.run.smithi008.stdout:[mgr.x] 2022-09-20T20:13:45.931 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDYHipjOIMOKhAAjAvgrf1bhF15My1o/mn93g== 2022-09-20T20:13:45.931 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b] 2022-09-20T20:13:45.932 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDYHipjMEJXOhAAFJSlZNH6JvnqUqmt4pchMQ== 2022-09-20T20:13:45.932 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d] 2022-09-20T20:13:45.932 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDZHipjVqtIBhAAvf5iUYeokkl35l4iil3lpg== 2022-09-20T20:13:45.932 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.4] 2022-09-20T20:13:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDsHipjgjjrMxAA24vkVUAM1g9udhWfTulDXw== 2022-09-20T20:13:45.933 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.5] 2022-09-20T20:13:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDvHipjeWfcMxAAm1JCjBfp73NxUacMJKPX7Q== 2022-09-20T20:13:45.933 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.6] 2022-09-20T20:13:45.933 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDyHipjD5YHNBAAVqt7iT6TJco5216gL0Cy6w== 2022-09-20T20:13:45.934 INFO:teuthology.orchestra.run.smithi008.stdout:[osd.7] 2022-09-20T20:13:45.934 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQD1Hipj85LdMxAAji4MSOm4Gx+nwMq1en135w== 2022-09-20T20:13:45.934 INFO:teuthology.orchestra.run.smithi008.stdout:[client.0] 2022-09-20T20:13:45.934 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDZHipjZ/DXChAA08Srj2R8agwsy0txvtl4yg== 2022-09-20T20:13:45.934 INFO:teuthology.orchestra.run.smithi008.stdout:[client.2] 2022-09-20T20:13:45.935 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDZHipjK/SwEBAAWW/WosxHnoQIQOZz8bvFoQ== 2022-09-20T20:13:45.935 INFO:teuthology.orchestra.run.smithi008.stdout:[client.1] 2022-09-20T20:13:45.935 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDZHipjxtsxFBAAPtbqqPJOKPcSzSrrKK7S5w== 2022-09-20T20:13:45.935 INFO:teuthology.orchestra.run.smithi008.stdout:[client.3] 2022-09-20T20:13:45.936 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQDZHipjsfycFxAAMkLew6HSKmxMwEyjZEc2dw== 2022-09-20T20:13:45.953 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.y] 2022-09-20T20:13:45.953 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDYHipjJ8M4JhAARHv1VW9nsUFP40miBz+uUw== 2022-09-20T20:13:45.953 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2022-09-20T20:13:45.954 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDYHipjdVWGLRAA6OjZalkZdt2+2iIobZuCtg== 2022-09-20T20:13:45.954 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2022-09-20T20:13:45.954 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDYHipj+0j7NBAA0lhRvaO3oopj4ceYHv39xw== 2022-09-20T20:13:45.954 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.0] 2022-09-20T20:13:45.955 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDaHipjlO4hKhAApbWupzu/ujY0BkoXnyUsog== 2022-09-20T20:13:45.955 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.1] 2022-09-20T20:13:45.955 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDdHipj6bzlKRAAJOilIiZxcMrhvd4WLPgb5A== 2022-09-20T20:13:45.955 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.2] 2022-09-20T20:13:45.955 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDgHipj/3TRKRAAP6IEgWGCYmQMqJpKv5reBA== 2022-09-20T20:13:45.956 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.3] 2022-09-20T20:13:45.956 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDjHipjxeuNKRAAdwv8YgxvqxpO1si06JFbXA== 2022-09-20T20:13:45.956 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.x] 2022-09-20T20:13:45.956 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDYHipjOIMOKhAAjAvgrf1bhF15My1o/mn93g== 2022-09-20T20:13:45.957 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2022-09-20T20:13:45.957 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDYHipjMEJXOhAAFJSlZNH6JvnqUqmt4pchMQ== 2022-09-20T20:13:45.957 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2022-09-20T20:13:45.957 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZHipjVqtIBhAAvf5iUYeokkl35l4iil3lpg== 2022-09-20T20:13:45.957 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.4] 2022-09-20T20:13:45.958 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDsHipjgjjrMxAA24vkVUAM1g9udhWfTulDXw== 2022-09-20T20:13:45.958 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.5] 2022-09-20T20:13:45.958 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDvHipjeWfcMxAAm1JCjBfp73NxUacMJKPX7Q== 2022-09-20T20:13:45.958 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.6] 2022-09-20T20:13:45.959 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDyHipjD5YHNBAAVqt7iT6TJco5216gL0Cy6w== 2022-09-20T20:13:45.959 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.7] 2022-09-20T20:13:45.959 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQD1Hipj85LdMxAAji4MSOm4Gx+nwMq1en135w== 2022-09-20T20:13:45.959 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2022-09-20T20:13:45.959 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZHipjZ/DXChAA08Srj2R8agwsy0txvtl4yg== 2022-09-20T20:13:45.960 INFO:teuthology.orchestra.run.smithi055.stdout:[client.2] 2022-09-20T20:13:45.960 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZHipjK/SwEBAAWW/WosxHnoQIQOZz8bvFoQ== 2022-09-20T20:13:45.960 INFO:teuthology.orchestra.run.smithi055.stdout:[client.1] 2022-09-20T20:13:45.960 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZHipjxtsxFBAAPtbqqPJOKPcSzSrrKK7S5w== 2022-09-20T20:13:45.961 INFO:teuthology.orchestra.run.smithi055.stdout:[client.3] 2022-09-20T20:13:45.961 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDZHipjsfycFxAAMkLew6HSKmxMwEyjZEc2dw== 2022-09-20T20:13:45.962 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-09-20T20:13:45.980 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-09-20T20:13:46.060 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-20T20:13:46.062 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-20T20:13:46.122 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-20T20:13:46.124 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-20T20:13:46.181 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:13:46.184 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:13:46.238 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:13:46.240 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:13:46.294 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:13:46.296 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:13:46.350 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:13:46.353 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:13:46.407 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-09-20T20:13:46.410 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-09-20T20:13:46.464 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-20T20:13:46.467 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-20T20:13:46.524 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-20T20:13:46.526 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-20T20:13:46.583 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:13:46.585 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:13:46.640 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:13:46.643 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:13:46.697 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:13:46.699 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:13:46.753 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:13:46.756 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:13:46.810 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-20T20:13:46.813 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-20T20:13:46.869 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-20T20:13:46.872 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-20T20:13:46.929 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-20T20:13:46.931 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-20T20:13:46.988 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-20T20:13:46.991 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-20T20:13:47.048 INFO:tasks.ceph:Running mkfs on mon nodes... 2022-09-20T20:13:47.048 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2022-09-20T20:13:47.076 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-09-20T20:13:47.175 DEBUG:teuthology.orchestra.run.smithi008:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2022-09-20T20:13:47.203 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2022-09-20T20:13:47.232 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-09-20T20:13:47.330 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2022-09-20T20:13:47.358 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2022-09-20T20:13:47.425 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-09-20T20:13:47.533 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2022-09-20T20:13:47.561 DEBUG:teuthology.orchestra.run.smithi008:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:13:47.564 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:13:47.618 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2022-09-20T20:13:47.619 INFO:tasks.ceph.mon.a:Restarting daemon 2022-09-20T20:13:47.620 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-09-20T20:13:47.622 INFO:tasks.ceph.mon.a:Started 2022-09-20T20:13:47.623 INFO:tasks.ceph.mon.b:Restarting daemon 2022-09-20T20:13:47.623 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-09-20T20:13:47.660 INFO:tasks.ceph.mon.b:Started 2022-09-20T20:13:47.661 INFO:tasks.ceph.mon.c:Restarting daemon 2022-09-20T20:13:47.661 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-09-20T20:13:47.663 INFO:tasks.ceph.mon.c:Started 2022-09-20T20:13:47.664 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2022-09-20T20:13:47.664 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-09-20T20:13:47.665 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-09-20T20:13:47.667 INFO:tasks.ceph.mgr.y:Started 2022-09-20T20:13:47.667 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-09-20T20:13:47.668 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-09-20T20:13:47.670 INFO:tasks.ceph.mgr.x:Started 2022-09-20T20:13:47.670 INFO:tasks.ceph:Setting crush tunables to default 2022-09-20T20:13:47.671 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph osd crush tunables default 2022-09-20T20:13:47.799 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.797+0000 7f18db286700 1 Processor -- start 2022-09-20T20:13:47.799 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.798+0000 7f18db286700 1 -- start start 2022-09-20T20:13:47.801 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.798+0000 7f18db286700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f18d4153a40 0x7f18d415daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:47.802 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.798+0000 7f18db286700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f18d40c9ee0 0x7f18d40b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:47.802 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.798+0000 7f18db286700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d415a410 con 0x7f18d40b18e0 2022-09-20T20:13:47.802 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.798+0000 7f18db286700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d40b1d60 con 0x7f18d40c9ee0 2022-09-20T20:13:47.802 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.798+0000 7f18db286700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d4159ae0 con 0x7f18d4153a40 2022-09-20T20:13:47.802 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.799+0000 7f18d8821700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f18d40c9ee0 0x7f18d40b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:47.803 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.799+0000 7f18d9022700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f18d4153a40 0x7f18d415daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:47.803 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.799+0000 7f18d8821700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f18d40c9ee0 0x7f18d40b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57944/0 (socket says 172.21.15.8:57944) 2022-09-20T20:13:47.803 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.799+0000 7f18d8821700 1 -- 172.21.15.8:0/2687349561 learned_addr learned my addr 172.21.15.8:0/2687349561 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:13:47.803 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.799+0000 7f18d9022700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f18d4153a40 0x7f18d415daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.8:53332/0 (socket says 172.21.15.8:53332) 2022-09-20T20:13:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.799+0000 7f18d9022700 1 -- 172.21.15.8:0/2687349561 >> v2:172.21.15.55:3300/0 conn(0x7f18d4153a40 msgr2=0x7f18d415daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-09-20T20:13:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.799+0000 7f18d9022700 1 -- 172.21.15.8:0/2687349561 >> v2:172.21.15.55:3300/0 conn(0x7f18d4153a40 msgr2=0x7f18d415daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:13:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.799+0000 7f18d9022700 1 --2- 172.21.15.8:0/2687349561 >> v2:172.21.15.55:3300/0 conn(0x7f18d4153a40 0x7f18d415daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:13:47.804 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.799+0000 7f18d8821700 1 -- 172.21.15.8:0/2687349561 >> v2:172.21.15.8:3300/0 conn(0x7f18d40c9ee0 msgr2=0x7f18d40b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-20T20:13:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.799+0000 7f18d8821700 1 -- 172.21.15.8:0/2687349561 >> v2:172.21.15.8:3300/0 conn(0x7f18d40c9ee0 msgr2=0x7f18d40b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:13:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.799+0000 7f18d8821700 1 --2- 172.21.15.8:0/2687349561 >> v2:172.21.15.8:3300/0 conn(0x7f18d40c9ee0 0x7f18d40b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:13:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.799+0000 7f18d9022700 1 --2- 172.21.15.8:0/2687349561 >> v2:172.21.15.55:3300/0 conn(0x7f18d4153a40 0x7f18d415daf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:13:47.805 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.799+0000 7f18d8821700 1 --2- 172.21.15.8:0/2687349561 >> v2:172.21.15.8:3300/0 conn(0x7f18d40c9ee0 0x7f18d40b13a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:13:47.977 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.976+0000 7f18c3fff700 1 -- 172.21.15.8:0/2687349561 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730220748 0 0) 0x7f18d415a410 con 0x7f18d40b18e0 2022-09-20T20:13:47.978 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.976+0000 7f18c3fff700 1 -- 172.21.15.8:0/2687349561 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18bc0035b0 con 0x7f18d40b18e0 2022-09-20T20:13:47.980 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18c3fff700 1 -- 172.21.15.8:0/2687349561 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4068502734 0 0) 0x7f18bc0035b0 con 0x7f18d40b18e0 2022-09-20T20:13:47.980 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18c3fff700 1 -- 172.21.15.8:0/2687349561 >> v2:172.21.15.55:3300/0 conn(0x7f18d4153a40 msgr2=0x7f18d415daf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-09-20T20:13:47.980 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18c3fff700 1 --2- 172.21.15.8:0/2687349561 >> v2:172.21.15.55:3300/0 conn(0x7f18d4153a40 0x7f18d415daf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:47.981 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18c3fff700 1 -- 172.21.15.8:0/2687349561 >> v2:172.21.15.8:3300/0 conn(0x7f18d40c9ee0 msgr2=0x7f18d40b13a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-09-20T20:13:47.981 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18c3fff700 1 --2- 172.21.15.8:0/2687349561 >> v2:172.21.15.8:3300/0 conn(0x7f18d40c9ee0 0x7f18d40b13a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:47.981 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18c3fff700 1 -- 172.21.15.8:0/2687349561 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d4159dc0 con 0x7f18d40b18e0 2022-09-20T20:13:47.981 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18c3fff700 1 -- 172.21.15.8:0/2687349561 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2564336580 0 0) 0x7f18cc0019f0 con 0x7f18d40b18e0 2022-09-20T20:13:47.981 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18c3fff700 1 -- 172.21.15.8:0/2687349561 >> v1:172.21.15.8:6789/0 conn(0x7f18d40b18e0 legacy=0x7f18d406ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:47.982 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18c3fff700 1 --2- 172.21.15.8:0/2687349561 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18bc003a00 0x7f18bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:47.982 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18c3fff700 1 --2- 172.21.15.8:0/2687349561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18bc004850 0x7f18bc004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:47.982 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18c3fff700 1 --2- 172.21.15.8:0/2687349561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18bc005200 0x7f18bc00fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:47.982 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18c3fff700 1 -- 172.21.15.8:0/2687349561 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40b1d60 con 0x7f18bc004850 2022-09-20T20:13:47.983 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18c3fff700 1 -- 172.21.15.8:0/2687349561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d4159ae0 con 0x7f18bc005200 2022-09-20T20:13:47.983 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18c3fff700 1 -- 172.21.15.8:0/2687349561 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc009a00 con 0x7f18bc003a00 2022-09-20T20:13:47.983 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18d9022700 1 --2- 172.21.15.8:0/2687349561 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18bc003a00 0x7f18bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:47.983 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18d9823700 1 --2- 172.21.15.8:0/2687349561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18bc005200 0x7f18bc00fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:47.984 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18d8821700 1 --2- 172.21.15.8:0/2687349561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18bc004850 0x7f18bc004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:47.984 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18d9022700 1 -- 172.21.15.8:0/2687349561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18bc005200 msgr2=0x7f18bc00fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:13:47.984 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18d9022700 1 --2- 172.21.15.8:0/2687349561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18bc005200 0x7f18bc00fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:47.984 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18d9022700 1 -- 172.21.15.8:0/2687349561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18bc004850 msgr2=0x7f18bc004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:13:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18d9022700 1 --2- 172.21.15.8:0/2687349561 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18bc004850 0x7f18bc004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18d9022700 1 -- 172.21.15.8:0/2687349561 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18bc0035b0 con 0x7f18bc003a00 2022-09-20T20:13:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.977+0000 7f18d9823700 1 -- 172.21.15.8:0/2687349561 reap_dead start 2022-09-20T20:13:47.985 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.978+0000 7f18d9022700 1 --2- 172.21.15.8:0/2687349561 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18bc003a00 0x7f18bc003dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009890 tx=0x7f18bc005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fcec425002403f9 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:47.986 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.978+0000 7f18c3fff700 1 -- 172.21.15.8:0/2687349561 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d000c070 con 0x7f18bc003a00 2022-09-20T20:13:47.986 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.978+0000 7f18c3fff700 1 -- 172.21.15.8:0/2687349561 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d0004020 con 0x7f18bc003a00 2022-09-20T20:13:47.986 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.978+0000 7f18c3fff700 1 -- 172.21.15.8:0/2687349561 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d00043b0 con 0x7f18bc003a00 2022-09-20T20:13:47.990 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.979+0000 7f18db286700 1 -- 172.21.15.8:0/2687349561 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18bc003a00 msgr2=0x7f18bc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:47.990 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.979+0000 7f18db286700 1 --2- 172.21.15.8:0/2687349561 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18bc003a00 0x7f18bc003dd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f18d0009890 tx=0x7f18bc005880 comp rx=0 tx=0).stop 2022-09-20T20:13:47.991 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.979+0000 7f18db286700 1 -- 172.21.15.8:0/2687349561 shutdown_connections 2022-09-20T20:13:47.991 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.979+0000 7f18db286700 1 --2- 172.21.15.8:0/2687349561 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18bc003a00 0x7f18bc003dd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:47.991 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.979+0000 7f18db286700 1 -- 172.21.15.8:0/2687349561 >> 172.21.15.8:0/2687349561 conn(0x7f18d40d05b0 msgr2=0x7f18d40cc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:47.991 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.979+0000 7f18db286700 1 -- 172.21.15.8:0/2687349561 shutdown_connections 2022-09-20T20:13:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.979+0000 7f18db286700 1 -- 172.21.15.8:0/2687349561 wait complete. 2022-09-20T20:13:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.981+0000 7f18db286700 1 Processor -- start 2022-09-20T20:13:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.981+0000 7f18db286700 1 -- start start 2022-09-20T20:13:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.982+0000 7f18db286700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18bc003a00 0x7f18d4151990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.982+0000 7f18db286700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18d4151f20 0x7f18d40b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.982+0000 7f18db286700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18d41ed0b0 0x7f18d40b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.982+0000 7f18db286700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40b4710 con 0x7f18bc003a00 2022-09-20T20:13:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.982+0000 7f18db286700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40aefd0 con 0x7f18d4151f20 2022-09-20T20:13:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.982+0000 7f18db286700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40b3a90 con 0x7f18d41ed0b0 2022-09-20T20:13:47.994 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.982+0000 7f18d9022700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18bc003a00 0x7f18d4151990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:47.994 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.982+0000 7f18d9022700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18bc003a00 0x7f18d4151990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57974/0 (socket says 172.21.15.8:57974) 2022-09-20T20:13:47.994 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.982+0000 7f18d9022700 1 -- 172.21.15.8:0/3341498028 learned_addr learned my addr 172.21.15.8:0/3341498028 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:13:47.994 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.982+0000 7f18d8821700 1 --2- 172.21.15.8:0/3341498028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18d4151f20 0x7f18d40b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.982+0000 7f18d9823700 1 --2- 172.21.15.8:0/3341498028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18d41ed0b0 0x7f18d40b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.982+0000 7f18d9022700 1 -- 172.21.15.8:0/3341498028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18d41ed0b0 msgr2=0x7f18d40b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.982+0000 7f18d9022700 1 --2- 172.21.15.8:0/3341498028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18d41ed0b0 0x7f18d40b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:47.995 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.982+0000 7f18d9022700 1 -- 172.21.15.8:0/3341498028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18d4151f20 msgr2=0x7f18d40b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.982+0000 7f18d9022700 1 --2- 172.21.15.8:0/3341498028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18d4151f20 0x7f18d40b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.982+0000 7f18d9022700 1 -- 172.21.15.8:0/3341498028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d40b3d70 con 0x7f18bc003a00 2022-09-20T20:13:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.983+0000 7f18d9022700 1 --2- 172.21.15.8:0/3341498028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18bc003a00 0x7f18d4151990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009b90 tx=0x7f18d00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.983+0000 7f18c1ffb700 1 -- 172.21.15.8:0/3341498028 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d00045c0 con 0x7f18bc003a00 2022-09-20T20:13:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.983+0000 7f18c1ffb700 1 -- 172.21.15.8:0/3341498028 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d0003d90 con 0x7f18bc003a00 2022-09-20T20:13:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.983+0000 7f18c1ffb700 1 -- 172.21.15.8:0/3341498028 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d00266a0 con 0x7f18bc003a00 2022-09-20T20:13:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.983+0000 7f18db286700 1 -- 172.21.15.8:0/3341498028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d40b4050 con 0x7f18bc003a00 2022-09-20T20:13:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.983+0000 7f18db286700 1 -- 172.21.15.8:0/3341498028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d40b3770 con 0x7f18bc003a00 2022-09-20T20:13:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.983+0000 7f18c1ffb700 1 -- 172.21.15.8:0/3341498028 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f18d002c020 con 0x7f18bc003a00 2022-09-20T20:13:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.983+0000 7f18c1ffb700 1 -- 172.21.15.8:0/3341498028 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f18d002f780 con 0x7f18bc003a00 2022-09-20T20:13:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.984+0000 7f18db286700 1 -- 172.21.15.8:0/3341498028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d40b4980 con 0x7f18bc003a00 2022-09-20T20:13:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:47.987+0000 7f18c1ffb700 1 -- 172.21.15.8:0/3341498028 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7f18d0017030 con 0x7f18bc003a00 2022-09-20T20:13:48.065 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:48.064+0000 7f18db286700 1 -- 172.21.15.8:0/3341498028 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f18d40656c0 con 0x7f18bc003a00 2022-09-20T20:13:48.068 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:48.067+0000 7f18c1ffb700 1 -- 172.21.15.8:0/3341498028 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f18d000f040 con 0x7f18bc003a00 2022-09-20T20:13:48.070 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:48.068+0000 7f18db286700 1 -- 172.21.15.8:0/3341498028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18bc003a00 msgr2=0x7f18d4151990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:48.070 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:48.068+0000 7f18db286700 1 --2- 172.21.15.8:0/3341498028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18bc003a00 0x7f18d4151990 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f18bc009b90 tx=0x7f18d00047c0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.070 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:48.068+0000 7f18db286700 1 -- 172.21.15.8:0/3341498028 shutdown_connections 2022-09-20T20:13:48.070 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:48.068+0000 7f18db286700 1 --2- 172.21.15.8:0/3341498028 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f18bc003a00 0x7f18d4151990 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.071 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:48.068+0000 7f18db286700 1 --2- 172.21.15.8:0/3341498028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f18d41ed0b0 0x7f18d40b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.071 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:48.068+0000 7f18db286700 1 --2- 172.21.15.8:0/3341498028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18d4151f20 0x7f18d40b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.071 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:48.068+0000 7f18db286700 1 -- 172.21.15.8:0/3341498028 >> 172.21.15.8:0/3341498028 conn(0x7f18d40d05b0 msgr2=0x7f18d4152a50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:48.071 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:48.068+0000 7f18db286700 1 -- 172.21.15.8:0/3341498028 shutdown_connections 2022-09-20T20:13:48.071 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:48.068+0000 7f18db286700 1 -- 172.21.15.8:0/3341498028 wait complete. 2022-09-20T20:13:48.072 INFO:teuthology.orchestra.run.smithi008.stderr:adjusted tunables profile to default 2022-09-20T20:13:48.085 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2022-09-20T20:13:48.086 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:48.086 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2022-09-20T20:13:48.095 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:48.094+0000 7fd6420df200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-09-20T20:13:48.101 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:48.100+0000 7f393c7f0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-09-20T20:13:48.113 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:48.114 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2022-09-20T20:13:48.162 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:48.161+0000 7fd6420df200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-09-20T20:13:48.169 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:48.168+0000 7f393c7f0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-09-20T20:13:48.181 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:48.181 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2022-09-20T20:13:48.239 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:48.238+0000 7fd6420df200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-09-20T20:13:48.248 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2022-09-20T20:13:48.248 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2022-09-20T20:13:48.249 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:48.247+0000 7f393c7f0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-09-20T20:13:48.280 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:48.281 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2022-09-20T20:13:48.308 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:48.309 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2022-09-20T20:13:48.322 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:48.320+0000 7fd6420df200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-09-20T20:13:48.336 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:48.335+0000 7f393c7f0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-09-20T20:13:48.348 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:48.349 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2022-09-20T20:13:48.415 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-09-20T20:13:48.416 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2022-09-20T20:13:48.470 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:48.469+0000 7fd6420df200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-09-20T20:13:48.481 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:48.480+0000 7f393c7f0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-09-20T20:13:48.482 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new bd449a06-0637-42f4-9257-e0de045c499e 0 2022-09-20T20:13:48.647 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.646+0000 7fbd2c591700 1 Processor -- start 2022-09-20T20:13:48.648 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.646+0000 7fbd2c591700 1 -- start start 2022-09-20T20:13:48.651 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.647+0000 7fbd2c591700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd240b4f00 0x7fbd2415dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:48.651 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.647+0000 7fbd2c591700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbd240b1a80 0x7fbd240cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:48.651 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.647+0000 7fbd2c591700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd240c9f40 con 0x7fbd240b52d0 2022-09-20T20:13:48.652 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.647+0000 7fbd2c591700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2415e000 con 0x7fbd240b1a80 2022-09-20T20:13:48.652 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.647+0000 7fbd2c591700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd240ca750 con 0x7fbd240b4f00 2022-09-20T20:13:48.652 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.647+0000 7fbd2a32d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd240b4f00 0x7fbd2415dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.647+0000 7fbd2ab2e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbd240b1a80 0x7fbd240cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.647+0000 7fbd2a32d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd240b4f00 0x7fbd2415dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:54982/0 (socket says 172.21.15.55:54982) 2022-09-20T20:13:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.647+0000 7fbd2ab2e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbd240b1a80 0x7fbd240cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36510/0 (socket says 172.21.15.55:36510) 2022-09-20T20:13:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.647+0000 7fbd2a32d700 1 -- 172.21.15.55:0/572139968 learned_addr learned my addr 172.21.15.55:0/572139968 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-09-20T20:13:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.648+0000 7fbd2ab2e700 1 -- 172.21.15.55:0/572139968 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd240b4f00 msgr2=0x7fbd2415dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:13:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.648+0000 7fbd2ab2e700 1 --2- 172.21.15.55:0/572139968 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd240b4f00 0x7fbd2415dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.648+0000 7fbd2ab2e700 1 -- 172.21.15.55:0/572139968 >> v1:172.21.15.8:6789/0 conn(0x7fbd240b52d0 legacy=0x7fbd240b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.648+0000 7fbd2ab2e700 1 -- 172.21.15.55:0/572139968 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd240ca190 con 0x7fbd240b1a80 2022-09-20T20:13:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.648+0000 7fbd2932b700 1 -- 172.21.15.55:0/572139968 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198939834 0 0) 0x7fbd240c9f40 con 0x7fbd240b52d0 2022-09-20T20:13:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.648+0000 7fbd2a32d700 1 --2- 172.21.15.55:0/572139968 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd240b4f00 0x7fbd2415dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:13:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.648+0000 7fbd2ab2e700 1 --2- 172.21.15.55:0/572139968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd240b1a80 0x7fbd240cde60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c009d90 tx=0x7fbd1c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb5867c2c4aa4943 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.648+0000 7fbd2932b700 1 -- 172.21.15.55:0/572139968 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c00e070 con 0x7fbd240b1a80 2022-09-20T20:13:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.648+0000 7fbd2932b700 1 -- 172.21.15.55:0/572139968 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c00bb20 con 0x7fbd240b1a80 2022-09-20T20:13:48.656 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.648+0000 7fbd2932b700 1 -- 172.21.15.55:0/572139968 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c012430 con 0x7fbd240b1a80 2022-09-20T20:13:48.656 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.648+0000 7fbd2c591700 1 -- 172.21.15.55:0/572139968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd240b1a80 msgr2=0x7fbd240cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:48.656 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.648+0000 7fbd2c591700 1 --2- 172.21.15.55:0/572139968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd240b1a80 0x7fbd240cde60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c009d90 tx=0x7fbd1c00b330 comp rx=0 tx=0).stop 2022-09-20T20:13:48.656 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.649+0000 7fbd2c591700 1 -- 172.21.15.55:0/572139968 shutdown_connections 2022-09-20T20:13:48.656 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.649+0000 7fbd2c591700 1 --2- 172.21.15.55:0/572139968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd240b1a80 0x7fbd240cde60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.657 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.649+0000 7fbd2c591700 1 --2- 172.21.15.55:0/572139968 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd240b4f00 0x7fbd2415dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.657 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.649+0000 7fbd2c591700 1 -- 172.21.15.55:0/572139968 >> 172.21.15.55:0/572139968 conn(0x7fbd2406df80 msgr2=0x7fbd240cc370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:48.657 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.649+0000 7fbd2c591700 1 -- 172.21.15.55:0/572139968 shutdown_connections 2022-09-20T20:13:48.657 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.649+0000 7fbd2c591700 1 -- 172.21.15.55:0/572139968 wait complete. 2022-09-20T20:13:48.660 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.650+0000 7fbd2c591700 1 Processor -- start 2022-09-20T20:13:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.650+0000 7fbd2c591700 1 -- start start 2022-09-20T20:13:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.651+0000 7fbd2c591700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd240b1a80 0x7fbd240c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.651+0000 7fbd2c591700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd240b4f00 0x7fbd2415c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.651+0000 7fbd2c591700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd240b52d0 0x7fbd241573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.651+0000 7fbd2c591700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd241eeda0 con 0x7fbd240b52d0 2022-09-20T20:13:48.662 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.651+0000 7fbd2c591700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd241ef040 con 0x7fbd240b1a80 2022-09-20T20:13:48.662 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.651+0000 7fbd2c591700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd241ef320 con 0x7fbd240b4f00 2022-09-20T20:13:48.662 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.651+0000 7fbd2a32d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd240b1a80 0x7fbd240c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:48.662 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.651+0000 7fbd29b2c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd240b4f00 0x7fbd2415c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:48.663 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.651+0000 7fbd2a32d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd240b1a80 0x7fbd240c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36512/0 (socket says 172.21.15.55:36512) 2022-09-20T20:13:48.663 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.651+0000 7fbd2a32d700 1 -- 172.21.15.55:0/371382261 learned_addr learned my addr 172.21.15.55:0/371382261 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-09-20T20:13:48.663 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.652+0000 7fbd2ab2e700 1 --2- 172.21.15.55:0/371382261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd240b52d0 0x7fbd241573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:48.663 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.652+0000 7fbd2a32d700 1 -- 172.21.15.55:0/371382261 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd240b4f00 msgr2=0x7fbd2415c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:48.664 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.652+0000 7fbd2a32d700 1 --2- 172.21.15.55:0/371382261 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd240b4f00 0x7fbd2415c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.664 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.652+0000 7fbd2a32d700 1 -- 172.21.15.55:0/371382261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd240b52d0 msgr2=0x7fbd241573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:48.664 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.652+0000 7fbd2a32d700 1 --2- 172.21.15.55:0/371382261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd240b52d0 0x7fbd241573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.664 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.652+0000 7fbd2a32d700 1 -- 172.21.15.55:0/371382261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd20009550 con 0x7fbd240b1a80 2022-09-20T20:13:48.664 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.652+0000 7fbd2ab2e700 1 --2- 172.21.15.55:0/371382261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd240b52d0 0x7fbd241573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-20T20:13:48.665 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.652+0000 7fbd29b2c700 1 --2- 172.21.15.55:0/371382261 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd240b4f00 0x7fbd2415c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:13:48.665 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.652+0000 7fbd2a32d700 1 --2- 172.21.15.55:0/371382261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd240b1a80 0x7fbd240c92d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000e9b0 tx=0x7fbd2000ecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:48.665 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.652+0000 7fbd12ffd700 1 -- 172.21.15.55:0/371382261 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2000c850 con 0x7fbd240b1a80 2022-09-20T20:13:48.665 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.652+0000 7fbd12ffd700 1 -- 172.21.15.55:0/371382261 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2000c9b0 con 0x7fbd240b1a80 2022-09-20T20:13:48.665 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.652+0000 7fbd2c591700 1 -- 172.21.15.55:0/371382261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd1c009a70 con 0x7fbd240b1a80 2022-09-20T20:13:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.652+0000 7fbd12ffd700 1 -- 172.21.15.55:0/371382261 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2000cd20 con 0x7fbd240b1a80 2022-09-20T20:13:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.652+0000 7fbd2c591700 1 -- 172.21.15.55:0/371382261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd241ef8e0 con 0x7fbd240b1a80 2022-09-20T20:13:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.652+0000 7fbd12ffd700 1 -- 172.21.15.55:0/371382261 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fbd20019030 con 0x7fbd240b1a80 2022-09-20T20:13:48.667 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.652+0000 7fbd12ffd700 1 -- 172.21.15.55:0/371382261 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fbd20006360 con 0x7fbd240b1a80 2022-09-20T20:13:48.667 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.653+0000 7fbd2c591700 1 -- 172.21.15.55:0/371382261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd241efc50 con 0x7fbd240b1a80 2022-09-20T20:13:48.667 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.655+0000 7fbd12ffd700 1 -- 172.21.15.55:0/371382261 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7fbd20021060 con 0x7fbd240b1a80 2022-09-20T20:13:48.741 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.740+0000 7fbd2c591700 1 -- 172.21.15.55:0/371382261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bd449a06-0637-42f4-9257-e0de045c499e", "id": 0} v 0) v1 -- 0x7fbd24071360 con 0x7fbd240b1a80 2022-09-20T20:13:48.747 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.745+0000 7fbd12ffd700 1 -- 172.21.15.55:0/371382261 <== mon.1 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bd449a06-0637-42f4-9257-e0de045c499e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbd20017070 con 0x7fbd240b1a80 2022-09-20T20:13:48.747 INFO:teuthology.orchestra.run.smithi055.stdout:0 2022-09-20T20:13:48.748 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.746+0000 7fbd2c591700 1 -- 172.21.15.55:0/371382261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd240b1a80 msgr2=0x7fbd240c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:48.749 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.746+0000 7fbd2c591700 1 --2- 172.21.15.55:0/371382261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd240b1a80 0x7fbd240c92d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000e9b0 tx=0x7fbd2000ecc0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.749 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.746+0000 7fbd2c591700 1 -- 172.21.15.55:0/371382261 shutdown_connections 2022-09-20T20:13:48.749 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.746+0000 7fbd2c591700 1 --2- 172.21.15.55:0/371382261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd240b52d0 0x7fbd241573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.749 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.746+0000 7fbd2c591700 1 --2- 172.21.15.55:0/371382261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd240b1a80 0x7fbd240c92d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.750 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.746+0000 7fbd2c591700 1 --2- 172.21.15.55:0/371382261 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd240b4f00 0x7fbd2415c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.750 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.746+0000 7fbd2c591700 1 -- 172.21.15.55:0/371382261 >> 172.21.15.55:0/371382261 conn(0x7fbd2406df80 msgr2=0x7fbd240b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:48.750 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.746+0000 7fbd2c591700 1 -- 172.21.15.55:0/371382261 shutdown_connections 2022-09-20T20:13:48.750 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.747+0000 7fbd2c591700 1 -- 172.21.15.55:0/371382261 wait complete. 2022-09-20T20:13:48.760 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new db347f63-385a-4b18-85be-65594acb61a9 1 2022-09-20T20:13:48.819 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:48.817+0000 7f393c7f0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-09-20T20:13:48.826 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:48.824+0000 7fd6420df200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-09-20T20:13:48.883 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.882+0000 7f508add9700 1 Processor -- start 2022-09-20T20:13:48.884 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.882+0000 7f508add9700 1 -- start start 2022-09-20T20:13:48.889 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.882+0000 7f508add9700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f50840c8e10 0x7f5084070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:48.890 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.882+0000 7f508add9700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50840caf50 con 0x7f5084068b20 2022-09-20T20:13:48.890 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.882+0000 7f508add9700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50840c9280 con 0x7f5084159120 2022-09-20T20:13:48.890 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.882+0000 7f508add9700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50840cac70 con 0x7f50840c8e10 2022-09-20T20:13:48.890 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.883+0000 7f5088b75700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5084159120 0x7f508415cd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33582/0 (socket says 172.21.15.55:33582) 2022-09-20T20:13:48.890 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.883+0000 7f5088b75700 1 -- 172.21.15.55:0/1541620307 learned_addr learned my addr 172.21.15.55:0/1541620307 (peer_addr_for_me v1:172.21.15.55:0/0) 2022-09-20T20:13:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.883+0000 7f5083fff700 1 --2- 172.21.15.55:0/1541620307 >> v2:172.21.15.8:3300/0 conn(0x7f50840c8e10 0x7f5084070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.883+0000 7f50837fe700 1 -- 172.21.15.55:0/1541620307 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868886477 0 0) 0x7f50840c9280 con 0x7f5084159120 2022-09-20T20:13:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.883+0000 7f50837fe700 1 -- 172.21.15.55:0/1541620307 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50680035b0 con 0x7f5084159120 2022-09-20T20:13:48.891 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.883+0000 7f50837fe700 1 -- 172.21.15.55:0/1541620307 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2849017011 0 0) 0x7f50840caf50 con 0x7f5084068b20 2022-09-20T20:13:48.892 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.883+0000 7f50837fe700 1 -- 172.21.15.55:0/1541620307 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50840c9280 con 0x7f5084068b20 2022-09-20T20:13:48.892 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.883+0000 7f5083fff700 1 -- 172.21.15.55:0/1541620307 >> v1:172.21.15.55:6789/0 conn(0x7f5084159120 legacy=0x7f508415cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:48.892 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.883+0000 7f5083fff700 1 -- 172.21.15.55:0/1541620307 >> v1:172.21.15.8:6789/0 conn(0x7f5084068b20 legacy=0x7f5084159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:48.892 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.883+0000 7f5083fff700 1 -- 172.21.15.55:0/1541620307 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5084159880 con 0x7f50840c8e10 2022-09-20T20:13:48.892 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.883+0000 7f5083fff700 1 --2- 172.21.15.55:0/1541620307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50840c8e10 0x7f5084070f80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5070009840 tx=0x7f5070009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c48b6f1e2bdc21 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:48.893 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.883+0000 7f50837fe700 1 -- 172.21.15.55:0/1541620307 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070011830 con 0x7f50840c8e10 2022-09-20T20:13:48.893 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.883+0000 7f50837fe700 1 -- 172.21.15.55:0/1541620307 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5070011990 con 0x7f50840c8e10 2022-09-20T20:13:48.893 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.883+0000 7f50837fe700 1 -- 172.21.15.55:0/1541620307 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070011d20 con 0x7f50840c8e10 2022-09-20T20:13:48.893 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.884+0000 7f508add9700 1 -- 172.21.15.55:0/1541620307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50840c8e10 msgr2=0x7f5084070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:48.894 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.884+0000 7f508add9700 1 --2- 172.21.15.55:0/1541620307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50840c8e10 0x7f5084070f80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5070009840 tx=0x7f5070009b50 comp rx=0 tx=0).stop 2022-09-20T20:13:48.894 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.884+0000 7f508add9700 1 -- 172.21.15.55:0/1541620307 shutdown_connections 2022-09-20T20:13:48.894 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.884+0000 7f508add9700 1 --2- 172.21.15.55:0/1541620307 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50840c8e10 0x7f5084070f80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.894 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.884+0000 7f508add9700 1 -- 172.21.15.55:0/1541620307 >> 172.21.15.55:0/1541620307 conn(0x7f508406e8c0 msgr2=0x7f508406c220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:48.894 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.884+0000 7f508add9700 1 -- 172.21.15.55:0/1541620307 shutdown_connections 2022-09-20T20:13:48.895 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.884+0000 7f508add9700 1 -- 172.21.15.55:0/1541620307 wait complete. 2022-09-20T20:13:48.895 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.885+0000 7f508add9700 1 Processor -- start 2022-09-20T20:13:48.895 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.885+0000 7f508add9700 1 -- start start 2022-09-20T20:13:48.895 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.886+0000 7f508add9700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5084068b20 0x7f50840c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:48.896 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.886+0000 7f508add9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50840c8e10 0x7f50841eebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:48.896 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.886+0000 7f508add9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5084159120 0x7f5084154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:48.896 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.886+0000 7f508add9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50841efbd0 con 0x7f5084159120 2022-09-20T20:13:48.896 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.886+0000 7f508add9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50841ef120 con 0x7f50840c8e10 2022-09-20T20:13:48.896 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.886+0000 7f508add9700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50840acd90 con 0x7f5084068b20 2022-09-20T20:13:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.886+0000 7f5088b75700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5084068b20 0x7f50840c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.886+0000 7f5083fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50840c8e10 0x7f50841eebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.886+0000 7f5088b75700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5084068b20 0x7f50840c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:55000/0 (socket says 172.21.15.55:55000) 2022-09-20T20:13:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.886+0000 7f5089376700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5084159120 0x7f5084154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:48.897 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.886+0000 7f5083fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50840c8e10 0x7f50841eebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36526/0 (socket says 172.21.15.55:36526) 2022-09-20T20:13:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.886+0000 7f5088b75700 1 -- 172.21.15.55:0/2088842622 learned_addr learned my addr 172.21.15.55:0/2088842622 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-09-20T20:13:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.887+0000 7f5088b75700 1 -- 172.21.15.55:0/2088842622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50840c8e10 msgr2=0x7f50841eebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.887+0000 7f5088b75700 1 --2- 172.21.15.55:0/2088842622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50840c8e10 0x7f50841eebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.898 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.887+0000 7f5088b75700 1 -- 172.21.15.55:0/2088842622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5084159120 msgr2=0x7f5084154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.887+0000 7f5088b75700 1 --2- 172.21.15.55:0/2088842622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5084159120 0x7f5084154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.887+0000 7f5088b75700 1 -- 172.21.15.55:0/2088842622 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50700094a0 con 0x7f5084068b20 2022-09-20T20:13:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.887+0000 7f5089376700 1 --2- 172.21.15.55:0/2088842622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5084159120 0x7f5084154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:13:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.887+0000 7f5088b75700 1 --2- 172.21.15.55:0/2088842622 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5084068b20 0x7f50840c7d80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5078001eb0 tx=0x7f507800c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:48.899 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.887+0000 7f50817fa700 1 -- 172.21.15.55:0/2088842622 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5078005d70 con 0x7f5084068b20 2022-09-20T20:13:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.887+0000 7f50817fa700 1 -- 172.21.15.55:0/2088842622 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50780070d0 con 0x7f5084068b20 2022-09-20T20:13:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.887+0000 7f508add9700 1 -- 172.21.15.55:0/2088842622 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50840c5a10 con 0x7f5084068b20 2022-09-20T20:13:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.887+0000 7f50817fa700 1 -- 172.21.15.55:0/2088842622 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5078007440 con 0x7f5084068b20 2022-09-20T20:13:48.900 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.887+0000 7f508add9700 1 -- 172.21.15.55:0/2088842622 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50841ef610 con 0x7f5084068b20 2022-09-20T20:13:48.901 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.887+0000 7f50817fa700 1 -- 172.21.15.55:0/2088842622 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f5078019030 con 0x7f5084068b20 2022-09-20T20:13:48.901 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.887+0000 7f50817fa700 1 -- 172.21.15.55:0/2088842622 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f507801cc70 con 0x7f5084068b20 2022-09-20T20:13:48.901 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.888+0000 7f508add9700 1 -- 172.21.15.55:0/2088842622 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50840c5870 con 0x7f5084068b20 2022-09-20T20:13:48.902 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:48.894+0000 7f393c7f0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-09-20T20:13:48.902 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.890+0000 7f50817fa700 1 -- 172.21.15.55:0/2088842622 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7f50840c5870 con 0x7f5084068b20 2022-09-20T20:13:48.906 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:48.905+0000 7fd6420df200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-09-20T20:13:48.977 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.975+0000 7f508add9700 1 -- 172.21.15.55:0/2088842622 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd new", "uuid": "db347f63-385a-4b18-85be-65594acb61a9", "id": 1} v 0) v1 -- 0x7f508406abc0 con 0x7f5084068b20 2022-09-20T20:13:48.985 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.984+0000 7f50817fa700 1 -- 172.21.15.55:0/2088842622 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "db347f63-385a-4b18-85be-65594acb61a9", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5078021060 con 0x7f5084068b20 2022-09-20T20:13:48.986 INFO:teuthology.orchestra.run.smithi055.stdout:1 2022-09-20T20:13:48.987 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.984+0000 7f508add9700 1 -- 172.21.15.55:0/2088842622 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5084068b20 msgr2=0x7f50840c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:48.988 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.984+0000 7f508add9700 1 --2- 172.21.15.55:0/2088842622 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5084068b20 0x7f50840c7d80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5078001eb0 tx=0x7f507800c7b0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.988 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.985+0000 7f508add9700 1 -- 172.21.15.55:0/2088842622 shutdown_connections 2022-09-20T20:13:48.988 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.985+0000 7f508add9700 1 --2- 172.21.15.55:0/2088842622 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5084159120 0x7f5084154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.988 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.985+0000 7f508add9700 1 --2- 172.21.15.55:0/2088842622 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5084068b20 0x7f50840c7d80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.989 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.985+0000 7f508add9700 1 --2- 172.21.15.55:0/2088842622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50840c8e10 0x7f50841eebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:48.989 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.985+0000 7f508add9700 1 -- 172.21.15.55:0/2088842622 >> 172.21.15.55:0/2088842622 conn(0x7f508406e8c0 msgr2=0x7f5084157910 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:48.989 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.985+0000 7f508add9700 1 -- 172.21.15.55:0/2088842622 shutdown_connections 2022-09-20T20:13:48.989 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:48.985+0000 7f508add9700 1 -- 172.21.15.55:0/2088842622 wait complete. 2022-09-20T20:13:48.998 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new 296cfab0-d996-45d6-bef0-69c311817ffa 2 2022-09-20T20:13:49.028 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:49.027+0000 7f393c7f0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-09-20T20:13:49.042 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:49.041+0000 7fd6420df200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-09-20T20:13:49.111 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:49.109+0000 7f393c7f0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-09-20T20:13:49.123 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.121+0000 7f176f668700 1 Processor -- start 2022-09-20T20:13:49.123 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.122+0000 7f176f668700 1 -- start start 2022-09-20T20:13:49.126 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.123+0000 7f176f668700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f176815b3b0 0x7f17680cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.126 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.123+0000 7f176f668700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f176806feb0 0x7f17680c8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.127 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.123+0000 7f176f668700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1768069530 con 0x7f17680cba10 2022-09-20T20:13:49.127 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.123+0000 7f176f668700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176815b780 con 0x7f176815b3b0 2022-09-20T20:13:49.127 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.123+0000 7f176f668700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1768069780 con 0x7f176806feb0 2022-09-20T20:13:49.127 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.123+0000 7f176dc05700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f176806feb0 0x7f17680c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.128 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.123+0000 7f176dc05700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f176806feb0 0x7f17680c8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:55010/0 (socket says 172.21.15.55:55010) 2022-09-20T20:13:49.128 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.123+0000 7f176dc05700 1 -- 172.21.15.55:0/906518453 learned_addr learned my addr 172.21.15.55:0/906518453 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-09-20T20:13:49.128 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.123+0000 7f176d404700 1 --2- 172.21.15.55:0/906518453 >> v2:172.21.15.8:3300/0 conn(0x7f176815b3b0 0x7f17680cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.128 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.123+0000 7f176dc05700 1 -- 172.21.15.55:0/906518453 >> v2:172.21.15.8:3300/0 conn(0x7f176815b3b0 msgr2=0x7f17680cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:13:49.129 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.123+0000 7f176dc05700 1 --2- 172.21.15.55:0/906518453 >> v2:172.21.15.8:3300/0 conn(0x7f176815b3b0 0x7f17680cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.129 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.123+0000 7f176dc05700 1 -- 172.21.15.55:0/906518453 >> v1:172.21.15.55:6789/0 conn(0x7f17680cba10 legacy=0x7f176806f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.129 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.123+0000 7f176dc05700 1 -- 172.21.15.55:0/906518453 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1768069a60 con 0x7f176806feb0 2022-09-20T20:13:49.129 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.123+0000 7f1757fff700 1 -- 172.21.15.55:0/906518453 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 790077730 0 0) 0x7f1768069530 con 0x7f17680cba10 2022-09-20T20:13:49.129 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.124+0000 7f176dc05700 1 --2- 172.21.15.55:0/906518453 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f176806feb0 0x7f17680c8490 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1760009e50 tx=0x7f176000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e07b6086861272c7 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:49.130 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.124+0000 7f1757fff700 1 -- 172.21.15.55:0/906518453 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176000e070 con 0x7f176806feb0 2022-09-20T20:13:49.130 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.124+0000 7f1757fff700 1 -- 172.21.15.55:0/906518453 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176000b910 con 0x7f176806feb0 2022-09-20T20:13:49.130 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.124+0000 7f1757fff700 1 -- 172.21.15.55:0/906518453 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176000bcc0 con 0x7f176806feb0 2022-09-20T20:13:49.130 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.124+0000 7f176f668700 1 -- 172.21.15.55:0/906518453 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f176806feb0 msgr2=0x7f17680c8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.131 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.124+0000 7f176f668700 1 --2- 172.21.15.55:0/906518453 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f176806feb0 0x7f17680c8490 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1760009e50 tx=0x7f176000b330 comp rx=0 tx=0).stop 2022-09-20T20:13:49.131 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.124+0000 7f176f668700 1 -- 172.21.15.55:0/906518453 shutdown_connections 2022-09-20T20:13:49.131 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.124+0000 7f176f668700 1 --2- 172.21.15.55:0/906518453 >> v2:172.21.15.8:3300/0 conn(0x7f176815b3b0 0x7f17680cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.131 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.124+0000 7f176f668700 1 --2- 172.21.15.55:0/906518453 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f176806feb0 0x7f17680c8490 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.131 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.124+0000 7f176f668700 1 -- 172.21.15.55:0/906518453 >> 172.21.15.55:0/906518453 conn(0x7f17680cde40 msgr2=0x7f17680ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:49.132 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.125+0000 7f176f668700 1 -- 172.21.15.55:0/906518453 shutdown_connections 2022-09-20T20:13:49.132 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.125+0000 7f176f668700 1 -- 172.21.15.55:0/906518453 wait complete. 2022-09-20T20:13:49.133 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.126+0000 7f176f668700 1 Processor -- start 2022-09-20T20:13:49.133 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.126+0000 7f176f668700 1 -- start start 2022-09-20T20:13:49.134 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:49.127+0000 7fd6420df200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-09-20T20:13:49.136 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f176f668700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f176806feb0 0x7f17680b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.137 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f176f668700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17680cba10 0x7f17680c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.137 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f176f668700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f176815b3b0 0x7f17680c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.137 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f176f668700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1768145ba0 con 0x7f176806feb0 2022-09-20T20:13:49.137 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f176f668700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176815da10 con 0x7f176815b3b0 2022-09-20T20:13:49.138 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f176f668700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1768145270 con 0x7f17680cba10 2022-09-20T20:13:49.138 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f176dc05700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f176815b3b0 0x7f17680c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.138 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f176d404700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f176806feb0 0x7f17680b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.138 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f176d404700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f176806feb0 0x7f17680b16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.55:60590/0 (socket says 172.21.15.55:60590) 2022-09-20T20:13:49.139 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f176dc05700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f176815b3b0 0x7f17680c34d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36540/0 (socket says 172.21.15.55:36540) 2022-09-20T20:13:49.139 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f176d404700 1 -- 172.21.15.55:0/426822832 learned_addr learned my addr 172.21.15.55:0/426822832 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-09-20T20:13:49.139 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f176cc03700 1 --2- 172.21.15.55:0/426822832 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17680cba10 0x7f17680c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.139 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f176cc03700 1 -- 172.21.15.55:0/426822832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f176815b3b0 msgr2=0x7f17680c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.139 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f176cc03700 1 --2- 172.21.15.55:0/426822832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f176815b3b0 0x7f17680c34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.140 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f176cc03700 1 -- 172.21.15.55:0/426822832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f176806feb0 msgr2=0x7f17680b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.140 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f176cc03700 1 --2- 172.21.15.55:0/426822832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f176806feb0 0x7f17680b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.140 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f176cc03700 1 -- 172.21.15.55:0/426822832 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1760009b30 con 0x7f17680cba10 2022-09-20T20:13:49.140 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f176cc03700 1 --2- 172.21.15.55:0/426822832 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17680cba10 0x7f17680c2f90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f175800c520 tx=0x7f175800c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:49.140 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.127+0000 7f1755ffb700 1 -- 172.21.15.55:0/426822832 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17580054e0 con 0x7f17680cba10 2022-09-20T20:13:49.141 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.128+0000 7f1755ffb700 1 -- 172.21.15.55:0/426822832 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1758003680 con 0x7f17680cba10 2022-09-20T20:13:49.141 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.128+0000 7f176f668700 1 -- 172.21.15.55:0/426822832 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1768145550 con 0x7f17680cba10 2022-09-20T20:13:49.141 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.128+0000 7f1755ffb700 1 -- 172.21.15.55:0/426822832 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1758003a30 con 0x7f17680cba10 2022-09-20T20:13:49.141 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.128+0000 7f176f668700 1 -- 172.21.15.55:0/426822832 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17680c1970 con 0x7f17680cba10 2022-09-20T20:13:49.142 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.128+0000 7f1755ffb700 1 -- 172.21.15.55:0/426822832 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f1758019030 con 0x7f17680cba10 2022-09-20T20:13:49.142 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.128+0000 7f1755ffb700 1 -- 172.21.15.55:0/426822832 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f1758003e00 con 0x7f17680cba10 2022-09-20T20:13:49.142 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.129+0000 7f176f668700 1 -- 172.21.15.55:0/426822832 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17681e5c90 con 0x7f17680cba10 2022-09-20T20:13:49.142 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.131+0000 7f1755ffb700 1 -- 172.21.15.55:0/426822832 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7f1758021060 con 0x7f17680cba10 2022-09-20T20:13:49.216 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.215+0000 7f176f668700 1 -- 172.21.15.55:0/426822832 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd new", "uuid": "296cfab0-d996-45d6-bef0-69c311817ffa", "id": 2} v 0) v1 -- 0x7f176804da60 con 0x7f17680cba10 2022-09-20T20:13:49.221 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.220+0000 7f1755ffb700 1 -- 172.21.15.55:0/426822832 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "296cfab0-d996-45d6-bef0-69c311817ffa", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1758017070 con 0x7f17680cba10 2022-09-20T20:13:49.222 INFO:teuthology.orchestra.run.smithi055.stdout:2 2022-09-20T20:13:49.223 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.221+0000 7f176f668700 1 -- 172.21.15.55:0/426822832 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17680cba10 msgr2=0x7f17680c2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.223 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.221+0000 7f176f668700 1 --2- 172.21.15.55:0/426822832 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17680cba10 0x7f17680c2f90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f175800c520 tx=0x7f175800c830 comp rx=0 tx=0).stop 2022-09-20T20:13:49.223 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.221+0000 7f176f668700 1 -- 172.21.15.55:0/426822832 shutdown_connections 2022-09-20T20:13:49.223 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.221+0000 7f176f668700 1 --2- 172.21.15.55:0/426822832 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f176806feb0 0x7f17680b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.224 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.221+0000 7f176f668700 1 --2- 172.21.15.55:0/426822832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f176815b3b0 0x7f17680c34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.224 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.221+0000 7f176f668700 1 --2- 172.21.15.55:0/426822832 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17680cba10 0x7f17680c2f90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.224 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.221+0000 7f176f668700 1 -- 172.21.15.55:0/426822832 >> 172.21.15.55:0/426822832 conn(0x7f17680cde40 msgr2=0x7f17680b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:49.224 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.221+0000 7f176f668700 1 -- 172.21.15.55:0/426822832 shutdown_connections 2022-09-20T20:13:49.224 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.221+0000 7f176f668700 1 -- 172.21.15.55:0/426822832 wait complete. 2022-09-20T20:13:49.234 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new 77dc730e-ac38-4ac5-b821-53bfe07a7bc1 3 2022-09-20T20:13:49.399 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.398+0000 7f964ebf0700 1 Processor -- start 2022-09-20T20:13:49.400 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.398+0000 7f964ebf0700 1 -- start start 2022-09-20T20:13:49.403 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.399+0000 7f964ebf0700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96480b1ab0 0x7f9648164350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.403 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.399+0000 7f964ebf0700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f964815a410 con 0x7f9648153a40 2022-09-20T20:13:49.403 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.399+0000 7f964ebf0700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9648159ae0 con 0x7f964815daf0 2022-09-20T20:13:49.404 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.399+0000 7f964ebf0700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9648159dc0 con 0x7f96480b1ab0 2022-09-20T20:13:49.404 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.399+0000 7f964d18d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96480b1ab0 0x7f9648164350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.404 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.399+0000 7f9647fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f964815daf0 0x7f96480b13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33606/0 (socket says 172.21.15.55:33606) 2022-09-20T20:13:49.404 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.399+0000 7f9647fff700 1 -- 172.21.15.55:0/2356155908 learned_addr learned my addr 172.21.15.55:0/2356155908 (peer_addr_for_me v1:172.21.15.55:0/0) 2022-09-20T20:13:49.404 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.399+0000 7f964d18d700 1 -- 172.21.15.55:0/2356155908 >> v1:172.21.15.55:6789/0 conn(0x7f964815daf0 legacy=0x7f96480b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.405 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.399+0000 7f96477fe700 1 -- 172.21.15.55:0/2356155908 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880175418 0 0) 0x7f9648159ae0 con 0x7f964815daf0 2022-09-20T20:13:49.405 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.399+0000 7f964d18d700 1 -- 172.21.15.55:0/2356155908 >> v1:172.21.15.8:6789/0 conn(0x7f9648153a40 legacy=0x7f96480c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:13:49.405 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.399+0000 7f964d18d700 1 -- 172.21.15.55:0/2356155908 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f964815a0a0 con 0x7f96480b1ab0 2022-09-20T20:13:49.405 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.399+0000 7f964d18d700 1 --2- 172.21.15.55:0/2356155908 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96480b1ab0 0x7f9648164350 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9640009dc0 tx=0x7f964000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14d656d434642df4 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:49.406 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.399+0000 7f96477fe700 1 -- 172.21.15.55:0/2356155908 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f964000e070 con 0x7f96480b1ab0 2022-09-20T20:13:49.406 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.399+0000 7f96477fe700 1 -- 172.21.15.55:0/2356155908 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f964000bbd0 con 0x7f96480b1ab0 2022-09-20T20:13:49.406 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.399+0000 7f96477fe700 1 -- 172.21.15.55:0/2356155908 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9640012430 con 0x7f96480b1ab0 2022-09-20T20:13:49.406 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.400+0000 7f964ebf0700 1 -- 172.21.15.55:0/2356155908 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96480b1ab0 msgr2=0x7f9648164350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.407 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.400+0000 7f964ebf0700 1 --2- 172.21.15.55:0/2356155908 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96480b1ab0 0x7f9648164350 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9640009dc0 tx=0x7f964000b330 comp rx=0 tx=0).stop 2022-09-20T20:13:49.407 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.400+0000 7f964ebf0700 1 -- 172.21.15.55:0/2356155908 shutdown_connections 2022-09-20T20:13:49.407 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.400+0000 7f964ebf0700 1 --2- 172.21.15.55:0/2356155908 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96480b1ab0 0x7f9648164350 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.407 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.400+0000 7f964ebf0700 1 -- 172.21.15.55:0/2356155908 >> 172.21.15.55:0/2356155908 conn(0x7f96480d05b0 msgr2=0x7f96480cc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:49.407 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.400+0000 7f964ebf0700 1 -- 172.21.15.55:0/2356155908 shutdown_connections 2022-09-20T20:13:49.408 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.400+0000 7f964ebf0700 1 -- 172.21.15.55:0/2356155908 wait complete. 2022-09-20T20:13:49.408 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.401+0000 7f964ebf0700 1 Processor -- start 2022-09-20T20:13:49.408 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.401+0000 7f964ebf0700 1 -- start start 2022-09-20T20:13:49.411 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.402+0000 7f964ebf0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96480b1ab0 0x7f96481502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.411 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.402+0000 7f964ebf0700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9648153a40 0x7f9648156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.411 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.402+0000 7f964ebf0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f964815daf0 0x7f96480aea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.412 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.402+0000 7f964ebf0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9648156850 con 0x7f96480b1ab0 2022-09-20T20:13:49.412 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.402+0000 7f964ebf0700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9648155840 con 0x7f964815daf0 2022-09-20T20:13:49.412 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.402+0000 7f964ebf0700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964806b620 con 0x7f9648153a40 2022-09-20T20:13:49.412 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.402+0000 7f9647fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9648153a40 0x7f9648156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.412 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.402+0000 7f964d18d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f964815daf0 0x7f96480aea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.413 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.402+0000 7f9647fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9648153a40 0x7f9648156310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:55024/0 (socket says 172.21.15.55:55024) 2022-09-20T20:13:49.413 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.402+0000 7f9647fff700 1 -- 172.21.15.55:0/3590573844 learned_addr learned my addr 172.21.15.55:0/3590573844 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-09-20T20:13:49.413 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.402+0000 7f964c98c700 1 --2- 172.21.15.55:0/3590573844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96480b1ab0 0x7f96481502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.414 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.403+0000 7f9647fff700 1 -- 172.21.15.55:0/3590573844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f964815daf0 msgr2=0x7f96480aea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.414 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.403+0000 7f9647fff700 1 --2- 172.21.15.55:0/3590573844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f964815daf0 0x7f96480aea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.414 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.403+0000 7f9647fff700 1 -- 172.21.15.55:0/3590573844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96480b1ab0 msgr2=0x7f96481502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.414 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.403+0000 7f9647fff700 1 --2- 172.21.15.55:0/3590573844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96480b1ab0 0x7f96481502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.415 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.403+0000 7f9647fff700 1 -- 172.21.15.55:0/3590573844 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9640009a70 con 0x7f9648153a40 2022-09-20T20:13:49.415 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.403+0000 7f964d18d700 1 --2- 172.21.15.55:0/3590573844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f964815daf0 0x7f96480aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:13:49.415 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.403+0000 7f9647fff700 1 --2- 172.21.15.55:0/3590573844 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9648153a40 0x7f9648156310 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f963400c4d0 tx=0x7f963400c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:49.415 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.403+0000 7f96457fa700 1 -- 172.21.15.55:0/3590573844 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9634004c80 con 0x7f9648153a40 2022-09-20T20:13:49.415 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.403+0000 7f96457fa700 1 -- 172.21.15.55:0/3590573844 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9634004de0 con 0x7f9648153a40 2022-09-20T20:13:49.416 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.403+0000 7f964ebf0700 1 -- 172.21.15.55:0/3590573844 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964806b900 con 0x7f9648153a40 2022-09-20T20:13:49.416 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.403+0000 7f96457fa700 1 -- 172.21.15.55:0/3590573844 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9634007310 con 0x7f9648153a40 2022-09-20T20:13:49.416 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.403+0000 7f964ebf0700 1 -- 172.21.15.55:0/3590573844 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9648155df0 con 0x7f9648153a40 2022-09-20T20:13:49.416 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.403+0000 7f96457fa700 1 -- 172.21.15.55:0/3590573844 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f963401a020 con 0x7f9648153a40 2022-09-20T20:13:49.417 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.403+0000 7f96457fa700 1 -- 172.21.15.55:0/3590573844 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f96340076e0 con 0x7f9648153a40 2022-09-20T20:13:49.417 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.404+0000 7f964ebf0700 1 -- 172.21.15.55:0/3590573844 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9648156010 con 0x7f9648153a40 2022-09-20T20:13:49.417 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.406+0000 7f96457fa700 1 -- 172.21.15.55:0/3590573844 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7f96340133c0 con 0x7f9648153a40 2022-09-20T20:13:49.491 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.490+0000 7f964ebf0700 1 -- 172.21.15.55:0/3590573844 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd new", "uuid": "77dc730e-ac38-4ac5-b821-53bfe07a7bc1", "id": 3} v 0) v1 -- 0x7f96480656c0 con 0x7f9648153a40 2022-09-20T20:13:49.497 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.496+0000 7f96457fa700 1 -- 172.21.15.55:0/3590573844 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "77dc730e-ac38-4ac5-b821-53bfe07a7bc1", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f963401d760 con 0x7f9648153a40 2022-09-20T20:13:49.497 INFO:teuthology.orchestra.run.smithi055.stdout:3 2022-09-20T20:13:49.499 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.497+0000 7f964ebf0700 1 -- 172.21.15.55:0/3590573844 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9648153a40 msgr2=0x7f9648156310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.499 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.497+0000 7f964ebf0700 1 --2- 172.21.15.55:0/3590573844 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9648153a40 0x7f9648156310 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f963400c4d0 tx=0x7f963400c7e0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.499 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.497+0000 7f964ebf0700 1 -- 172.21.15.55:0/3590573844 shutdown_connections 2022-09-20T20:13:49.499 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.497+0000 7f964ebf0700 1 --2- 172.21.15.55:0/3590573844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f96480b1ab0 0x7f96481502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.500 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.497+0000 7f964ebf0700 1 --2- 172.21.15.55:0/3590573844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f964815daf0 0x7f96480aea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.500 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.497+0000 7f964ebf0700 1 --2- 172.21.15.55:0/3590573844 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9648153a40 0x7f9648156310 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.500 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.497+0000 7f964ebf0700 1 -- 172.21.15.55:0/3590573844 >> 172.21.15.55:0/3590573844 conn(0x7f96480d05b0 msgr2=0x7f964806d240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:49.500 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.497+0000 7f964ebf0700 1 -- 172.21.15.55:0/3590573844 shutdown_connections 2022-09-20T20:13:49.501 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.497+0000 7f964ebf0700 1 -- 172.21.15.55:0/3590573844 wait complete. 2022-09-20T20:13:49.510 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new bbb00f2b-07be-4844-bcce-b60c4c693a0f 4 2022-09-20T20:13:49.563 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:49.562+0000 7f393c7f0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-09-20T20:13:49.597 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:49.596+0000 7fd6420df200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-09-20T20:13:49.634 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.632+0000 7fcbeb89e700 1 Processor -- start 2022-09-20T20:13:49.634 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.632+0000 7fcbeb89e700 1 -- start start 2022-09-20T20:13:49.637 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.633+0000 7fcbeb89e700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fcbe415a240 0x7fcbe406f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.637 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.633+0000 7fcbeb89e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcbe406fd00 0x7fcbe4068b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.637 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.633+0000 7fcbeb89e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe4159570 con 0x7fcbe41591a0 2022-09-20T20:13:49.638 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.633+0000 7fcbeb89e700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe4070c40 con 0x7fcbe415a240 2022-09-20T20:13:49.638 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.633+0000 7fcbeb89e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe415a6b0 con 0x7fcbe406fd00 2022-09-20T20:13:49.638 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.633+0000 7fcbe963a700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcbe41591a0 0x7fcbe40c84f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33618/0 (socket says 172.21.15.55:33618) 2022-09-20T20:13:49.638 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.633+0000 7fcbe963a700 1 -- 172.21.15.55:0/2527700384 learned_addr learned my addr 172.21.15.55:0/2527700384 (peer_addr_for_me v1:172.21.15.55:0/0) 2022-09-20T20:13:49.639 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.633+0000 7fcbe9e3b700 1 --2- 172.21.15.55:0/2527700384 >> v2:172.21.15.55:3300/0 conn(0x7fcbe406fd00 0x7fcbe4068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.639 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.633+0000 7fcbe8e39700 1 --2- 172.21.15.55:0/2527700384 >> v2:172.21.15.8:3300/0 conn(0x7fcbe415a240 0x7fcbe406f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.639 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.634+0000 7fcbd3fff700 1 -- 172.21.15.55:0/2527700384 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874455701 0 0) 0x7fcbe0001110 con 0x7fcbe41591a0 2022-09-20T20:13:49.639 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.634+0000 7fcbd3fff700 1 -- 172.21.15.55:0/2527700384 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbcc0035b0 con 0x7fcbe41591a0 2022-09-20T20:13:49.640 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.634+0000 7fcbe9e3b700 1 -- 172.21.15.55:0/2527700384 >> v2:172.21.15.8:3300/0 conn(0x7fcbe415a240 msgr2=0x7fcbe406f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:13:49.640 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.634+0000 7fcbe9e3b700 1 --2- 172.21.15.55:0/2527700384 >> v2:172.21.15.8:3300/0 conn(0x7fcbe415a240 0x7fcbe406f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.640 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.634+0000 7fcbe9e3b700 1 -- 172.21.15.55:0/2527700384 >> v1:172.21.15.55:6789/0 conn(0x7fcbe41591a0 legacy=0x7fcbe40c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.640 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.634+0000 7fcbe9e3b700 1 -- 172.21.15.55:0/2527700384 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe40ca520 con 0x7fcbe406fd00 2022-09-20T20:13:49.640 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.634+0000 7fcbe9e3b700 1 --2- 172.21.15.55:0/2527700384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe406fd00 0x7fcbe4068b20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcbe40649b0 tx=0x7fcbdc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c6ddfb2113c76eb server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:49.641 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.634+0000 7fcbd3fff700 1 -- 172.21.15.55:0/2527700384 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc00e070 con 0x7fcbe406fd00 2022-09-20T20:13:49.641 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.634+0000 7fcbd3fff700 1 -- 172.21.15.55:0/2527700384 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc00bb20 con 0x7fcbe406fd00 2022-09-20T20:13:49.641 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.634+0000 7fcbd3fff700 1 -- 172.21.15.55:0/2527700384 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc012430 con 0x7fcbe406fd00 2022-09-20T20:13:49.641 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.635+0000 7fcbeb89e700 1 -- 172.21.15.55:0/2527700384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe406fd00 msgr2=0x7fcbe4068b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.642 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.635+0000 7fcbeb89e700 1 --2- 172.21.15.55:0/2527700384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe406fd00 0x7fcbe4068b20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcbe40649b0 tx=0x7fcbdc00b330 comp rx=0 tx=0).stop 2022-09-20T20:13:49.642 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.635+0000 7fcbeb89e700 1 -- 172.21.15.55:0/2527700384 shutdown_connections 2022-09-20T20:13:49.642 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.635+0000 7fcbeb89e700 1 --2- 172.21.15.55:0/2527700384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe406fd00 0x7fcbe4068b20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.642 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.635+0000 7fcbeb89e700 1 --2- 172.21.15.55:0/2527700384 >> v2:172.21.15.8:3300/0 conn(0x7fcbe415a240 0x7fcbe406f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.635+0000 7fcbeb89e700 1 -- 172.21.15.55:0/2527700384 >> 172.21.15.55:0/2527700384 conn(0x7fcbe40ca9b0 msgr2=0x7fcbe40cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.635+0000 7fcbeb89e700 1 -- 172.21.15.55:0/2527700384 shutdown_connections 2022-09-20T20:13:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.635+0000 7fcbeb89e700 1 -- 172.21.15.55:0/2527700384 wait complete. 2022-09-20T20:13:49.646 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.636+0000 7fcbeb89e700 1 Processor -- start 2022-09-20T20:13:49.646 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.636+0000 7fcbeb89e700 1 -- start start 2022-09-20T20:13:49.646 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.637+0000 7fcbeb89e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcbe406fd00 0x7fcbe40b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.646 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.637+0000 7fcbeb89e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbe41591a0 0x7fcbe40b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.647 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.637+0000 7fcbeb89e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe415a240 0x7fcbe40c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.647 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.637+0000 7fcbeb89e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40c2f40 con 0x7fcbe41591a0 2022-09-20T20:13:49.647 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.637+0000 7fcbeb89e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40c3190 con 0x7fcbe415a240 2022-09-20T20:13:49.647 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.637+0000 7fcbeb89e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40c3470 con 0x7fcbe406fd00 2022-09-20T20:13:49.648 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.638+0000 7fcbe9e3b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe415a240 0x7fcbe40c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.648 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.638+0000 7fcbe963a700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcbe406fd00 0x7fcbe40b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.648 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.638+0000 7fcbe9e3b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe415a240 0x7fcbe40c3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36564/0 (socket says 172.21.15.55:36564) 2022-09-20T20:13:49.648 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.638+0000 7fcbe9e3b700 1 -- 172.21.15.55:0/1713720395 learned_addr learned my addr 172.21.15.55:0/1713720395 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-09-20T20:13:49.648 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.638+0000 7fcbe8e39700 1 --2- 172.21.15.55:0/1713720395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbe41591a0 0x7fcbe40b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.649 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.638+0000 7fcbe9e3b700 1 -- 172.21.15.55:0/1713720395 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcbe406fd00 msgr2=0x7fcbe40b2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.649 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.638+0000 7fcbe9e3b700 1 --2- 172.21.15.55:0/1713720395 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcbe406fd00 0x7fcbe40b2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.649 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.638+0000 7fcbe9e3b700 1 -- 172.21.15.55:0/1713720395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbe41591a0 msgr2=0x7fcbe40b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.649 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.638+0000 7fcbe9e3b700 1 --2- 172.21.15.55:0/1713720395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbe41591a0 0x7fcbe40b32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.649 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.638+0000 7fcbe9e3b700 1 -- 172.21.15.55:0/1713720395 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc009a70 con 0x7fcbe415a240 2022-09-20T20:13:49.650 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.638+0000 7fcbe8e39700 1 --2- 172.21.15.55:0/1713720395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbe41591a0 0x7fcbe40b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:13:49.650 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.638+0000 7fcbe963a700 1 --2- 172.21.15.55:0/1713720395 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcbe406fd00 0x7fcbe40b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:13:49.650 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.638+0000 7fcbe9e3b700 1 --2- 172.21.15.55:0/1713720395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe415a240 0x7fcbe40c3f50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc014040 tx=0x7fcbdc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:49.650 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.638+0000 7fcbd1ffb700 1 -- 172.21.15.55:0/1713720395 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc012430 con 0x7fcbe415a240 2022-09-20T20:13:49.651 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.638+0000 7fcbd1ffb700 1 -- 172.21.15.55:0/1713720395 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc020070 con 0x7fcbe415a240 2022-09-20T20:13:49.651 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.638+0000 7fcbeb89e700 1 -- 172.21.15.55:0/1713720395 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe40c3750 con 0x7fcbe415a240 2022-09-20T20:13:49.651 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.638+0000 7fcbd1ffb700 1 -- 172.21.15.55:0/1713720395 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0098f0 con 0x7fcbe415a240 2022-09-20T20:13:49.651 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.639+0000 7fcbeb89e700 1 -- 172.21.15.55:0/1713720395 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe40c4490 con 0x7fcbe415a240 2022-09-20T20:13:49.651 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.639+0000 7fcbd1ffb700 1 -- 172.21.15.55:0/1713720395 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fcbdc004040 con 0x7fcbe415a240 2022-09-20T20:13:49.652 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.639+0000 7fcbd1ffb700 1 -- 172.21.15.55:0/1713720395 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fcbdc022070 con 0x7fcbe415a240 2022-09-20T20:13:49.652 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.639+0000 7fcbeb89e700 1 -- 172.21.15.55:0/1713720395 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe40c3c70 con 0x7fcbe415a240 2022-09-20T20:13:49.652 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.642+0000 7fcbd1ffb700 1 -- 172.21.15.55:0/1713720395 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7fcbdc0456d0 con 0x7fcbe415a240 2022-09-20T20:13:49.729 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.727+0000 7fcbeb89e700 1 -- 172.21.15.55:0/1713720395 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bbb00f2b-07be-4844-bcce-b60c4c693a0f", "id": 4} v 0) v1 -- 0x7fcbe4072c60 con 0x7fcbe415a240 2022-09-20T20:13:49.733 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.732+0000 7fcbd1ffb700 1 -- 172.21.15.55:0/1713720395 <== mon.1 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bbb00f2b-07be-4844-bcce-b60c4c693a0f", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcbdc034030 con 0x7fcbe415a240 2022-09-20T20:13:49.734 INFO:teuthology.orchestra.run.smithi055.stdout:4 2022-09-20T20:13:49.735 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.733+0000 7fcbeb89e700 1 -- 172.21.15.55:0/1713720395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe415a240 msgr2=0x7fcbe40c3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.735 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.733+0000 7fcbeb89e700 1 --2- 172.21.15.55:0/1713720395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe415a240 0x7fcbe40c3f50 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc014040 tx=0x7fcbdc004ad0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.736 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.733+0000 7fcbeb89e700 1 -- 172.21.15.55:0/1713720395 shutdown_connections 2022-09-20T20:13:49.736 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.733+0000 7fcbeb89e700 1 --2- 172.21.15.55:0/1713720395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbe415a240 0x7fcbe40c3f50 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.736 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.733+0000 7fcbeb89e700 1 --2- 172.21.15.55:0/1713720395 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcbe406fd00 0x7fcbe40b2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.736 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.733+0000 7fcbeb89e700 1 --2- 172.21.15.55:0/1713720395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcbe41591a0 0x7fcbe40b32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.737 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.733+0000 7fcbeb89e700 1 -- 172.21.15.55:0/1713720395 >> 172.21.15.55:0/1713720395 conn(0x7fcbe40ca9b0 msgr2=0x7fcbe415c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:49.737 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.733+0000 7fcbeb89e700 1 -- 172.21.15.55:0/1713720395 shutdown_connections 2022-09-20T20:13:49.737 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.733+0000 7fcbeb89e700 1 -- 172.21.15.55:0/1713720395 wait complete. 2022-09-20T20:13:49.746 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new dad61efb-3c40-4377-ba3d-df1ea6996dec 5 2022-09-20T20:13:49.872 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.870+0000 7fae8d121700 1 Processor -- start 2022-09-20T20:13:49.872 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.871+0000 7fae8d121700 1 -- start start 2022-09-20T20:13:49.875 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.872+0000 7fae8d121700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae8806ca50 0x7fae88070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.875 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.872+0000 7fae8d121700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae88070140 0x7fae88068b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.875 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.872+0000 7fae8d121700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae880ce3e0 con 0x7fae8815b520 2022-09-20T20:13:49.876 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.872+0000 7fae8d121700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae880c2a20 con 0x7fae88070140 2022-09-20T20:13:49.876 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.872+0000 7fae8d121700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae880b0dd0 con 0x7fae8806ca50 2022-09-20T20:13:49.876 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.872+0000 7fae8759e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae88070140 0x7fae88068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.876 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.872+0000 7fae8659c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae8806ca50 0x7fae88070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.877 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.872+0000 7fae8759e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae88070140 0x7fae88068b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36570/0 (socket says 172.21.15.55:36570) 2022-09-20T20:13:49.877 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.872+0000 7fae8659c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae8806ca50 0x7fae88070a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:55044/0 (socket says 172.21.15.55:55044) 2022-09-20T20:13:49.877 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.872+0000 7fae8759e700 1 -- 172.21.15.55:0/2680895199 learned_addr learned my addr 172.21.15.55:0/2680895199 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-09-20T20:13:49.877 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.872+0000 7fae8759e700 1 -- 172.21.15.55:0/2680895199 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae8806ca50 msgr2=0x7fae88070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:13:49.877 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.872+0000 7fae8759e700 1 --2- 172.21.15.55:0/2680895199 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae8806ca50 0x7fae88070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.878 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.872+0000 7fae8759e700 1 -- 172.21.15.55:0/2680895199 >> v1:172.21.15.8:6789/0 conn(0x7fae8815b520 legacy=0x7fae880c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.878 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.872+0000 7fae8759e700 1 -- 172.21.15.55:0/2680895199 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae880b10b0 con 0x7fae88070140 2022-09-20T20:13:49.878 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.873+0000 7fae8759e700 1 --2- 172.21.15.55:0/2680895199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae88070140 0x7fae88068b20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fae80009e50 tx=0x7fae8000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8f9f0d8de827b40 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:49.878 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.873+0000 7fae85d9b700 1 -- 172.21.15.55:0/2680895199 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8000e070 con 0x7fae88070140 2022-09-20T20:13:49.879 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.873+0000 7fae85d9b700 1 -- 172.21.15.55:0/2680895199 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8000b910 con 0x7fae88070140 2022-09-20T20:13:49.879 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.873+0000 7fae85d9b700 1 -- 172.21.15.55:0/2680895199 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8000bcc0 con 0x7fae88070140 2022-09-20T20:13:49.879 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.873+0000 7fae8d121700 1 -- 172.21.15.55:0/2680895199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae88070140 msgr2=0x7fae88068b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.879 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.873+0000 7fae8d121700 1 --2- 172.21.15.55:0/2680895199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae88070140 0x7fae88068b20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fae80009e50 tx=0x7fae8000b330 comp rx=0 tx=0).stop 2022-09-20T20:13:49.879 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.873+0000 7fae8d121700 1 -- 172.21.15.55:0/2680895199 shutdown_connections 2022-09-20T20:13:49.880 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.873+0000 7fae8d121700 1 --2- 172.21.15.55:0/2680895199 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae88070140 0x7fae88068b20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.880 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.873+0000 7fae8d121700 1 --2- 172.21.15.55:0/2680895199 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae8806ca50 0x7fae88070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.880 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.873+0000 7fae8d121700 1 -- 172.21.15.55:0/2680895199 >> 172.21.15.55:0/2680895199 conn(0x7fae8806e8c0 msgr2=0x7fae8806c220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:49.880 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.873+0000 7fae8d121700 1 -- 172.21.15.55:0/2680895199 shutdown_connections 2022-09-20T20:13:49.881 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.873+0000 7fae8d121700 1 -- 172.21.15.55:0/2680895199 wait complete. 2022-09-20T20:13:49.883 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.875+0000 7fae8d121700 1 Processor -- start 2022-09-20T20:13:49.884 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.875+0000 7fae8d121700 1 -- start start 2022-09-20T20:13:49.884 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae8d121700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae8806ca50 0x7fae881583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.884 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae8d121700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae88070140 0x7fae881e50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.884 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae8d121700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae8815b520 0x7fae880acab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:49.885 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae8d121700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8815a340 con 0x7fae8815b520 2022-09-20T20:13:49.885 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae8d121700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8815a620 con 0x7fae88070140 2022-09-20T20:13:49.885 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae8d121700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8815a900 con 0x7fae8806ca50 2022-09-20T20:13:49.885 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae86d9d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae8806ca50 0x7fae881583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.885 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae8659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae88070140 0x7fae881e50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.886 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae86d9d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae8806ca50 0x7fae881583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:55048/0 (socket says 172.21.15.55:55048) 2022-09-20T20:13:49.886 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae8759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae8815b520 0x7fae880acab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:49.886 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae86d9d700 1 -- 172.21.15.55:0/2887714297 learned_addr learned my addr 172.21.15.55:0/2887714297 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-09-20T20:13:49.886 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae8659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae88070140 0x7fae881e50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36574/0 (socket says 172.21.15.55:36574) 2022-09-20T20:13:49.887 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae8659c700 1 -- 172.21.15.55:0/2887714297 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae8806ca50 msgr2=0x7fae881583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.887 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae8659c700 1 --2- 172.21.15.55:0/2887714297 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae8806ca50 0x7fae881583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.887 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae8659c700 1 -- 172.21.15.55:0/2887714297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae8815b520 msgr2=0x7fae880acab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.887 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae8659c700 1 --2- 172.21.15.55:0/2887714297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae8815b520 0x7fae880acab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.887 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae8659c700 1 -- 172.21.15.55:0/2887714297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae80009b30 con 0x7fae88070140 2022-09-20T20:13:49.888 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae86d9d700 1 --2- 172.21.15.55:0/2887714297 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae8806ca50 0x7fae881583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:13:49.888 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae8659c700 1 --2- 172.21.15.55:0/2887714297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae88070140 0x7fae881e50b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00e870 tx=0x7fae7c00eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:49.888 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.876+0000 7fae6f7fe700 1 -- 172.21.15.55:0/2887714297 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c013680 con 0x7fae88070140 2022-09-20T20:13:49.888 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.877+0000 7fae6f7fe700 1 -- 172.21.15.55:0/2887714297 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c0137e0 con 0x7fae88070140 2022-09-20T20:13:49.889 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.877+0000 7fae8d121700 1 -- 172.21.15.55:0/2887714297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8815abe0 con 0x7fae88070140 2022-09-20T20:13:49.889 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.877+0000 7fae6f7fe700 1 -- 172.21.15.55:0/2887714297 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c013b90 con 0x7fae88070140 2022-09-20T20:13:49.889 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.877+0000 7fae8d121700 1 -- 172.21.15.55:0/2887714297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae88158910 con 0x7fae88070140 2022-09-20T20:13:49.889 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.877+0000 7fae6f7fe700 1 -- 172.21.15.55:0/2887714297 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fae7c019030 con 0x7fae88070140 2022-09-20T20:13:49.889 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.877+0000 7fae6f7fe700 1 -- 172.21.15.55:0/2887714297 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fae7c005de0 con 0x7fae88070140 2022-09-20T20:13:49.890 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.878+0000 7fae8d121700 1 -- 172.21.15.55:0/2887714297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae881f0a30 con 0x7fae88070140 2022-09-20T20:13:49.890 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.880+0000 7fae6f7fe700 1 -- 172.21.15.55:0/2887714297 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7fae7c021060 con 0x7fae88070140 2022-09-20T20:13:49.967 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.966+0000 7fae8d121700 1 -- 172.21.15.55:0/2887714297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dad61efb-3c40-4377-ba3d-df1ea6996dec", "id": 5} v 0) v1 -- 0x7fae88072c60 con 0x7fae88070140 2022-09-20T20:13:49.975 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.973+0000 7fae6f7fe700 1 -- 172.21.15.55:0/2887714297 <== mon.1 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dad61efb-3c40-4377-ba3d-df1ea6996dec", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fae7c029020 con 0x7fae88070140 2022-09-20T20:13:49.975 INFO:teuthology.orchestra.run.smithi055.stdout:5 2022-09-20T20:13:49.976 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.974+0000 7fae8d121700 1 -- 172.21.15.55:0/2887714297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae88070140 msgr2=0x7fae881e50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:49.977 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.974+0000 7fae8d121700 1 --2- 172.21.15.55:0/2887714297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae88070140 0x7fae881e50b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00e870 tx=0x7fae7c00eb80 comp rx=0 tx=0).stop 2022-09-20T20:13:49.977 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.974+0000 7fae8d121700 1 -- 172.21.15.55:0/2887714297 shutdown_connections 2022-09-20T20:13:49.977 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.974+0000 7fae8d121700 1 --2- 172.21.15.55:0/2887714297 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fae8815b520 0x7fae880acab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.977 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.974+0000 7fae8d121700 1 --2- 172.21.15.55:0/2887714297 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae8806ca50 0x7fae881583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.978 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.974+0000 7fae8d121700 1 --2- 172.21.15.55:0/2887714297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae88070140 0x7fae881e50b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:49.978 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.974+0000 7fae8d121700 1 -- 172.21.15.55:0/2887714297 >> 172.21.15.55:0/2887714297 conn(0x7fae8806e8c0 msgr2=0x7fae88068b20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:49.978 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.974+0000 7fae8d121700 1 -- 172.21.15.55:0/2887714297 shutdown_connections 2022-09-20T20:13:49.978 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:49.974+0000 7fae8d121700 1 -- 172.21.15.55:0/2887714297 wait complete. 2022-09-20T20:13:49.988 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new 6b9de588-7ec2-4466-a4a8-561d80a92f5e 6 2022-09-20T20:13:50.150 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:50.148+0000 7f393c7f0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-09-20T20:13:50.151 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.149+0000 7f39775c3700 1 Processor -- start 2022-09-20T20:13:50.151 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.149+0000 7f39775c3700 1 -- start start 2022-09-20T20:13:50.158 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.150+0000 7f39775c3700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3970158e00 0x7f39700cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:50.158 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.150+0000 7f39775c3700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f397006f7c0 0x7f397006fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:50.158 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.150+0000 7f39775c3700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f397006b8c0 con 0x7f397015c330 2022-09-20T20:13:50.159 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.150+0000 7f39775c3700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39700cbb10 con 0x7f397006f7c0 2022-09-20T20:13:50.159 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.150+0000 7f39775c3700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39700cbdf0 con 0x7f3970158e00 2022-09-20T20:13:50.159 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.150+0000 7f397535f700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3970158e00 0x7f39700cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:50.159 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.150+0000 7f397535f700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3970158e00 0x7f39700cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:55054/0 (socket says 172.21.15.55:55054) 2022-09-20T20:13:50.160 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.150+0000 7f397535f700 1 -- 172.21.15.55:0/4112817330 learned_addr learned my addr 172.21.15.55:0/4112817330 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-09-20T20:13:50.160 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.150+0000 7f3975b60700 1 --2- 172.21.15.55:0/4112817330 >> v2:172.21.15.8:3300/0 conn(0x7f397006f7c0 0x7f397006fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:50.160 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.151+0000 7f397535f700 1 -- 172.21.15.55:0/4112817330 >> v2:172.21.15.8:3300/0 conn(0x7f397006f7c0 msgr2=0x7f397006fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:13:50.160 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.151+0000 7f397535f700 1 --2- 172.21.15.55:0/4112817330 >> v2:172.21.15.8:3300/0 conn(0x7f397006f7c0 0x7f397006fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.161 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.151+0000 7f397535f700 1 -- 172.21.15.55:0/4112817330 >> v1:172.21.15.8:6789/0 conn(0x7f397015c330 legacy=0x7f397006c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:50.161 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.151+0000 7f397535f700 1 -- 172.21.15.55:0/4112817330 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39700cc0d0 con 0x7f3970158e00 2022-09-20T20:13:50.161 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.151+0000 7f397535f700 1 --2- 172.21.15.55:0/4112817330 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3970158e00 0x7f39700cd750 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f396c0098f0 tx=0x7f396c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f99415776bce2d2f server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:50.161 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.151+0000 7f395ffff700 1 -- 172.21.15.55:0/4112817330 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c011830 con 0x7f3970158e00 2022-09-20T20:13:50.162 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.151+0000 7f395ffff700 1 -- 172.21.15.55:0/4112817330 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396c011990 con 0x7f3970158e00 2022-09-20T20:13:50.162 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.151+0000 7f395ffff700 1 -- 172.21.15.55:0/4112817330 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396c011d20 con 0x7f3970158e00 2022-09-20T20:13:50.162 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.152+0000 7f39775c3700 1 -- 172.21.15.55:0/4112817330 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3970158e00 msgr2=0x7f39700cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:50.162 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.152+0000 7f39775c3700 1 --2- 172.21.15.55:0/4112817330 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3970158e00 0x7f39700cd750 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f396c0098f0 tx=0x7f396c009c00 comp rx=0 tx=0).stop 2022-09-20T20:13:50.162 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.152+0000 7f39775c3700 1 -- 172.21.15.55:0/4112817330 shutdown_connections 2022-09-20T20:13:50.163 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.152+0000 7f39775c3700 1 --2- 172.21.15.55:0/4112817330 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3970158e00 0x7f39700cd750 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.163 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.152+0000 7f39775c3700 1 --2- 172.21.15.55:0/4112817330 >> v2:172.21.15.8:3300/0 conn(0x7f397006f7c0 0x7f397006fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.163 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.152+0000 7f39775c3700 1 -- 172.21.15.55:0/4112817330 >> 172.21.15.55:0/4112817330 conn(0x7f39700ca9b0 msgr2=0x7f39700cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:50.163 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.152+0000 7f39775c3700 1 -- 172.21.15.55:0/4112817330 shutdown_connections 2022-09-20T20:13:50.164 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.152+0000 7f39775c3700 1 -- 172.21.15.55:0/4112817330 wait complete. 2022-09-20T20:13:50.164 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.153+0000 7f39775c3700 1 Processor -- start 2022-09-20T20:13:50.164 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.153+0000 7f39775c3700 1 -- start start 2022-09-20T20:13:50.164 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.154+0000 7f39775c3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f397006f7c0 0x7f3970140bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:50.165 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.154+0000 7f39775c3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3970158e00 0x7f39700c3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:50.165 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.154+0000 7f39775c3700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f397015c330 0x7f39700c4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:50.165 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.154+0000 7f39775c3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39700c48b0 con 0x7f3970158e00 2022-09-20T20:13:50.166 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.154+0000 7f39775c3700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3970153dd0 con 0x7f397006f7c0 2022-09-20T20:13:50.166 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.154+0000 7f39775c3700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39700b3b60 con 0x7f397015c330 2022-09-20T20:13:50.166 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.154+0000 7f3975b60700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f397015c330 0x7f39700c4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:50.166 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.154+0000 7f3975b60700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f397015c330 0x7f39700c4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:55064/0 (socket says 172.21.15.55:55064) 2022-09-20T20:13:50.166 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.154+0000 7f3975b60700 1 -- 172.21.15.55:0/1918745206 learned_addr learned my addr 172.21.15.55:0/1918745206 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-09-20T20:13:50.167 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.154+0000 7f397535f700 1 --2- 172.21.15.55:0/1918745206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f397006f7c0 0x7f3970140bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:50.167 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.154+0000 7f3974b5e700 1 --2- 172.21.15.55:0/1918745206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3970158e00 0x7f39700c3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:50.167 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.154+0000 7f3975b60700 1 -- 172.21.15.55:0/1918745206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f397006f7c0 msgr2=0x7f3970140bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:50.167 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.154+0000 7f3975b60700 1 --2- 172.21.15.55:0/1918745206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f397006f7c0 0x7f3970140bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.168 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.154+0000 7f3975b60700 1 -- 172.21.15.55:0/1918745206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3970158e00 msgr2=0x7f39700c3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:50.168 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.154+0000 7f3975b60700 1 --2- 172.21.15.55:0/1918745206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3970158e00 0x7f39700c3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.168 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.154+0000 7f3975b60700 1 -- 172.21.15.55:0/1918745206 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396c009550 con 0x7f397015c330 2022-09-20T20:13:50.168 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.154+0000 7f397535f700 1 --2- 172.21.15.55:0/1918745206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f397006f7c0 0x7f3970140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:13:50.169 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.154+0000 7f3975b60700 1 --2- 172.21.15.55:0/1918745206 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f397015c330 0x7f39700c4370 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f396800efc0 tx=0x7f396800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:50.169 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.155+0000 7f395dffb700 1 -- 172.21.15.55:0/1918745206 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3968009ea0 con 0x7f397015c330 2022-09-20T20:13:50.169 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.155+0000 7f395dffb700 1 -- 172.21.15.55:0/1918745206 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396800f040 con 0x7f397015c330 2022-09-20T20:13:50.169 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.155+0000 7f39775c3700 1 -- 172.21.15.55:0/1918745206 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3970154020 con 0x7f397015c330 2022-09-20T20:13:50.170 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.155+0000 7f395dffb700 1 -- 172.21.15.55:0/1918745206 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396800ced0 con 0x7f397015c330 2022-09-20T20:13:50.170 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.155+0000 7f39775c3700 1 -- 172.21.15.55:0/1918745206 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39701545e0 con 0x7f397015c330 2022-09-20T20:13:50.170 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.155+0000 7f395dffb700 1 -- 172.21.15.55:0/1918745206 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f39680146f0 con 0x7f397015c330 2022-09-20T20:13:50.170 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.155+0000 7f395dffb700 1 -- 172.21.15.55:0/1918745206 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f39680139d0 con 0x7f397015c330 2022-09-20T20:13:50.171 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.156+0000 7f39775c3700 1 -- 172.21.15.55:0/1918745206 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39700b3eb0 con 0x7f397015c330 2022-09-20T20:13:50.171 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.158+0000 7f395dffb700 1 -- 172.21.15.55:0/1918745206 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7f3968018020 con 0x7f397015c330 2022-09-20T20:13:50.214 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:50.212+0000 7fd6420df200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-09-20T20:13:50.244 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.243+0000 7f39775c3700 1 -- 172.21.15.55:0/1918745206 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6b9de588-7ec2-4466-a4a8-561d80a92f5e", "id": 6} v 0) v1 -- 0x7f3970072c60 con 0x7f397015c330 2022-09-20T20:13:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.249+0000 7f395dffb700 1 -- 172.21.15.55:0/1918745206 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6b9de588-7ec2-4466-a4a8-561d80a92f5e", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3968013e50 con 0x7f397015c330 2022-09-20T20:13:50.251 INFO:teuthology.orchestra.run.smithi055.stdout:6 2022-09-20T20:13:50.252 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.250+0000 7f39775c3700 1 -- 172.21.15.55:0/1918745206 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f397015c330 msgr2=0x7f39700c4370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.250+0000 7f39775c3700 1 --2- 172.21.15.55:0/1918745206 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f397015c330 0x7f39700c4370 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f396800efc0 tx=0x7f396800c3a0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.250+0000 7f39775c3700 1 -- 172.21.15.55:0/1918745206 shutdown_connections 2022-09-20T20:13:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.250+0000 7f39775c3700 1 --2- 172.21.15.55:0/1918745206 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f397015c330 0x7f39700c4370 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.253 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.250+0000 7f39775c3700 1 --2- 172.21.15.55:0/1918745206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f397006f7c0 0x7f3970140bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.250+0000 7f39775c3700 1 --2- 172.21.15.55:0/1918745206 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3970158e00 0x7f39700c3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.250+0000 7f39775c3700 1 -- 172.21.15.55:0/1918745206 >> 172.21.15.55:0/1918745206 conn(0x7f39700ca9b0 msgr2=0x7f39701e3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.250+0000 7f39775c3700 1 -- 172.21.15.55:0/1918745206 shutdown_connections 2022-09-20T20:13:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.250+0000 7f39775c3700 1 -- 172.21.15.55:0/1918745206 wait complete. 2022-09-20T20:13:50.263 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new e9fbcb44-5753-4b0f-9136-007a17bc8157 7 2022-09-20T20:13:50.311 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:50.309+0000 7f393c7f0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-09-20T20:13:50.379 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:50.378+0000 7fd6420df200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-09-20T20:13:50.392 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.390+0000 7f9aece39700 1 Processor -- start 2022-09-20T20:13:50.392 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.390+0000 7f9aece39700 1 -- start start 2022-09-20T20:13:50.398 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.391+0000 7f9aece39700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae8158e00 0x7f9ae80cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:50.399 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.391+0000 7f9aece39700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f9ae815c330 0x7f9ae806c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:50.399 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.391+0000 7f9aece39700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ae806c570 0x7f9ae806f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:50.399 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.391+0000 7f9aece39700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae806b8c0 con 0x7f9ae815c330 2022-09-20T20:13:50.400 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.391+0000 7f9aece39700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae80cbb10 con 0x7f9ae806c570 2022-09-20T20:13:50.400 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.391+0000 7f9aece39700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae80cbdf0 con 0x7f9ae8158e00 2022-09-20T20:13:50.400 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.391+0000 7f9ae659c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae8158e00 0x7f9ae80cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:50.400 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.391+0000 7f9ae6d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ae806c570 0x7f9ae806f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:50.401 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.391+0000 7f9ae6d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ae806c570 0x7f9ae806f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36594/0 (socket says 172.21.15.55:36594) 2022-09-20T20:13:50.401 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.391+0000 7f9ae659c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae8158e00 0x7f9ae80cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:55066/0 (socket says 172.21.15.55:55066) 2022-09-20T20:13:50.401 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.391+0000 7f9ae6d9d700 1 -- 172.21.15.55:0/3237270936 learned_addr learned my addr 172.21.15.55:0/3237270936 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-09-20T20:13:50.401 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.391+0000 7f9ae5d9b700 1 --2- 172.21.15.55:0/3237270936 >> v2:172.21.15.8:3300/0 conn(0x7f9ae815c330 0x7f9ae806c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.392+0000 7f9ae6d9d700 1 -- 172.21.15.55:0/3237270936 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae8158e00 msgr2=0x7f9ae80cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:13:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.392+0000 7f9ae6d9d700 1 --2- 172.21.15.55:0/3237270936 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae8158e00 0x7f9ae80cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.392+0000 7f9ae6d9d700 1 -- 172.21.15.55:0/3237270936 >> v2:172.21.15.8:3300/0 conn(0x7f9ae815c330 msgr2=0x7f9ae806c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:13:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.392+0000 7f9ae6d9d700 1 --2- 172.21.15.55:0/3237270936 >> v2:172.21.15.8:3300/0 conn(0x7f9ae815c330 0x7f9ae806c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.403 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.392+0000 7f9ae6d9d700 1 -- 172.21.15.55:0/3237270936 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae80cc0d0 con 0x7f9ae806c570 2022-09-20T20:13:50.403 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.392+0000 7f9ae5d9b700 1 --2- 172.21.15.55:0/3237270936 >> v2:172.21.15.8:3300/0 conn(0x7f9ae815c330 0x7f9ae806c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-20T20:13:50.403 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.392+0000 7f9ae659c700 1 --2- 172.21.15.55:0/3237270936 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae8158e00 0x7f9ae80cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:13:50.403 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.392+0000 7f9ae6d9d700 1 --2- 172.21.15.55:0/3237270936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ae806c570 0x7f9ae806f7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9ae806f200 tx=0x7f9ae0009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcfff5191c6bb4ee server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:50.404 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.392+0000 7f9ae559a700 1 -- 172.21.15.55:0/3237270936 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0011830 con 0x7f9ae806c570 2022-09-20T20:13:50.404 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.392+0000 7f9ae559a700 1 -- 172.21.15.55:0/3237270936 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae0011990 con 0x7f9ae806c570 2022-09-20T20:13:50.404 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.392+0000 7f9ae559a700 1 -- 172.21.15.55:0/3237270936 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0011d20 con 0x7f9ae806c570 2022-09-20T20:13:50.404 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.392+0000 7f9aece39700 1 -- 172.21.15.55:0/3237270936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ae806c570 msgr2=0x7f9ae806f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:50.405 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.392+0000 7f9aece39700 1 --2- 172.21.15.55:0/3237270936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ae806c570 0x7f9ae806f7c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9ae806f200 tx=0x7f9ae0009bd0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.405 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.393+0000 7f9aece39700 1 -- 172.21.15.55:0/3237270936 shutdown_connections 2022-09-20T20:13:50.405 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.393+0000 7f9aece39700 1 --2- 172.21.15.55:0/3237270936 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ae806c570 0x7f9ae806f7c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.405 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.393+0000 7f9aece39700 1 --2- 172.21.15.55:0/3237270936 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae8158e00 0x7f9ae80cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.406 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.393+0000 7f9aece39700 1 --2- 172.21.15.55:0/3237270936 >> v2:172.21.15.8:3300/0 conn(0x7f9ae815c330 0x7f9ae806c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.406 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.393+0000 7f9aece39700 1 -- 172.21.15.55:0/3237270936 >> 172.21.15.55:0/3237270936 conn(0x7f9ae80ca9b0 msgr2=0x7f9ae80cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:50.406 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.393+0000 7f9aece39700 1 -- 172.21.15.55:0/3237270936 shutdown_connections 2022-09-20T20:13:50.406 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.393+0000 7f9aece39700 1 -- 172.21.15.55:0/3237270936 wait complete. 2022-09-20T20:13:50.407 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.394+0000 7f9aece39700 1 Processor -- start 2022-09-20T20:13:50.407 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.394+0000 7f9aece39700 1 -- start start 2022-09-20T20:13:50.407 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.395+0000 7f9aece39700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ae806c570 0x7f9ae81521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:50.407 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.395+0000 7f9aece39700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ae8158e00 0x7f9ae8151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:50.408 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.395+0000 7f9aece39700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae815c330 0x7f9ae80c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:50.408 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.395+0000 7f9aece39700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae80c47c0 con 0x7f9ae8158e00 2022-09-20T20:13:50.408 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.395+0000 7f9aece39700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae81538e0 con 0x7f9ae806c570 2022-09-20T20:13:50.408 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.395+0000 7f9aece39700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae8153bc0 con 0x7f9ae815c330 2022-09-20T20:13:50.409 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.395+0000 7f9ae6d9d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae815c330 0x7f9ae80c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:50.409 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.395+0000 7f9ae6d9d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae815c330 0x7f9ae80c4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:55076/0 (socket says 172.21.15.55:55076) 2022-09-20T20:13:50.409 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.395+0000 7f9ae5d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ae8158e00 0x7f9ae8151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:50.409 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.395+0000 7f9ae6d9d700 1 -- 172.21.15.55:0/1206097520 learned_addr learned my addr 172.21.15.55:0/1206097520 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-09-20T20:13:50.410 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.395+0000 7f9ae659c700 1 --2- 172.21.15.55:0/1206097520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ae806c570 0x7f9ae81521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:50.410 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.395+0000 7f9ae6d9d700 1 -- 172.21.15.55:0/1206097520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ae806c570 msgr2=0x7f9ae81521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:50.410 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.395+0000 7f9ae6d9d700 1 --2- 172.21.15.55:0/1206097520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ae806c570 0x7f9ae81521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.410 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.395+0000 7f9ae6d9d700 1 -- 172.21.15.55:0/1206097520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ae8158e00 msgr2=0x7f9ae8151b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:50.411 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.395+0000 7f9ae6d9d700 1 --2- 172.21.15.55:0/1206097520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ae8158e00 0x7f9ae8151b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.411 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.395+0000 7f9ae6d9d700 1 -- 172.21.15.55:0/1206097520 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad8009a70 con 0x7f9ae815c330 2022-09-20T20:13:50.411 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.395+0000 7f9ae5d9b700 1 --2- 172.21.15.55:0/1206097520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ae8158e00 0x7f9ae8151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:13:50.411 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.396+0000 7f9ae6d9d700 1 --2- 172.21.15.55:0/1206097520 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae815c330 0x7f9ae80c4280 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0009c10 tx=0x7f9ae0004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:50.411 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.396+0000 7f9adeffd700 1 -- 172.21.15.55:0/1206097520 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0004240 con 0x7f9ae815c330 2022-09-20T20:13:50.412 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.396+0000 7f9adeffd700 1 -- 172.21.15.55:0/1206097520 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae001f070 con 0x7f9ae815c330 2022-09-20T20:13:50.412 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.396+0000 7f9adeffd700 1 -- 172.21.15.55:0/1206097520 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae00045e0 con 0x7f9ae815c330 2022-09-20T20:13:50.412 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.396+0000 7f9aece39700 1 -- 172.21.15.55:0/1206097520 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae0009550 con 0x7f9ae815c330 2022-09-20T20:13:50.412 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.396+0000 7f9aece39700 1 -- 172.21.15.55:0/1206097520 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae8154180 con 0x7f9ae815c330 2022-09-20T20:13:50.413 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.396+0000 7f9adeffd700 1 -- 172.21.15.55:0/1206097520 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f9ae002a020 con 0x7f9ae815c330 2022-09-20T20:13:50.413 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.396+0000 7f9adeffd700 1 -- 172.21.15.55:0/1206097520 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f9ae001aab0 con 0x7f9ae815c330 2022-09-20T20:13:50.413 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.397+0000 7f9aece39700 1 -- 172.21.15.55:0/1206097520 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae8072380 con 0x7f9ae815c330 2022-09-20T20:13:50.414 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.399+0000 7f9adeffd700 1 -- 172.21.15.55:0/1206097520 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7f9ae0015020 con 0x7f9ae815c330 2022-09-20T20:13:50.495 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.494+0000 7f9aece39700 1 -- 172.21.15.55:0/1206097520 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e9fbcb44-5753-4b0f-9136-007a17bc8157", "id": 7} v 0) v1 -- 0x7f9ae80705f0 con 0x7f9ae815c330 2022-09-20T20:13:50.504 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.502+0000 7f9adeffd700 1 -- 172.21.15.55:0/1206097520 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e9fbcb44-5753-4b0f-9136-007a17bc8157", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9ae001ae20 con 0x7f9ae815c330 2022-09-20T20:13:50.504 INFO:teuthology.orchestra.run.smithi055.stdout:7 2022-09-20T20:13:50.505 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.503+0000 7f9aece39700 1 -- 172.21.15.55:0/1206097520 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae815c330 msgr2=0x7f9ae80c4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:50.506 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.503+0000 7f9aece39700 1 --2- 172.21.15.55:0/1206097520 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae815c330 0x7f9ae80c4280 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0009c10 tx=0x7f9ae0004750 comp rx=0 tx=0).stop 2022-09-20T20:13:50.506 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.503+0000 7f9aece39700 1 -- 172.21.15.55:0/1206097520 shutdown_connections 2022-09-20T20:13:50.506 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.503+0000 7f9aece39700 1 --2- 172.21.15.55:0/1206097520 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ae815c330 0x7f9ae80c4280 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.506 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.503+0000 7f9aece39700 1 --2- 172.21.15.55:0/1206097520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ae806c570 0x7f9ae81521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.507 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.503+0000 7f9aece39700 1 --2- 172.21.15.55:0/1206097520 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ae8158e00 0x7f9ae8151b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.507 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.503+0000 7f9aece39700 1 -- 172.21.15.55:0/1206097520 >> 172.21.15.55:0/1206097520 conn(0x7f9ae80ca9b0 msgr2=0x7f9ae806f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:50.507 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.504+0000 7f9aece39700 1 -- 172.21.15.55:0/1206097520 shutdown_connections 2022-09-20T20:13:50.507 INFO:teuthology.orchestra.run.smithi055.stderr:2022-09-20T20:13:50.504+0000 7f9aece39700 1 -- 172.21.15.55:0/1206097520 wait complete. 2022-09-20T20:13:50.517 INFO:tasks.ceph.osd.0:Restarting daemon 2022-09-20T20:13:50.517 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-09-20T20:13:50.519 INFO:tasks.ceph.osd.0:Started 2022-09-20T20:13:50.520 INFO:tasks.ceph.osd.1:Restarting daemon 2022-09-20T20:13:50.520 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-09-20T20:13:50.523 INFO:tasks.ceph.osd.1:Started 2022-09-20T20:13:50.523 INFO:tasks.ceph.osd.2:Restarting daemon 2022-09-20T20:13:50.523 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-09-20T20:13:50.526 INFO:tasks.ceph.osd.2:Started 2022-09-20T20:13:50.526 INFO:tasks.ceph.osd.3:Restarting daemon 2022-09-20T20:13:50.526 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-09-20T20:13:50.529 INFO:tasks.ceph.osd.3:Started 2022-09-20T20:13:50.529 INFO:tasks.ceph.osd.4:Restarting daemon 2022-09-20T20:13:50.530 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2022-09-20T20:13:50.532 INFO:tasks.ceph.osd.4:Started 2022-09-20T20:13:50.532 INFO:tasks.ceph.osd.5:Restarting daemon 2022-09-20T20:13:50.533 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2022-09-20T20:13:50.535 INFO:tasks.ceph.osd.5:Started 2022-09-20T20:13:50.535 INFO:tasks.ceph.osd.6:Restarting daemon 2022-09-20T20:13:50.536 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2022-09-20T20:13:50.538 INFO:tasks.ceph.osd.6:Started 2022-09-20T20:13:50.538 INFO:tasks.ceph.osd.7:Restarting daemon 2022-09-20T20:13:50.539 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2022-09-20T20:13:50.541 INFO:tasks.ceph.osd.7:Started 2022-09-20T20:13:50.542 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-20T20:13:50.700 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.698+0000 7faec72a0700 1 Processor -- start 2022-09-20T20:13:50.701 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.698+0000 7faec72a0700 1 -- start start 2022-09-20T20:13:50.710 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.699+0000 7faec72a0700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faec006d950 0x7faec00cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:50.710 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.699+0000 7faec72a0700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec00cc0a0 con 0x7faec00aef10 2022-09-20T20:13:50.711 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.699+0000 7faec72a0700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faec015d130 con 0x7faec0159510 2022-09-20T20:13:50.711 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.699+0000 7faec72a0700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faec01598e0 con 0x7faec006d950 2022-09-20T20:13:50.712 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.699+0000 7faec483b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7faec006d950 0x7faec00cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:50.712 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.699+0000 7faec583d700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7faec00aef10 0x7faec00cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40806/0 (socket says 172.21.15.8:40806) 2022-09-20T20:13:50.712 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.699+0000 7faec583d700 1 -- 172.21.15.8:0/3957351734 learned_addr learned my addr 172.21.15.8:0/3957351734 (peer_addr_for_me v1:172.21.15.8:0/0) 2022-09-20T20:13:50.713 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.699+0000 7faec483b700 1 -- 172.21.15.8:0/3957351734 >> v1:172.21.15.55:6789/0 conn(0x7faec0159510 legacy=0x7faec006d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:50.713 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.699+0000 7faec483b700 1 -- 172.21.15.8:0/3957351734 >> v1:172.21.15.8:6789/0 conn(0x7faec00aef10 legacy=0x7faec00cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.699+0000 7faeaffff700 1 -- 172.21.15.8:0/3957351734 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099203240 0 0) 0x7faec00cc0a0 con 0x7faec00aef10 2022-09-20T20:13:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.699+0000 7faec483b700 1 -- 172.21.15.8:0/3957351734 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec015d3d0 con 0x7faec006d950 2022-09-20T20:13:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.700+0000 7faec483b700 1 --2- 172.21.15.8:0/3957351734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faec006d950 0x7faec00cd660 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009840 tx=0x7faeb0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9973e8eaaf812e server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.700+0000 7faeaffff700 1 -- 172.21.15.8:0/3957351734 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb0011830 con 0x7faec006d950 2022-09-20T20:13:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.700+0000 7faeaffff700 1 -- 172.21.15.8:0/3957351734 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb0011990 con 0x7faec006d950 2022-09-20T20:13:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.700+0000 7faeaffff700 1 -- 172.21.15.8:0/3957351734 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb0011d20 con 0x7faec006d950 2022-09-20T20:13:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.700+0000 7faec72a0700 1 -- 172.21.15.8:0/3957351734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faec006d950 msgr2=0x7faec00cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:50.717 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.700+0000 7faec72a0700 1 --2- 172.21.15.8:0/3957351734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faec006d950 0x7faec00cd660 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009840 tx=0x7faeb0009b50 comp rx=0 tx=0).stop 2022-09-20T20:13:50.717 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.700+0000 7faec72a0700 1 -- 172.21.15.8:0/3957351734 shutdown_connections 2022-09-20T20:13:50.718 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.700+0000 7faec72a0700 1 --2- 172.21.15.8:0/3957351734 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faec006d950 0x7faec00cd660 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.718 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.700+0000 7faec72a0700 1 -- 172.21.15.8:0/3957351734 >> 172.21.15.8:0/3957351734 conn(0x7faec00cf900 msgr2=0x7faec00cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:50.719 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.701+0000 7faec72a0700 1 -- 172.21.15.8:0/3957351734 shutdown_connections 2022-09-20T20:13:50.719 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.701+0000 7faec72a0700 1 -- 172.21.15.8:0/3957351734 wait complete. 2022-09-20T20:13:50.720 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.702+0000 7faec72a0700 1 Processor -- start 2022-09-20T20:13:50.720 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.702+0000 7faec72a0700 1 -- start start 2022-09-20T20:13:50.720 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.703+0000 7faec72a0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faec006d950 0x7faec00af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:50.721 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.703+0000 7faec72a0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faec00aef10 0x7faec015c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:50.721 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.703+0000 7faec72a0700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faec0159510 0x7faec00b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:50.722 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.703+0000 7faec72a0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec015c8e0 con 0x7faec00aef10 2022-09-20T20:13:50.722 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.703+0000 7faec72a0700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec00b1bb0 con 0x7faec006d950 2022-09-20T20:13:50.723 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.703+0000 7faec72a0700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec00b1e50 con 0x7faec0159510 2022-09-20T20:13:50.723 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.703+0000 7faec483b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faec00aef10 0x7faec015c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:50.723 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.703+0000 7faec483b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faec00aef10 0x7faec015c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58012/0 (socket says 172.21.15.8:58012) 2022-09-20T20:13:50.724 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.703+0000 7faec483b700 1 -- 172.21.15.8:0/3166489332 learned_addr learned my addr 172.21.15.8:0/3166489332 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:13:50.724 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.703+0000 7faec503c700 1 --2- 172.21.15.8:0/3166489332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faec006d950 0x7faec00af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:50.724 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.703+0000 7faec583d700 1 --2- 172.21.15.8:0/3166489332 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faec0159510 0x7faec00b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:50.725 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.704+0000 7faec483b700 1 -- 172.21.15.8:0/3166489332 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faec0159510 msgr2=0x7faec00b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:50.725 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.704+0000 7faec483b700 1 --2- 172.21.15.8:0/3166489332 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faec0159510 0x7faec00b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.725 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.704+0000 7faec483b700 1 -- 172.21.15.8:0/3166489332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faec006d950 msgr2=0x7faec00af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:50.726 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.704+0000 7faec483b700 1 --2- 172.21.15.8:0/3166489332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faec006d950 0x7faec00af360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.726 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.704+0000 7faec483b700 1 -- 172.21.15.8:0/3166489332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb00094a0 con 0x7faec00aef10 2022-09-20T20:13:50.727 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.704+0000 7faec483b700 1 --2- 172.21.15.8:0/3166489332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faec00aef10 0x7faec015c3a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faeb00090b0 tx=0x7faeb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:50.727 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.704+0000 7faeadffb700 1 -- 172.21.15.8:0/3166489332 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb001a7e0 con 0x7faec00aef10 2022-09-20T20:13:50.727 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.704+0000 7faeadffb700 1 -- 172.21.15.8:0/3166489332 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeb001a940 con 0x7faec00aef10 2022-09-20T20:13:50.728 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.704+0000 7faeadffb700 1 -- 172.21.15.8:0/3166489332 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb001acb0 con 0x7faec00aef10 2022-09-20T20:13:50.728 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.704+0000 7faec72a0700 1 -- 172.21.15.8:0/3166489332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec00b2130 con 0x7faec00aef10 2022-09-20T20:13:50.729 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.704+0000 7faec72a0700 1 -- 172.21.15.8:0/3166489332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec00af940 con 0x7faec00aef10 2022-09-20T20:13:50.729 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.704+0000 7faeadffb700 1 -- 172.21.15.8:0/3166489332 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7faeb000f050 con 0x7faec00aef10 2022-09-20T20:13:50.729 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.704+0000 7faeadffb700 1 -- 172.21.15.8:0/3166489332 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7faeb001ae10 con 0x7faec00aef10 2022-09-20T20:13:50.730 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.705+0000 7faec72a0700 1 -- 172.21.15.8:0/3166489332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec0159eb0 con 0x7faec00aef10 2022-09-20T20:13:50.730 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.707+0000 7faeadffb700 1 -- 172.21.15.8:0/3166489332 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7faec0159eb0 con 0x7faec00aef10 2022-09-20T20:13:50.780 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.778+0000 7faec72a0700 1 -- 172.21.15.8:0/3166489332 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faec0072c60 con 0x7faec00aef10 2022-09-20T20:13:50.781 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.778+0000 7faeadffb700 1 -- 172.21.15.8:0/3166489332 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7faeb0032060 con 0x7faec00aef10 2022-09-20T20:13:50.781 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:13:50.782 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":10,"fsid":"e2fce34f-6561-47ef-8379-911f2b368662","created":"2022-09-20T20:13:47.969272+0000","modified":"2022-09-20T20:13:50.496167+0000","last_up_change":"0.000000","last_in_change":"2022-09-20T20:13:50.496167+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"bd449a06-0637-42f4-9257-e0de045c499e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"db347f63-385a-4b18-85be-65594acb61a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"296cfab0-d996-45d6-bef0-69c311817ffa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"77dc730e-ac38-4ac5-b821-53bfe07a7bc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bbb00f2b-07be-4844-bcce-b60c4c693a0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dad61efb-3c40-4377-ba3d-df1ea6996dec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6b9de588-7ec2-4466-a4a8-561d80a92f5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e9fbcb44-5753-4b0f-9136-007a17bc8157","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-20T20:13:50.784 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.779+0000 7faec72a0700 1 -- 172.21.15.8:0/3166489332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faec00aef10 msgr2=0x7faec015c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:50.785 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.779+0000 7faec72a0700 1 --2- 172.21.15.8:0/3166489332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faec00aef10 0x7faec015c3a0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faeb00090b0 tx=0x7faeb0004750 comp rx=0 tx=0).stop 2022-09-20T20:13:50.785 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.779+0000 7faec72a0700 1 -- 172.21.15.8:0/3166489332 shutdown_connections 2022-09-20T20:13:50.786 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.779+0000 7faec72a0700 1 --2- 172.21.15.8:0/3166489332 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7faec0159510 0x7faec00b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.786 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.779+0000 7faec72a0700 1 --2- 172.21.15.8:0/3166489332 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faec006d950 0x7faec00af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.786 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.779+0000 7faec72a0700 1 --2- 172.21.15.8:0/3166489332 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7faec00aef10 0x7faec015c3a0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:50.786 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.779+0000 7faec72a0700 1 -- 172.21.15.8:0/3166489332 >> 172.21.15.8:0/3166489332 conn(0x7faec00cf900 msgr2=0x7faec0154040 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:50.787 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.779+0000 7faec72a0700 1 -- 172.21.15.8:0/3166489332 shutdown_connections 2022-09-20T20:13:50.787 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:50.779+0000 7faec72a0700 1 -- 172.21.15.8:0/3166489332 wait complete. 2022-09-20T20:13:50.793 INFO:tasks.ceph.ceph_manager.ceph:[] 2022-09-20T20:13:50.793 INFO:tasks.ceph:Waiting for OSDs to come up 2022-09-20T20:13:50.939 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:50.938+0000 7f393c7f0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-09-20T20:13:51.003 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:51.002+0000 7fd6420df200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-09-20T20:13:51.134 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:51.132+0000 7f393c7f0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-09-20T20:13:51.137 INFO:tasks.ceph.osd.2.smithi008.stderr:2022-09-20T20:13:51.136+0000 7fbe9d0125c0 -1 Falling back to public interface 2022-09-20T20:13:51.143 INFO:tasks.ceph.osd.6.smithi055.stderr:2022-09-20T20:13:51.142+0000 7fd8f293f5c0 -1 Falling back to public interface 2022-09-20T20:13:51.145 INFO:tasks.ceph.osd.1.smithi008.stderr:2022-09-20T20:13:51.144+0000 7fc0b1aae5c0 -1 Falling back to public interface 2022-09-20T20:13:51.147 INFO:tasks.ceph.osd.7.smithi055.stderr:2022-09-20T20:13:51.146+0000 7f658acaf5c0 -1 Falling back to public interface 2022-09-20T20:13:51.161 INFO:tasks.ceph.osd.0.smithi008.stderr:2022-09-20T20:13:51.160+0000 7f923041e5c0 -1 Falling back to public interface 2022-09-20T20:13:51.163 INFO:tasks.ceph.osd.4.smithi055.stderr:2022-09-20T20:13:51.162+0000 7f92c71775c0 -1 Falling back to public interface 2022-09-20T20:13:51.166 INFO:tasks.ceph.osd.3.smithi008.stderr:2022-09-20T20:13:51.164+0000 7fc5399d95c0 -1 Falling back to public interface 2022-09-20T20:13:51.168 INFO:tasks.ceph.osd.5.smithi055.stderr:2022-09-20T20:13:51.167+0000 7f0fe1e765c0 -1 Falling back to public interface 2022-09-20T20:13:51.203 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:51.202+0000 7fd6420df200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-09-20T20:13:51.280 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:51.278+0000 7f393c7f0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-09-20T20:13:51.345 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:51.344+0000 7fd6420df200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-09-20T20:13:51.444 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:51.443+0000 7f393c7f0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-09-20T20:13:51.511 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:51.510+0000 7fd6420df200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-09-20T20:13:51.581 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:51.579+0000 7f393c7f0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-09-20T20:13:51.599 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-09-20T20:13:51.650 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:51.649+0000 7fd6420df200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-09-20T20:13:51.715 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.713+0000 7f4e11563700 1 Processor -- start 2022-09-20T20:13:51.715 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.713+0000 7f4e11563700 1 -- start start 2022-09-20T20:13:51.719 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.714+0000 7f4e11563700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e0c159260 0x7f4e0c0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:51.719 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.714+0000 7f4e11563700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4e0c0b1970 0x7f4e0c0cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:51.719 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.714+0000 7f4e11563700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0c0ceb00 con 0x7f4e0c0cb800 2022-09-20T20:13:51.719 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.714+0000 7f4e11563700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e0c159630 con 0x7f4e0c0b1970 2022-09-20T20:13:51.720 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.714+0000 7f4e11563700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c0cdef0 con 0x7f4e0c159260 2022-09-20T20:13:51.720 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.714+0000 7f4e0a7fc700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f4e0c0cb800 0x7f4e0c0b1260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:40816/0 (socket says 172.21.15.8:40816) 2022-09-20T20:13:51.720 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.714+0000 7f4e0a7fc700 1 -- 172.21.15.8:0/1050682424 learned_addr learned my addr 172.21.15.8:0/1050682424 (peer_addr_for_me v1:172.21.15.8:0/0) 2022-09-20T20:13:51.720 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.714+0000 7f4e0b7fe700 1 --2- 172.21.15.8:0/1050682424 >> v2:172.21.15.55:3300/0 conn(0x7f4e0c0b1970 0x7f4e0c0cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:51.721 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.714+0000 7f4e0affd700 1 --2- 172.21.15.8:0/1050682424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e0c159260 0x7f4e0c0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:51.721 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.715+0000 7f4e09ffb700 1 -- 172.21.15.8:0/1050682424 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535578500 0 0) 0x7f4e0c0ceb00 con 0x7f4e0c0cb800 2022-09-20T20:13:51.721 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.715+0000 7f4e09ffb700 1 -- 172.21.15.8:0/1050682424 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4df80035b0 con 0x7f4e0c0cb800 2022-09-20T20:13:51.721 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.715+0000 7f4e0affd700 1 -- 172.21.15.8:0/1050682424 >> v2:172.21.15.55:3300/0 conn(0x7f4e0c0b1970 msgr2=0x7f4e0c0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:13:51.722 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.715+0000 7f4e0affd700 1 --2- 172.21.15.8:0/1050682424 >> v2:172.21.15.55:3300/0 conn(0x7f4e0c0b1970 0x7f4e0c0cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:51.722 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.715+0000 7f4e0affd700 1 -- 172.21.15.8:0/1050682424 >> v1:172.21.15.8:6789/0 conn(0x7f4e0c0cb800 legacy=0x7f4e0c0b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:51.722 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.715+0000 7f4e0affd700 1 -- 172.21.15.8:0/1050682424 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0c0ce1d0 con 0x7f4e0c159260 2022-09-20T20:13:51.722 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.715+0000 7f4e0b7fe700 1 --2- 172.21.15.8:0/1050682424 >> v2:172.21.15.55:3300/0 conn(0x7f4e0c0b1970 0x7f4e0c0cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:13:51.722 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.715+0000 7f4e0affd700 1 --2- 172.21.15.8:0/1050682424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e0c159260 0x7f4e0c0cef90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009840 tx=0x7f4dfc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af5e78f8093aae0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:51.723 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.715+0000 7f4e09ffb700 1 -- 172.21.15.8:0/1050682424 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc011830 con 0x7f4e0c159260 2022-09-20T20:13:51.723 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.715+0000 7f4e09ffb700 1 -- 172.21.15.8:0/1050682424 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dfc011990 con 0x7f4e0c159260 2022-09-20T20:13:51.723 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.715+0000 7f4e09ffb700 1 -- 172.21.15.8:0/1050682424 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc011d20 con 0x7f4e0c159260 2022-09-20T20:13:51.723 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.716+0000 7f4e11563700 1 -- 172.21.15.8:0/1050682424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e0c159260 msgr2=0x7f4e0c0cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:51.724 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.716+0000 7f4e11563700 1 --2- 172.21.15.8:0/1050682424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e0c159260 0x7f4e0c0cef90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009840 tx=0x7f4dfc009b50 comp rx=0 tx=0).stop 2022-09-20T20:13:51.724 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.716+0000 7f4e11563700 1 -- 172.21.15.8:0/1050682424 shutdown_connections 2022-09-20T20:13:51.724 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.716+0000 7f4e11563700 1 --2- 172.21.15.8:0/1050682424 >> v2:172.21.15.55:3300/0 conn(0x7f4e0c0b1970 0x7f4e0c0cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:51.724 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.716+0000 7f4e11563700 1 --2- 172.21.15.8:0/1050682424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e0c159260 0x7f4e0c0cef90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:51.725 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.716+0000 7f4e11563700 1 -- 172.21.15.8:0/1050682424 >> 172.21.15.8:0/1050682424 conn(0x7f4e0c06ded0 msgr2=0x7f4e0c0cc260 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:51.725 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.716+0000 7f4e11563700 1 -- 172.21.15.8:0/1050682424 shutdown_connections 2022-09-20T20:13:51.725 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.716+0000 7f4e11563700 1 -- 172.21.15.8:0/1050682424 wait complete. 2022-09-20T20:13:51.725 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.717+0000 7f4e11563700 1 Processor -- start 2022-09-20T20:13:51.725 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.717+0000 7f4e11563700 1 -- start start 2022-09-20T20:13:51.728 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.718+0000 7f4e11563700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e0c0b1970 0x7f4e0c153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:51.729 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.718+0000 7f4e11563700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e0c0cb800 0x7f4e0c0c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:51.729 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.718+0000 7f4e11563700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e0c159260 0x7f4e0c0b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:51.729 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.718+0000 7f4e11563700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c0c6c70 con 0x7f4e0c0b1970 2022-09-20T20:13:51.729 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.718+0000 7f4e11563700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c0c8430 con 0x7f4e0c159260 2022-09-20T20:13:51.730 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.718+0000 7f4e11563700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0c0c8710 con 0x7f4e0c0cb800 2022-09-20T20:13:51.730 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.718+0000 7f4e0affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e0c0b1970 0x7f4e0c153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:51.730 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.718+0000 7f4e0affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e0c0b1970 0x7f4e0c153d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58022/0 (socket says 172.21.15.8:58022) 2022-09-20T20:13:51.730 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.718+0000 7f4e0affd700 1 -- 172.21.15.8:0/4246748955 learned_addr learned my addr 172.21.15.8:0/4246748955 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:13:51.731 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.718+0000 7f4e0a7fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e0c0cb800 0x7f4e0c0c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:51.731 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.718+0000 7f4e0b7fe700 1 --2- 172.21.15.8:0/4246748955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e0c159260 0x7f4e0c0b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:51.731 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.719+0000 7f4e0a7fc700 1 -- 172.21.15.8:0/4246748955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e0c159260 msgr2=0x7f4e0c0b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:51.731 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.719+0000 7f4e0a7fc700 1 --2- 172.21.15.8:0/4246748955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e0c159260 0x7f4e0c0b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:51.732 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.719+0000 7f4e0a7fc700 1 -- 172.21.15.8:0/4246748955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e0c0b1970 msgr2=0x7f4e0c153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:51.732 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.719+0000 7f4e0a7fc700 1 --2- 172.21.15.8:0/4246748955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e0c0b1970 0x7f4e0c153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:51.732 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.719+0000 7f4e0a7fc700 1 -- 172.21.15.8:0/4246748955 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e04009a70 con 0x7f4e0c0cb800 2022-09-20T20:13:51.732 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.719+0000 7f4e0affd700 1 --2- 172.21.15.8:0/4246748955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e0c0b1970 0x7f4e0c153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:13:51.733 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.719+0000 7f4e0a7fc700 1 --2- 172.21.15.8:0/4246748955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e0c0cb800 0x7f4e0c0c94d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000c490 tx=0x7f4e0000c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:51.733 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.719+0000 7f4df37fe700 1 -- 172.21.15.8:0/4246748955 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00005d70 con 0x7f4e0c0cb800 2022-09-20T20:13:51.733 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.719+0000 7f4df37fe700 1 -- 172.21.15.8:0/4246748955 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e000070d0 con 0x7f4e0c0cb800 2022-09-20T20:13:51.733 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.719+0000 7f4e11563700 1 -- 172.21.15.8:0/4246748955 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dfc0094a0 con 0x7f4e0c0cb800 2022-09-20T20:13:51.733 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.719+0000 7f4df37fe700 1 -- 172.21.15.8:0/4246748955 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00007440 con 0x7f4e0c0cb800 2022-09-20T20:13:51.734 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.719+0000 7f4e11563700 1 -- 172.21.15.8:0/4246748955 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0c0c8cd0 con 0x7f4e0c0cb800 2022-09-20T20:13:51.734 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.719+0000 7f4df37fe700 1 -- 172.21.15.8:0/4246748955 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f4e00019030 con 0x7f4e0c0cb800 2022-09-20T20:13:51.734 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.719+0000 7f4df37fe700 1 -- 172.21.15.8:0/4246748955 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f4e00012ad0 con 0x7f4e0c0cb800 2022-09-20T20:13:51.734 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.720+0000 7f4e11563700 1 -- 172.21.15.8:0/4246748955 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0c072ca0 con 0x7f4e0c0cb800 2022-09-20T20:13:51.735 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.722+0000 7f4df37fe700 1 -- 172.21.15.8:0/4246748955 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7f4e00017070 con 0x7f4e0c0cb800 2022-09-20T20:13:51.795 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.793+0000 7f4e11563700 1 -- 172.21.15.8:0/4246748955 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e0c0ce4b0 con 0x7f4e0c0cb800 2022-09-20T20:13:51.796 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.794+0000 7f4df37fe700 1 -- 172.21.15.8:0/4246748955 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f4e00012400 con 0x7f4e0c0cb800 2022-09-20T20:13:51.796 INFO:teuthology.misc.health.smithi008.stdout: 2022-09-20T20:13:51.796 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":10,"fsid":"e2fce34f-6561-47ef-8379-911f2b368662","created":"2022-09-20T20:13:47.969272+0000","modified":"2022-09-20T20:13:50.496167+0000","last_up_change":"0.000000","last_in_change":"2022-09-20T20:13:50.496167+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"bd449a06-0637-42f4-9257-e0de045c499e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"db347f63-385a-4b18-85be-65594acb61a9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"296cfab0-d996-45d6-bef0-69c311817ffa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"77dc730e-ac38-4ac5-b821-53bfe07a7bc1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"bbb00f2b-07be-4844-bcce-b60c4c693a0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"dad61efb-3c40-4377-ba3d-df1ea6996dec","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6b9de588-7ec2-4466-a4a8-561d80a92f5e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e9fbcb44-5753-4b0f-9136-007a17bc8157","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-20T20:13:51.798 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.795+0000 7f4e11563700 1 -- 172.21.15.8:0/4246748955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e0c0cb800 msgr2=0x7f4e0c0c94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:51.798 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.795+0000 7f4e11563700 1 --2- 172.21.15.8:0/4246748955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e0c0cb800 0x7f4e0c0c94d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000c490 tx=0x7f4e0000c7a0 comp rx=0 tx=0).stop 2022-09-20T20:13:51.798 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.795+0000 7f4e11563700 1 -- 172.21.15.8:0/4246748955 shutdown_connections 2022-09-20T20:13:51.799 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.795+0000 7f4e11563700 1 --2- 172.21.15.8:0/4246748955 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e0c0b1970 0x7f4e0c153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:51.799 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.795+0000 7f4e11563700 1 --2- 172.21.15.8:0/4246748955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4e0c159260 0x7f4e0c0b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:51.799 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.795+0000 7f4e11563700 1 --2- 172.21.15.8:0/4246748955 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4e0c0cb800 0x7f4e0c0c94d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:51.799 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.795+0000 7f4e11563700 1 -- 172.21.15.8:0/4246748955 >> 172.21.15.8:0/4246748955 conn(0x7f4e0c06ded0 msgr2=0x7f4e0c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:51.799 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.795+0000 7f4e11563700 1 -- 172.21.15.8:0/4246748955 shutdown_connections 2022-09-20T20:13:51.800 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:51.795+0000 7f4e11563700 1 -- 172.21.15.8:0/4246748955 wait complete. 2022-09-20T20:13:51.809 DEBUG:teuthology.misc:0 of 8 OSDs are up 2022-09-20T20:13:51.948 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:51.946+0000 7f393c7f0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-09-20T20:13:52.017 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:52.015+0000 7fd6420df200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-09-20T20:13:52.106 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:52.104+0000 7f393c7f0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-09-20T20:13:52.175 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:52.174+0000 7fd6420df200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-09-20T20:13:52.225 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:52.224+0000 7f393c7f0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-09-20T20:13:52.295 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:52.294+0000 7fd6420df200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-09-20T20:13:52.376 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:52.374+0000 7f393c7f0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-09-20T20:13:52.445 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:52.444+0000 7fd6420df200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-09-20T20:13:52.477 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:52.476+0000 7f393c7f0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-09-20T20:13:52.547 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:52.546+0000 7fd6420df200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-09-20T20:13:52.845 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:52.844+0000 7f393c7f0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-09-20T20:13:52.916 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:52.914+0000 7fd6420df200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-09-20T20:13:53.449 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:53.447+0000 7f393c7f0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-09-20T20:13:53.526 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-09-20T20:13:53.524+0000 7fd6420df200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-09-20T20:13:54.473 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:54.471+0000 7f38f4dc5700 -1 mgr.server handle_report got status from non-daemon mon.c 2022-09-20T20:13:54.473 INFO:tasks.ceph.mgr.y.smithi008.stderr:2022-09-20T20:13:54.471+0000 7f38f4dc5700 -1 mgr.server handle_report got status from non-daemon mon.b 2022-09-20T20:13:54.637 INFO:tasks.ceph.osd.6.smithi055.stderr:2022-09-20T20:13:54.635+0000 7fd8f293f5c0 -1 osd.6 0 log_to_monitors true 2022-09-20T20:13:54.642 INFO:tasks.ceph.osd.2.smithi008.stderr:2022-09-20T20:13:54.640+0000 7fbe9d0125c0 -1 osd.2 0 log_to_monitors true 2022-09-20T20:13:54.668 INFO:tasks.ceph.osd.1.smithi008.stderr:2022-09-20T20:13:54.666+0000 7fc0b1aae5c0 -1 osd.1 0 log_to_monitors true 2022-09-20T20:13:54.687 INFO:tasks.ceph.osd.5.smithi055.stderr:2022-09-20T20:13:54.685+0000 7f0fe1e765c0 -1 osd.5 0 log_to_monitors true 2022-09-20T20:13:54.696 INFO:tasks.ceph.osd.0.smithi008.stderr:2022-09-20T20:13:54.694+0000 7f923041e5c0 -1 osd.0 0 log_to_monitors true 2022-09-20T20:13:54.697 INFO:tasks.ceph.osd.3.smithi008.stderr:2022-09-20T20:13:54.696+0000 7fc5399d95c0 -1 osd.3 0 log_to_monitors true 2022-09-20T20:13:54.712 INFO:tasks.ceph.osd.4.smithi055.stderr:2022-09-20T20:13:54.711+0000 7f92c71775c0 -1 osd.4 0 log_to_monitors true 2022-09-20T20:13:54.713 INFO:tasks.ceph.osd.7.smithi055.stderr:2022-09-20T20:13:54.711+0000 7f658acaf5c0 -1 osd.7 0 log_to_monitors true 2022-09-20T20:13:57.798 INFO:tasks.ceph.osd.0.smithi008.stderr:2022-09-20T20:13:57.795+0000 7f92241db700 -1 osd.0 0 waiting for initial osdmap 2022-09-20T20:13:57.801 INFO:tasks.ceph.osd.1.smithi008.stderr:2022-09-20T20:13:57.800+0000 7fc0a586b700 -1 osd.1 0 waiting for initial osdmap 2022-09-20T20:13:57.814 INFO:tasks.ceph.osd.0.smithi008.stderr:2022-09-20T20:13:57.813+0000 7f921c5b6700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-20T20:13:57.819 INFO:tasks.ceph.osd.1.smithi008.stderr:2022-09-20T20:13:57.818+0000 7fc09dc46700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-20T20:13:57.823 INFO:tasks.ceph.osd.2.smithi008.stderr:2022-09-20T20:13:57.822+0000 7fbe90dcf700 -1 osd.2 0 waiting for initial osdmap 2022-09-20T20:13:57.835 INFO:tasks.ceph.osd.2.smithi008.stderr:2022-09-20T20:13:57.834+0000 7fbe891aa700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-20T20:13:57.856 INFO:tasks.ceph.osd.3.smithi008.stderr:2022-09-20T20:13:57.855+0000 7fc52d796700 -1 osd.3 0 waiting for initial osdmap 2022-09-20T20:13:57.867 INFO:tasks.ceph.osd.3.smithi008.stderr:2022-09-20T20:13:57.866+0000 7fc525b71700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-20T20:13:58.341 INFO:tasks.ceph.osd.6.smithi055.stderr:2022-09-20T20:13:58.340+0000 7fd8e66fc700 -1 osd.6 0 waiting for initial osdmap 2022-09-20T20:13:58.350 INFO:tasks.ceph.osd.5.smithi055.stderr:2022-09-20T20:13:58.349+0000 7f0fd5c33700 -1 osd.5 0 waiting for initial osdmap 2022-09-20T20:13:58.360 INFO:tasks.ceph.osd.6.smithi055.stderr:2022-09-20T20:13:58.359+0000 7fd8dead7700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-20T20:13:58.361 INFO:tasks.ceph.osd.4.smithi055.stderr:2022-09-20T20:13:58.360+0000 7f92baf34700 -1 osd.4 0 waiting for initial osdmap 2022-09-20T20:13:58.362 INFO:tasks.ceph.osd.7.smithi055.stderr:2022-09-20T20:13:58.361+0000 7f657ea6c700 -1 osd.7 0 waiting for initial osdmap 2022-09-20T20:13:58.365 INFO:tasks.ceph.osd.5.smithi055.stderr:2022-09-20T20:13:58.364+0000 7f0fce00e700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-20T20:13:58.377 INFO:tasks.ceph.osd.4.smithi055.stderr:2022-09-20T20:13:58.376+0000 7f92b330f700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-20T20:13:58.377 INFO:tasks.ceph.osd.7.smithi055.stderr:2022-09-20T20:13:58.376+0000 7f6576e47700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-20T20:13:58.616 DEBUG:teuthology.orchestra.run.smithi008:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-09-20T20:13:58.745 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.744+0000 7f6334822700 1 Processor -- start 2022-09-20T20:13:58.746 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.744+0000 7f6334822700 1 -- start start 2022-09-20T20:13:58.748 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.745+0000 7f6334822700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f633015b2a0 0x7f63300d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:58.748 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.745+0000 7f6334822700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f633015eec0 0x7f633015f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:58.749 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.745+0000 7f6334822700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63300cf720 con 0x7f633015f880 2022-09-20T20:13:58.749 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.745+0000 7f6334822700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63300d2950 con 0x7f633015b2a0 2022-09-20T20:13:58.749 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.745+0000 7f6334822700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633015fd00 con 0x7f633015eec0 2022-09-20T20:13:58.749 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.745+0000 7f632e59c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f633015b2a0 0x7f63300d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:58.750 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.745+0000 7f632e59c700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f633015b2a0 0x7f63300d2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58126/0 (socket says 172.21.15.8:58126) 2022-09-20T20:13:58.750 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.745+0000 7f632e59c700 1 -- 172.21.15.8:0/477315508 learned_addr learned my addr 172.21.15.8:0/477315508 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:13:58.750 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.745+0000 7f632dd9b700 1 --2- 172.21.15.8:0/477315508 >> v2:172.21.15.55:3300/0 conn(0x7f633015eec0 0x7f633015f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:58.750 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.745+0000 7f632e59c700 1 -- 172.21.15.8:0/477315508 >> v2:172.21.15.55:3300/0 conn(0x7f633015eec0 msgr2=0x7f633015f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:13:58.750 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.745+0000 7f632e59c700 1 --2- 172.21.15.8:0/477315508 >> v2:172.21.15.55:3300/0 conn(0x7f633015eec0 0x7f633015f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:58.751 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.745+0000 7f632e59c700 1 -- 172.21.15.8:0/477315508 >> v1:172.21.15.55:6789/0 conn(0x7f633015f880 legacy=0x7f63300cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:58.751 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.745+0000 7f632e59c700 1 -- 172.21.15.8:0/477315508 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63300cc240 con 0x7f633015b2a0 2022-09-20T20:13:58.751 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.745+0000 7f632e59c700 1 --2- 172.21.15.8:0/477315508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633015b2a0 0x7f63300d2410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f63300b3650 tx=0x7f6320009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5820a94eb015bed5 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:58.752 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.745+0000 7f632d59a700 1 -- 172.21.15.8:0/477315508 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6320005e30 con 0x7f633015b2a0 2022-09-20T20:13:58.752 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.746+0000 7f632d59a700 1 -- 172.21.15.8:0/477315508 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6320004030 con 0x7f633015b2a0 2022-09-20T20:13:58.752 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.746+0000 7f632d59a700 1 -- 172.21.15.8:0/477315508 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63200043e0 con 0x7f633015b2a0 2022-09-20T20:13:58.752 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.746+0000 7f6334822700 1 -- 172.21.15.8:0/477315508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633015b2a0 msgr2=0x7f63300d2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:58.753 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.746+0000 7f6334822700 1 --2- 172.21.15.8:0/477315508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633015b2a0 0x7f63300d2410 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f63300b3650 tx=0x7f6320009bd0 comp rx=0 tx=0).stop 2022-09-20T20:13:58.753 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.746+0000 7f6334822700 1 -- 172.21.15.8:0/477315508 shutdown_connections 2022-09-20T20:13:58.753 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.746+0000 7f6334822700 1 --2- 172.21.15.8:0/477315508 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633015b2a0 0x7f63300d2410 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:58.753 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.746+0000 7f6334822700 1 --2- 172.21.15.8:0/477315508 >> v2:172.21.15.55:3300/0 conn(0x7f633015eec0 0x7f633015f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:58.753 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.746+0000 7f6334822700 1 -- 172.21.15.8:0/477315508 >> 172.21.15.8:0/477315508 conn(0x7f6330069f00 msgr2=0x7f633006a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:58.754 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.746+0000 7f6334822700 1 -- 172.21.15.8:0/477315508 shutdown_connections 2022-09-20T20:13:58.754 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.746+0000 7f6334822700 1 -- 172.21.15.8:0/477315508 wait complete. 2022-09-20T20:13:58.757 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.748+0000 7f6334822700 1 Processor -- start 2022-09-20T20:13:58.757 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.748+0000 7f6334822700 1 -- start start 2022-09-20T20:13:58.758 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.748+0000 7f6334822700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f633015b2a0 0x7f633015d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:58.758 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.748+0000 7f6334822700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f633015eec0 0x7f63300c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:58.758 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.748+0000 7f6334822700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633015f880 0x7f63300cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:58.758 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.748+0000 7f6334822700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633015bae0 con 0x7f633015f880 2022-09-20T20:13:58.758 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.748+0000 7f6334822700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633015bdc0 con 0x7f633015eec0 2022-09-20T20:13:58.759 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.748+0000 7f6334822700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633015c0a0 con 0x7f633015b2a0 2022-09-20T20:13:58.759 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.748+0000 7f632ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633015f880 0x7f63300cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:58.759 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.748+0000 7f632ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633015f880 0x7f63300cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58136/0 (socket says 172.21.15.8:58136) 2022-09-20T20:13:58.759 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.748+0000 7f632ed9d700 1 -- 172.21.15.8:0/3042203338 learned_addr learned my addr 172.21.15.8:0/3042203338 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:13:58.760 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.749+0000 7f632dd9b700 1 --2- 172.21.15.8:0/3042203338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f633015eec0 0x7f63300c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:58.760 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.749+0000 7f632e59c700 1 --2- 172.21.15.8:0/3042203338 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f633015b2a0 0x7f633015d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:58.760 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.749+0000 7f632ed9d700 1 -- 172.21.15.8:0/3042203338 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f633015b2a0 msgr2=0x7f633015d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:58.760 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.749+0000 7f632ed9d700 1 --2- 172.21.15.8:0/3042203338 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f633015b2a0 0x7f633015d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:58.760 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.749+0000 7f632ed9d700 1 -- 172.21.15.8:0/3042203338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f633015eec0 msgr2=0x7f63300c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:58.761 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.749+0000 7f632ed9d700 1 --2- 172.21.15.8:0/3042203338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f633015eec0 0x7f63300c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:58.761 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.749+0000 7f632ed9d700 1 -- 172.21.15.8:0/3042203338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6320009500 con 0x7f633015f880 2022-09-20T20:13:58.761 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.749+0000 7f632ed9d700 1 --2- 172.21.15.8:0/3042203338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633015f880 0x7f63300cb5a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f632800cc50 tx=0x7f632800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:58.761 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.749+0000 7f631effd700 1 -- 172.21.15.8:0/3042203338 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f632800ad80 con 0x7f633015f880 2022-09-20T20:13:58.762 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.749+0000 7f631effd700 1 -- 172.21.15.8:0/3042203338 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f632800ce50 con 0x7f633015f880 2022-09-20T20:13:58.762 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.749+0000 7f6334822700 1 -- 172.21.15.8:0/3042203338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633015c380 con 0x7f633015f880 2022-09-20T20:13:58.762 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.749+0000 7f631effd700 1 -- 172.21.15.8:0/3042203338 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6328003c40 con 0x7f633015f880 2022-09-20T20:13:58.763 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.749+0000 7f6334822700 1 -- 172.21.15.8:0/3042203338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633015db90 con 0x7f633015f880 2022-09-20T20:13:58.763 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.750+0000 7f6334822700 1 -- 172.21.15.8:0/3042203338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63300b7970 con 0x7f633015f880 2022-09-20T20:13:58.763 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.750+0000 7f631effd700 1 -- 172.21.15.8:0/3042203338 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 83870+0+0 (secure 0 0 0) 0x7f6328010050 con 0x7f633015f880 2022-09-20T20:13:58.763 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.751+0000 7f631effd700 1 --2- 172.21.15.8:0/3042203338 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f630c065a00 0x7f630c067eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:58.764 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.751+0000 7f631effd700 1 -- 172.21.15.8:0/3042203338 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f6328081b10 con 0x7f633015f880 2022-09-20T20:13:58.764 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.751+0000 7f632e59c700 1 --2- 172.21.15.8:0/3042203338 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f630c065a00 0x7f630c067eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:58.764 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.751+0000 7f632e59c700 1 --2- 172.21.15.8:0/3042203338 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f630c065a00 0x7f630c067eb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6320009c10 tx=0x7f6320008070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:58.764 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.755+0000 7f631effd700 1 -- 172.21.15.8:0/3042203338 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7f6328050840 con 0x7f633015f880 2022-09-20T20:13:58.956 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.954+0000 7f6334822700 1 -- 172.21.15.8:0/3042203338 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6330072ca0 con 0x7f633015f880 2022-09-20T20:13:58.956 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.955+0000 7f631effd700 1 -- 172.21.15.8:0/3042203338 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10348 (secure 0 0 0) 0x7f6328053e60 con 0x7f633015f880 2022-09-20T20:13:58.957 INFO:teuthology.misc.health.smithi008.stdout: 2022-09-20T20:13:58.957 INFO:teuthology.misc.health.smithi008.stdout:{"epoch":13,"fsid":"e2fce34f-6561-47ef-8379-911f2b368662","created":"2022-09-20T20:13:47.969272+0000","modified":"2022-09-20T20:13:58.804121+0000","last_up_change":"2022-09-20T20:13:58.804121+0000","last_in_change":"2022-09-20T20:13:50.496167+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"bd449a06-0637-42f4-9257-e0de045c499e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":99877},{"type":"v1","addr":"172.21.15.8:6817","nonce":99877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":99877},{"type":"v1","addr":"172.21.15.8:6819","nonce":99877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":99877},{"type":"v1","addr":"172.21.15.8:6823","nonce":99877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":99877},{"type":"v1","addr":"172.21.15.8:6821","nonce":99877}]},"public_addr":"172.21.15.8:6817/99877","cluster_addr":"172.21.15.8:6819/99877","heartbeat_back_addr":"172.21.15.8:6823/99877","heartbeat_front_addr":"172.21.15.8:6821/99877","state":["exists","up"]},{"osd":1,"uuid":"db347f63-385a-4b18-85be-65594acb61a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":99876},{"type":"v1","addr":"172.21.15.8:6809","nonce":99876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":99876},{"type":"v1","addr":"172.21.15.8:6811","nonce":99876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":99876},{"type":"v1","addr":"172.21.15.8:6815","nonce":99876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":99876},{"type":"v1","addr":"172.21.15.8:6813","nonce":99876}]},"public_addr":"172.21.15.8:6809/99876","cluster_addr":"172.21.15.8:6811/99876","heartbeat_back_addr":"172.21.15.8:6815/99876","heartbeat_front_addr":"172.21.15.8:6813/99876","state":["exists","up"]},{"osd":2,"uuid":"296cfab0-d996-45d6-bef0-69c311817ffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":99875},{"type":"v1","addr":"172.21.15.8:6801","nonce":99875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":99875},{"type":"v1","addr":"172.21.15.8:6803","nonce":99875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":99875},{"type":"v1","addr":"172.21.15.8:6807","nonce":99875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":99875},{"type":"v1","addr":"172.21.15.8:6805","nonce":99875}]},"public_addr":"172.21.15.8:6801/99875","cluster_addr":"172.21.15.8:6803/99875","heartbeat_back_addr":"172.21.15.8:6807/99875","heartbeat_front_addr":"172.21.15.8:6805/99875","state":["exists","up"]},{"osd":3,"uuid":"77dc730e-ac38-4ac5-b821-53bfe07a7bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":99886},{"type":"v1","addr":"172.21.15.8:6825","nonce":99886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":99886},{"type":"v1","addr":"172.21.15.8:6827","nonce":99886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":99886},{"type":"v1","addr":"172.21.15.8:6831","nonce":99886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":99886},{"type":"v1","addr":"172.21.15.8:6829","nonce":99886}]},"public_addr":"172.21.15.8:6825/99886","cluster_addr":"172.21.15.8:6827/99886","heartbeat_back_addr":"172.21.15.8:6831/99886","heartbeat_front_addr":"172.21.15.8:6829/99886","state":["exists","up"]},{"osd":4,"uuid":"bbb00f2b-07be-4844-bcce-b60c4c693a0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":100137},{"type":"v1","addr":"172.21.15.55:6817","nonce":100137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":100137},{"type":"v1","addr":"172.21.15.55:6819","nonce":100137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":100137},{"type":"v1","addr":"172.21.15.55:6823","nonce":100137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":100137},{"type":"v1","addr":"172.21.15.55:6821","nonce":100137}]},"public_addr":"172.21.15.55:6817/100137","cluster_addr":"172.21.15.55:6819/100137","heartbeat_back_addr":"172.21.15.55:6823/100137","heartbeat_front_addr":"172.21.15.55:6821/100137","state":["exists","up"]},{"osd":5,"uuid":"dad61efb-3c40-4377-ba3d-df1ea6996dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":100136},{"type":"v1","addr":"172.21.15.55:6825","nonce":100136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":100136},{"type":"v1","addr":"172.21.15.55:6827","nonce":100136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":100136},{"type":"v1","addr":"172.21.15.55:6831","nonce":100136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":100136},{"type":"v1","addr":"172.21.15.55:6829","nonce":100136}]},"public_addr":"172.21.15.55:6825/100136","cluster_addr":"172.21.15.55:6827/100136","heartbeat_back_addr":"172.21.15.55:6831/100136","heartbeat_front_addr":"172.21.15.55:6829/100136","state":["exists","up"]},{"osd":6,"uuid":"6b9de588-7ec2-4466-a4a8-561d80a92f5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":100130},{"type":"v1","addr":"172.21.15.55:6801","nonce":100130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":100130},{"type":"v1","addr":"172.21.15.55:6803","nonce":100130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":100130},{"type":"v1","addr":"172.21.15.55:6807","nonce":100130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":100130},{"type":"v1","addr":"172.21.15.55:6805","nonce":100130}]},"public_addr":"172.21.15.55:6801/100130","cluster_addr":"172.21.15.55:6803/100130","heartbeat_back_addr":"172.21.15.55:6807/100130","heartbeat_front_addr":"172.21.15.55:6805/100130","state":["exists","up"]},{"osd":7,"uuid":"e9fbcb44-5753-4b0f-9136-007a17bc8157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":100131},{"type":"v1","addr":"172.21.15.55:6809","nonce":100131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":100131},{"type":"v1","addr":"172.21.15.55:6811","nonce":100131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":100131},{"type":"v1","addr":"172.21.15.55:6815","nonce":100131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":100131},{"type":"v1","addr":"172.21.15.55:6813","nonce":100131}]},"public_addr":"172.21.15.55:6809/100131","cluster_addr":"172.21.15.55:6811/100131","heartbeat_back_addr":"172.21.15.55:6815/100131","heartbeat_front_addr":"172.21.15.55:6813/100131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-20T20:13:58.959 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.957+0000 7f6334822700 1 -- 172.21.15.8:0/3042203338 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f630c065a00 msgr2=0x7f630c067eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:58.959 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.957+0000 7f6334822700 1 --2- 172.21.15.8:0/3042203338 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f630c065a00 0x7f630c067eb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6320009c10 tx=0x7f6320008070 comp rx=0 tx=0).stop 2022-09-20T20:13:58.959 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.957+0000 7f6334822700 1 -- 172.21.15.8:0/3042203338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633015f880 msgr2=0x7f63300cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:58.960 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.957+0000 7f6334822700 1 --2- 172.21.15.8:0/3042203338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633015f880 0x7f63300cb5a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f632800cc50 tx=0x7f632800a340 comp rx=0 tx=0).stop 2022-09-20T20:13:58.960 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.957+0000 7f6334822700 1 -- 172.21.15.8:0/3042203338 shutdown_connections 2022-09-20T20:13:58.960 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.957+0000 7f6334822700 1 --2- 172.21.15.8:0/3042203338 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f630c065a00 0x7f630c067eb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:58.960 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.957+0000 7f6334822700 1 --2- 172.21.15.8:0/3042203338 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f633015f880 0x7f63300cb5a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:58.960 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.957+0000 7f6334822700 1 --2- 172.21.15.8:0/3042203338 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f633015b2a0 0x7f633015d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:58.961 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.957+0000 7f6334822700 1 --2- 172.21.15.8:0/3042203338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f633015eec0 0x7f63300c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:58.961 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.957+0000 7f6334822700 1 -- 172.21.15.8:0/3042203338 >> 172.21.15.8:0/3042203338 conn(0x7f6330069f00 msgr2=0x7f63300cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:58.961 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.957+0000 7f6334822700 1 -- 172.21.15.8:0/3042203338 shutdown_connections 2022-09-20T20:13:58.961 INFO:teuthology.misc.health.smithi008.stderr:2022-09-20T20:13:58.957+0000 7f6334822700 1 -- 172.21.15.8:0/3042203338 wait complete. 2022-09-20T20:13:58.970 DEBUG:teuthology.misc:8 of 8 OSDs are up 2022-09-20T20:13:58.970 INFO:tasks.ceph:Creating RBD pool 2022-09-20T20:13:58.971 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph osd pool create rbd 8 2022-09-20T20:13:59.095 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.093+0000 7f93fb1e9700 1 Processor -- start 2022-09-20T20:13:59.095 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.093+0000 7f93fb1e9700 1 -- start start 2022-09-20T20:13:59.098 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.094+0000 7f93fb1e9700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40b04b0 0x7f93f4070610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:59.098 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.094+0000 7f93fb1e9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93f40b0de0 0x7f93f40cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.094+0000 7f93fb1e9700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f93f40cd930 0x7f93f4157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.094+0000 7f93fb1e9700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f406ca50 con 0x7f93f40cd930 2022-09-20T20:13:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.094+0000 7f93fb1e9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f406cf80 con 0x7f93f40b0de0 2022-09-20T20:13:59.099 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.094+0000 7f93fb1e9700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f40ccf60 con 0x7f93f40b04b0 2022-09-20T20:13:59.100 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.094+0000 7f93f9786700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f93f40cd930 0x7f93f4157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:59.100 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.094+0000 7f93f9786700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f93f40cd930 0x7f93f4157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58256/0 (socket says 172.21.15.8:58256) 2022-09-20T20:13:59.100 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.094+0000 7f93f9786700 1 -- 172.21.15.8:0/2088789523 learned_addr learned my addr 172.21.15.8:0/2088789523 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:13:59.100 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.094+0000 7f93f8f85700 1 --2- 172.21.15.8:0/2088789523 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40b04b0 0x7f93f4070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:59.101 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.094+0000 7f93f3fff700 1 --2- 172.21.15.8:0/2088789523 >> v2:172.21.15.55:3300/0 conn(0x7f93f40b0de0 0x7f93f40cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:59.101 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.094+0000 7f93f9786700 1 -- 172.21.15.8:0/2088789523 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40b04b0 msgr2=0x7f93f4070610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:13:59.101 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.094+0000 7f93f9786700 1 --2- 172.21.15.8:0/2088789523 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40b04b0 0x7f93f4070610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:59.101 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.094+0000 7f93f9786700 1 -- 172.21.15.8:0/2088789523 >> v2:172.21.15.55:3300/0 conn(0x7f93f40b0de0 msgr2=0x7f93f40cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:13:59.101 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.094+0000 7f93f9786700 1 --2- 172.21.15.8:0/2088789523 >> v2:172.21.15.55:3300/0 conn(0x7f93f40b0de0 0x7f93f40cd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:59.102 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.094+0000 7f93f9786700 1 -- 172.21.15.8:0/2088789523 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f40adc10 con 0x7f93f40cd930 2022-09-20T20:13:59.102 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.095+0000 7f93f9786700 1 --2- 172.21.15.8:0/2088789523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93f40cd930 0x7f93f4157da0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f93f406fe30 tx=0x7f93ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4edd5f76174c86 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:59.102 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.095+0000 7f93f37fe700 1 -- 172.21.15.8:0/2088789523 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec00bb10 con 0x7f93f40cd930 2022-09-20T20:13:59.102 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.095+0000 7f93f37fe700 1 -- 172.21.15.8:0/2088789523 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93ec00bc70 con 0x7f93f40cd930 2022-09-20T20:13:59.103 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.095+0000 7f93f37fe700 1 -- 172.21.15.8:0/2088789523 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93ec011460 con 0x7f93f40cd930 2022-09-20T20:13:59.103 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.095+0000 7f93fb1e9700 1 -- 172.21.15.8:0/2088789523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93f40cd930 msgr2=0x7f93f4157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:59.103 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.095+0000 7f93fb1e9700 1 --2- 172.21.15.8:0/2088789523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93f40cd930 0x7f93f4157da0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f93f406fe30 tx=0x7f93ec00b330 comp rx=0 tx=0).stop 2022-09-20T20:13:59.103 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.095+0000 7f93fb1e9700 1 -- 172.21.15.8:0/2088789523 shutdown_connections 2022-09-20T20:13:59.103 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.095+0000 7f93fb1e9700 1 --2- 172.21.15.8:0/2088789523 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93f40cd930 0x7f93f4157da0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:59.104 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.095+0000 7f93fb1e9700 1 --2- 172.21.15.8:0/2088789523 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40b04b0 0x7f93f4070610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:59.104 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.095+0000 7f93fb1e9700 1 --2- 172.21.15.8:0/2088789523 >> v2:172.21.15.55:3300/0 conn(0x7f93f40b0de0 0x7f93f40cd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:59.104 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.095+0000 7f93fb1e9700 1 -- 172.21.15.8:0/2088789523 >> 172.21.15.8:0/2088789523 conn(0x7f93f406e8c0 msgr2=0x7f93f406c220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:59.105 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.095+0000 7f93fb1e9700 1 -- 172.21.15.8:0/2088789523 shutdown_connections 2022-09-20T20:13:59.105 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.095+0000 7f93fb1e9700 1 -- 172.21.15.8:0/2088789523 wait complete. 2022-09-20T20:13:59.105 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.097+0000 7f93fb1e9700 1 Processor -- start 2022-09-20T20:13:59.105 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.097+0000 7f93fb1e9700 1 -- start start 2022-09-20T20:13:59.109 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.097+0000 7f93fb1e9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93f40b04b0 0x7f93f4150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:59.109 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.097+0000 7f93fb1e9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f40b0de0 0x7f93f4154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:59.109 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93fb1e9700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40cd930 0x7f93f40aa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:59.110 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93fb1e9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f41559c0 con 0x7f93f40b04b0 2022-09-20T20:13:59.110 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93fb1e9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f4151070 con 0x7f93f40b0de0 2022-09-20T20:13:59.110 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93fb1e9700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f4154db0 con 0x7f93f40cd930 2022-09-20T20:13:59.110 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93f8f85700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93f40b04b0 0x7f93f4150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:59.111 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93f8f85700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93f40b04b0 0x7f93f4150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58258/0 (socket says 172.21.15.8:58258) 2022-09-20T20:13:59.111 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93f8f85700 1 -- 172.21.15.8:0/2126852418 learned_addr learned my addr 172.21.15.8:0/2126852418 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:13:59.111 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93f3fff700 1 --2- 172.21.15.8:0/2126852418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f40b0de0 0x7f93f4154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:59.111 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93f9786700 1 --2- 172.21.15.8:0/2126852418 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40cd930 0x7f93f40aa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:59.112 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93f8f85700 1 -- 172.21.15.8:0/2126852418 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40cd930 msgr2=0x7f93f40aa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:59.112 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93f8f85700 1 --2- 172.21.15.8:0/2126852418 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40cd930 0x7f93f40aa8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:59.112 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93f8f85700 1 -- 172.21.15.8:0/2126852418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f40b0de0 msgr2=0x7f93f4154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:59.112 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93f8f85700 1 --2- 172.21.15.8:0/2126852418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f40b0de0 0x7f93f4154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:59.113 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93f8f85700 1 -- 172.21.15.8:0/2126852418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93ec009b30 con 0x7f93f40b04b0 2022-09-20T20:13:59.113 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93f8f85700 1 --2- 172.21.15.8:0/2126852418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93f40b04b0 0x7f93f4150b30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f93e800e930 tx=0x7f93e800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:59.113 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93f17fa700 1 -- 172.21.15.8:0/2126852418 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e8013680 con 0x7f93f40b04b0 2022-09-20T20:13:59.113 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93f17fa700 1 -- 172.21.15.8:0/2126852418 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e80137e0 con 0x7f93f40b04b0 2022-09-20T20:13:59.113 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93fb1e9700 1 -- 172.21.15.8:0/2126852418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f4155090 con 0x7f93f40b04b0 2022-09-20T20:13:59.114 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93f17fa700 1 -- 172.21.15.8:0/2126852418 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e8013b70 con 0x7f93f40b04b0 2022-09-20T20:13:59.114 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.098+0000 7f93fb1e9700 1 -- 172.21.15.8:0/2126852418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f4155650 con 0x7f93f40b04b0 2022-09-20T20:13:59.114 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.099+0000 7f93fb1e9700 1 -- 172.21.15.8:0/2126852418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f4072c60 con 0x7f93f40b04b0 2022-09-20T20:13:59.115 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.100+0000 7f93f17fa700 1 -- 172.21.15.8:0/2126852418 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 83870+0+0 (secure 0 0 0) 0x7f93e8019030 con 0x7f93f40b04b0 2022-09-20T20:13:59.115 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.100+0000 7f93f17fa700 1 --2- 172.21.15.8:0/2126852418 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f93dc065a00 0x7f93dc067eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:59.115 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.100+0000 7f93f17fa700 1 -- 172.21.15.8:0/2126852418 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f93e80821d0 con 0x7f93f40b04b0 2022-09-20T20:13:59.115 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.100+0000 7f93f3fff700 1 --2- 172.21.15.8:0/2126852418 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f93dc065a00 0x7f93dc067eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:59.116 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.100+0000 7f93f3fff700 1 --2- 172.21.15.8:0/2126852418 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f93dc065a00 0x7f93dc067eb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f93f40ad740 tx=0x7f93e0009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:59.116 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.104+0000 7f93f17fa700 1 -- 172.21.15.8:0/2126852418 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7f93e80506c0 con 0x7f93f40b04b0 2022-09-20T20:13:59.296 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.295+0000 7f93fb1e9700 1 -- 172.21.15.8:0/2126852418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f93f40b4740 con 0x7f93f40b04b0 2022-09-20T20:13:59.817 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.815+0000 7f93f17fa700 1 -- 172.21.15.8:0/2126852418 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f93e8053ce0 con 0x7f93f40b04b0 2022-09-20T20:13:59.820 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.818+0000 7f93fb1e9700 1 -- 172.21.15.8:0/2126852418 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f93dc065a00 msgr2=0x7f93dc067eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:59.820 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.818+0000 7f93fb1e9700 1 --2- 172.21.15.8:0/2126852418 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f93dc065a00 0x7f93dc067eb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f93f40ad740 tx=0x7f93e0009210 comp rx=0 tx=0).stop 2022-09-20T20:13:59.820 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.818+0000 7f93fb1e9700 1 -- 172.21.15.8:0/2126852418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93f40b04b0 msgr2=0x7f93f4150b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:59.820 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.818+0000 7f93fb1e9700 1 --2- 172.21.15.8:0/2126852418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93f40b04b0 0x7f93f4150b30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f93e800e930 tx=0x7f93e800ec40 comp rx=0 tx=0).stop 2022-09-20T20:13:59.821 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.818+0000 7f93fb1e9700 1 -- 172.21.15.8:0/2126852418 shutdown_connections 2022-09-20T20:13:59.821 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.818+0000 7f93fb1e9700 1 --2- 172.21.15.8:0/2126852418 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f93dc065a00 0x7f93dc067eb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:59.821 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.818+0000 7f93fb1e9700 1 --2- 172.21.15.8:0/2126852418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f93f40b04b0 0x7f93f4150b30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:59.821 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.818+0000 7f93fb1e9700 1 --2- 172.21.15.8:0/2126852418 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40cd930 0x7f93f40aa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:59.821 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.818+0000 7f93fb1e9700 1 --2- 172.21.15.8:0/2126852418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f40b0de0 0x7f93f4154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:59.822 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.818+0000 7f93fb1e9700 1 -- 172.21.15.8:0/2126852418 >> 172.21.15.8:0/2126852418 conn(0x7f93f406e8c0 msgr2=0x7f93f40cc210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:59.822 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.818+0000 7f93fb1e9700 1 -- 172.21.15.8:0/2126852418 shutdown_connections 2022-09-20T20:13:59.822 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.818+0000 7f93fb1e9700 1 -- 172.21.15.8:0/2126852418 wait complete. 2022-09-20T20:13:59.823 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'rbd' created 2022-09-20T20:13:59.834 DEBUG:teuthology.orchestra.run.smithi008:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2022-09-20T20:13:59.963 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.962+0000 7f342cd90700 1 Processor -- start 2022-09-20T20:13:59.964 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.962+0000 7f342cd90700 1 -- start start 2022-09-20T20:13:59.967 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.963+0000 7f342cd90700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34280c84f0 0x7f34280cd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:59.967 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.963+0000 7f342cd90700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342806f860 con 0x7f342815b370 2022-09-20T20:13:59.967 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.963+0000 7f342cd90700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f342815b740 con 0x7f3428069230 2022-09-20T20:13:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.963+0000 7f342cd90700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342806fb00 con 0x7f34280c84f0 2022-09-20T20:13:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.963+0000 7f342659c700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f342815b370 0x7f3428068b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41098/0 (socket says 172.21.15.8:41098) 2022-09-20T20:13:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.963+0000 7f342659c700 1 -- 172.21.15.8:0/3068874553 learned_addr learned my addr 172.21.15.8:0/3068874553 (peer_addr_for_me v1:172.21.15.8:0/0) 2022-09-20T20:13:59.968 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.963+0000 7f3425d9b700 1 --2- 172.21.15.8:0/3068874553 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34280c84f0 0x7f34280cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:59.969 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.963+0000 7f342559a700 1 -- 172.21.15.8:0/3068874553 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1516119565 0 0) 0x7f342806f860 con 0x7f342815b370 2022-09-20T20:13:59.969 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.963+0000 7f342559a700 1 -- 172.21.15.8:0/3068874553 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f340c0035b0 con 0x7f342815b370 2022-09-20T20:13:59.969 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.963+0000 7f342559a700 1 -- 172.21.15.8:0/3068874553 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299329667 0 0) 0x7f342815b740 con 0x7f3428069230 2022-09-20T20:13:59.969 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.963+0000 7f342559a700 1 -- 172.21.15.8:0/3068874553 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f342806f860 con 0x7f3428069230 2022-09-20T20:13:59.969 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.963+0000 7f342559a700 1 -- 172.21.15.8:0/3068874553 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4175597119 0 0) 0x7f340c0035b0 con 0x7f342815b370 2022-09-20T20:13:59.970 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.963+0000 7f3425d9b700 1 -- 172.21.15.8:0/3068874553 >> v1:172.21.15.55:6789/0 conn(0x7f3428069230 legacy=0x7f342815ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:59.970 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.963+0000 7f3425d9b700 1 -- 172.21.15.8:0/3068874553 >> v1:172.21.15.8:6789/0 conn(0x7f342815b370 legacy=0x7f3428068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:59.970 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.963+0000 7f3425d9b700 1 -- 172.21.15.8:0/3068874553 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342806fde0 con 0x7f34280c84f0 2022-09-20T20:13:59.970 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.964+0000 7f3425d9b700 1 --2- 172.21.15.8:0/3068874553 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34280c84f0 0x7f34280cd800 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3418009870 tx=0x7f3418009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=276b095a2aba6dbf server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:59.971 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.964+0000 7f342559a700 1 -- 172.21.15.8:0/3068874553 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c001670 con 0x7f34280c84f0 2022-09-20T20:13:59.971 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.964+0000 7f342559a700 1 -- 172.21.15.8:0/3068874553 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3418004030 con 0x7f34280c84f0 2022-09-20T20:13:59.971 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.964+0000 7f342559a700 1 -- 172.21.15.8:0/3068874553 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34180043c0 con 0x7f34280c84f0 2022-09-20T20:13:59.971 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.964+0000 7f342cd90700 1 -- 172.21.15.8:0/3068874553 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34280c84f0 msgr2=0x7f34280cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:59.971 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.964+0000 7f342cd90700 1 --2- 172.21.15.8:0/3068874553 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34280c84f0 0x7f34280cd800 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3418009870 tx=0x7f3418009b80 comp rx=0 tx=0).stop 2022-09-20T20:13:59.972 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.964+0000 7f342cd90700 1 -- 172.21.15.8:0/3068874553 shutdown_connections 2022-09-20T20:13:59.972 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.964+0000 7f342cd90700 1 --2- 172.21.15.8:0/3068874553 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f34280c84f0 0x7f34280cd800 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:59.972 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.964+0000 7f342cd90700 1 -- 172.21.15.8:0/3068874553 >> 172.21.15.8:0/3068874553 conn(0x7f34280ca9b0 msgr2=0x7f34280cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:13:59.972 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.964+0000 7f342cd90700 1 -- 172.21.15.8:0/3068874553 shutdown_connections 2022-09-20T20:13:59.973 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.965+0000 7f342cd90700 1 -- 172.21.15.8:0/3068874553 wait complete. 2022-09-20T20:13:59.976 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.966+0000 7f342cd90700 1 Processor -- start 2022-09-20T20:13:59.976 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.966+0000 7f342cd90700 1 -- start start 2022-09-20T20:13:59.976 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f342cd90700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3428069230 0x7f342814ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:59.976 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f342cd90700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34280c84f0 0x7f34280c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:59.977 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f342cd90700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f342815b370 0x7f3428159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:59.977 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f342cd90700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342814b820 con 0x7f3428069230 2022-09-20T20:13:59.977 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f342cd90700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34280c4f70 con 0x7f34280c84f0 2022-09-20T20:13:59.977 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f342cd90700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34280c5250 con 0x7f342815b370 2022-09-20T20:13:59.978 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f342659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3428069230 0x7f342814ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:59.978 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f342659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3428069230 0x7f342814ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58306/0 (socket says 172.21.15.8:58306) 2022-09-20T20:13:59.978 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f342659c700 1 -- 172.21.15.8:0/2424267691 learned_addr learned my addr 172.21.15.8:0/2424267691 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:13:59.978 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f3426d9d700 1 --2- 172.21.15.8:0/2424267691 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f342815b370 0x7f3428159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:59.978 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f3425d9b700 1 --2- 172.21.15.8:0/2424267691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34280c84f0 0x7f34280c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f342659c700 1 -- 172.21.15.8:0/2424267691 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f342815b370 msgr2=0x7f3428159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f342659c700 1 --2- 172.21.15.8:0/2424267691 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f342815b370 0x7f3428159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f342659c700 1 -- 172.21.15.8:0/2424267691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34280c84f0 msgr2=0x7f34280c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:13:59.979 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f342659c700 1 --2- 172.21.15.8:0/2424267691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34280c84f0 0x7f34280c6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:13:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f342659c700 1 -- 172.21.15.8:0/2424267691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34180094a0 con 0x7f3428069230 2022-09-20T20:13:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f3425d9b700 1 --2- 172.21.15.8:0/2424267691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34280c84f0 0x7f34280c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-20T20:13:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f342659c700 1 --2- 172.21.15.8:0/2424267691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3428069230 0x7f342814ace0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f341c00c6b0 tx=0x7f341c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f3416ffd700 1 -- 172.21.15.8:0/2424267691 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c007620 con 0x7f3428069230 2022-09-20T20:13:59.980 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f3416ffd700 1 -- 172.21.15.8:0/2424267691 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f341c004870 con 0x7f3428069230 2022-09-20T20:13:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f342cd90700 1 -- 172.21.15.8:0/2424267691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34280c5530 con 0x7f3428069230 2022-09-20T20:13:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f3416ffd700 1 -- 172.21.15.8:0/2424267691 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c004c20 con 0x7f3428069230 2022-09-20T20:13:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.967+0000 7f342cd90700 1 -- 172.21.15.8:0/2424267691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34280c5af0 con 0x7f3428069230 2022-09-20T20:13:59.981 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.968+0000 7f342cd90700 1 -- 172.21.15.8:0/2424267691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342806d2c0 con 0x7f3428069230 2022-09-20T20:13:59.982 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.969+0000 7f3416ffd700 1 -- 172.21.15.8:0/2424267691 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 83870+0+0 (secure 0 0 0) 0x7f341c01a020 con 0x7f3428069230 2022-09-20T20:13:59.982 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.969+0000 7f3416ffd700 1 --2- 172.21.15.8:0/2424267691 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f3404065a00 0x7f3404067eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:13:59.982 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.969+0000 7f3416ffd700 1 -- 172.21.15.8:0/2424267691 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 5184+0+0 (secure 0 0 0) 0x7f341c082440 con 0x7f3428069230 2022-09-20T20:13:59.982 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.969+0000 7f3425d9b700 1 --2- 172.21.15.8:0/2424267691 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f3404065a00 0x7f3404067eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:13:59.982 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.969+0000 7f3425d9b700 1 --2- 172.21.15.8:0/2424267691 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f3404065a00 0x7f3404067eb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f34180090b0 tx=0x7f3418008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:13:59.983 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:13:59.973+0000 7f3416ffd700 1 -- 172.21.15.8:0/2424267691 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7f341c050670 con 0x7f3428069230 2022-09-20T20:14:00.163 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:00.161+0000 7f342cd90700 1 -- 172.21.15.8:0/2424267691 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3428072c60 con 0x7f3428069230 2022-09-20T20:14:00.825 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:00.823+0000 7f3416ffd700 1 -- 172.21.15.8:0/2424267691 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f341c053c90 con 0x7f3428069230 2022-09-20T20:14:00.829 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:00.826+0000 7f342cd90700 1 -- 172.21.15.8:0/2424267691 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f3404065a00 msgr2=0x7f3404067eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:00.829 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:00.826+0000 7f342cd90700 1 --2- 172.21.15.8:0/2424267691 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f3404065a00 0x7f3404067eb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f34180090b0 tx=0x7f3418008030 comp rx=0 tx=0).stop 2022-09-20T20:14:00.829 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:00.826+0000 7f342cd90700 1 -- 172.21.15.8:0/2424267691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3428069230 msgr2=0x7f342814ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:00.830 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:00.826+0000 7f342cd90700 1 --2- 172.21.15.8:0/2424267691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3428069230 0x7f342814ace0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f341c00c6b0 tx=0x7f341c00c9c0 comp rx=0 tx=0).stop 2022-09-20T20:14:00.830 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:00.826+0000 7f342cd90700 1 -- 172.21.15.8:0/2424267691 shutdown_connections 2022-09-20T20:14:00.830 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:00.826+0000 7f342cd90700 1 --2- 172.21.15.8:0/2424267691 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f3404065a00 0x7f3404067eb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:00.831 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:00.826+0000 7f342cd90700 1 --2- 172.21.15.8:0/2424267691 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3428069230 0x7f342814ace0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:00.831 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:00.826+0000 7f342cd90700 1 --2- 172.21.15.8:0/2424267691 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f342815b370 0x7f3428159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:00.831 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:00.826+0000 7f342cd90700 1 --2- 172.21.15.8:0/2424267691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f34280c84f0 0x7f34280c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:00.832 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:00.826+0000 7f342cd90700 1 -- 172.21.15.8:0/2424267691 >> 172.21.15.8:0/2424267691 conn(0x7f34280ca9b0 msgr2=0x7f342806b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:00.832 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:00.827+0000 7f342cd90700 1 -- 172.21.15.8:0/2424267691 shutdown_connections 2022-09-20T20:14:00.832 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:00.827+0000 7f342cd90700 1 -- 172.21.15.8:0/2424267691 wait complete. 2022-09-20T20:14:00.833 INFO:teuthology.orchestra.run.smithi008.stderr:enabled application 'rbd' on pool 'rbd' 2022-09-20T20:14:00.847 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2022-09-20T20:14:00.848 INFO:tasks.ceph.mds.a:Restarting daemon 2022-09-20T20:14:00.849 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-09-20T20:14:00.852 INFO:tasks.ceph.mds.a:Started 2022-09-20T20:14:00.853 INFO:tasks.ceph.mds.c:Restarting daemon 2022-09-20T20:14:00.853 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-09-20T20:14:00.857 INFO:tasks.ceph.mds.c:Started 2022-09-20T20:14:00.858 INFO:tasks.ceph.mds.b:Restarting daemon 2022-09-20T20:14:00.859 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-09-20T20:14:00.862 INFO:tasks.ceph.mds.b:Started 2022-09-20T20:14:00.862 INFO:tasks.ceph.mds.d:Restarting daemon 2022-09-20T20:14:00.863 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2022-09-20T20:14:00.865 INFO:tasks.ceph.mds.d:Started 2022-09-20T20:14:00.866 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2022-09-20T20:14:00.866 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-20T20:14:00.952 INFO:tasks.ceph.mds.a.smithi008.stdout:starting mds.a at 2022-09-20T20:14:00.956 INFO:tasks.ceph.mds.c.smithi008.stdout:starting mds.c at 2022-09-20T20:14:00.957 INFO:tasks.ceph.mds.b.smithi055.stdout:starting mds.b at 2022-09-20T20:14:00.968 INFO:tasks.ceph.mds.d.smithi055.stdout:starting mds.d at 2022-09-20T20:14:01.022 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.020+0000 7f8a20a15700 1 Processor -- start 2022-09-20T20:14:01.022 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.020+0000 7f8a20a15700 1 -- start start 2022-09-20T20:14:01.025 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.021+0000 7f8a20a15700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8a1c06d950 0x7f8a1c0cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:01.025 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.021+0000 7f8a20a15700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8a1c0aef10 0x7f8a1c0cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:01.025 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.021+0000 7f8a20a15700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a1c0cc0a0 con 0x7f8a1c159510 2022-09-20T20:14:01.026 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.021+0000 7f8a20a15700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1c15d130 con 0x7f8a1c06d950 2022-09-20T20:14:01.026 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.021+0000 7f8a20a15700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a1c1598e0 con 0x7f8a1c0aef10 2022-09-20T20:14:01.026 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.021+0000 7f8a19d9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8a1c06d950 0x7f8a1c0cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:01.026 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.021+0000 7f8a19d9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f8a1c06d950 0x7f8a1c0cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58386/0 (socket says 172.21.15.8:58386) 2022-09-20T20:14:01.026 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.021+0000 7f8a19d9b700 1 -- 172.21.15.8:0/1796678076 learned_addr learned my addr 172.21.15.8:0/1796678076 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:14:01.027 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.022+0000 7f8a1ad9d700 1 --2- 172.21.15.8:0/1796678076 >> v2:172.21.15.55:3300/0 conn(0x7f8a1c0aef10 0x7f8a1c0cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:01.027 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.022+0000 7f8a19d9b700 1 -- 172.21.15.8:0/1796678076 >> v2:172.21.15.55:3300/0 conn(0x7f8a1c0aef10 msgr2=0x7f8a1c0cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:01.027 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.022+0000 7f8a1959a700 1 -- 172.21.15.8:0/1796678076 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007383587 0 0) 0x7f8a1c0cc0a0 con 0x7f8a1c159510 2022-09-20T20:14:01.027 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.022+0000 7f8a19d9b700 1 --2- 172.21.15.8:0/1796678076 >> v2:172.21.15.55:3300/0 conn(0x7f8a1c0aef10 0x7f8a1c0cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.028 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.022+0000 7f8a19d9b700 1 -- 172.21.15.8:0/1796678076 >> v1:172.21.15.55:6789/0 conn(0x7f8a1c159510 legacy=0x7f8a1c06d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.028 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.022+0000 7f8a19d9b700 1 -- 172.21.15.8:0/1796678076 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c15d3d0 con 0x7f8a1c06d950 2022-09-20T20:14:01.028 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.022+0000 7f8a19d9b700 1 --2- 172.21.15.8:0/1796678076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a1c06d950 0x7f8a1c0cd660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c070ae0 tx=0x7f8a10009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537c6b824cfc3775 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:01.028 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.022+0000 7f8a1959a700 1 -- 172.21.15.8:0/1796678076 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10011830 con 0x7f8a1c06d950 2022-09-20T20:14:01.029 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.022+0000 7f8a1959a700 1 -- 172.21.15.8:0/1796678076 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a10011990 con 0x7f8a1c06d950 2022-09-20T20:14:01.029 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.022+0000 7f8a1959a700 1 -- 172.21.15.8:0/1796678076 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10011d20 con 0x7f8a1c06d950 2022-09-20T20:14:01.029 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.023+0000 7f8a20a15700 1 -- 172.21.15.8:0/1796678076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a1c06d950 msgr2=0x7f8a1c0cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.029 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.023+0000 7f8a20a15700 1 --2- 172.21.15.8:0/1796678076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a1c06d950 0x7f8a1c0cd660 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c070ae0 tx=0x7f8a10009bd0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.030 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.023+0000 7f8a20a15700 1 -- 172.21.15.8:0/1796678076 shutdown_connections 2022-09-20T20:14:01.030 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.023+0000 7f8a20a15700 1 --2- 172.21.15.8:0/1796678076 >> v2:172.21.15.55:3300/0 conn(0x7f8a1c0aef10 0x7f8a1c0cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.030 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.023+0000 7f8a20a15700 1 --2- 172.21.15.8:0/1796678076 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a1c06d950 0x7f8a1c0cd660 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.030 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.023+0000 7f8a20a15700 1 -- 172.21.15.8:0/1796678076 >> 172.21.15.8:0/1796678076 conn(0x7f8a1c0cf900 msgr2=0x7f8a1c0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:01.030 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.023+0000 7f8a20a15700 1 -- 172.21.15.8:0/1796678076 shutdown_connections 2022-09-20T20:14:01.031 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.023+0000 7f8a20a15700 1 -- 172.21.15.8:0/1796678076 wait complete. 2022-09-20T20:14:01.034 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.024+0000 7f8a20a15700 1 Processor -- start 2022-09-20T20:14:01.034 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.024+0000 7f8a20a15700 1 -- start start 2022-09-20T20:14:01.035 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.025+0000 7f8a20a15700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8a1c06d950 0x7f8a1c152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:01.035 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.025+0000 7f8a20a15700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a1c0aef10 0x7f8a1c1f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:01.035 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.025+0000 7f8a20a15700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a1c159510 0x7f8a1c1f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:01.035 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.025+0000 7f8a20a15700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c06a640 con 0x7f8a1c0aef10 2022-09-20T20:14:01.035 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.025+0000 7f8a20a15700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c06b650 con 0x7f8a1c159510 2022-09-20T20:14:01.036 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.025+0000 7f8a20a15700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c06a890 con 0x7f8a1c06d950 2022-09-20T20:14:01.036 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.025+0000 7f8a19d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a1c0aef10 0x7f8a1c1f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:01.036 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.025+0000 7f8a19d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a1c0aef10 0x7f8a1c1f4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58392/0 (socket says 172.21.15.8:58392) 2022-09-20T20:14:01.036 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.025+0000 7f8a19d9b700 1 -- 172.21.15.8:0/449021240 learned_addr learned my addr 172.21.15.8:0/449021240 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:14:01.037 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.025+0000 7f8a1a59c700 1 --2- 172.21.15.8:0/449021240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8a1c06d950 0x7f8a1c152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:01.037 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.025+0000 7f8a1ad9d700 1 --2- 172.21.15.8:0/449021240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a1c159510 0x7f8a1c1f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:01.037 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.025+0000 7f8a19d9b700 1 -- 172.21.15.8:0/449021240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8a1c06d950 msgr2=0x7f8a1c152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.037 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.025+0000 7f8a19d9b700 1 --2- 172.21.15.8:0/449021240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8a1c06d950 0x7f8a1c152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.038 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.025+0000 7f8a19d9b700 1 -- 172.21.15.8:0/449021240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a1c159510 msgr2=0x7f8a1c1f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.038 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.025+0000 7f8a19d9b700 1 --2- 172.21.15.8:0/449021240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a1c159510 0x7f8a1c1f4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.038 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.025+0000 7f8a19d9b700 1 -- 172.21.15.8:0/449021240 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a10009550 con 0x7f8a1c0aef10 2022-09-20T20:14:01.039 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.025+0000 7f8a19d9b700 1 --2- 172.21.15.8:0/449021240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a1c0aef10 0x7f8a1c1f4200 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8a10009c10 tx=0x7f8a10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:01.039 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.026+0000 7f8a0affd700 1 -- 172.21.15.8:0/449021240 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10004510 con 0x7f8a1c0aef10 2022-09-20T20:14:01.039 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.026+0000 7f8a0affd700 1 -- 172.21.15.8:0/449021240 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a100036a0 con 0x7f8a1c0aef10 2022-09-20T20:14:01.039 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.026+0000 7f8a20a15700 1 -- 172.21.15.8:0/449021240 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1c06ab70 con 0x7f8a1c0aef10 2022-09-20T20:14:01.039 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.026+0000 7f8a0affd700 1 -- 172.21.15.8:0/449021240 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10003a30 con 0x7f8a1c0aef10 2022-09-20T20:14:01.040 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.026+0000 7f8a20a15700 1 -- 172.21.15.8:0/449021240 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1c06b130 con 0x7f8a1c0aef10 2022-09-20T20:14:01.040 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.027+0000 7f8a20a15700 1 -- 172.21.15.8:0/449021240 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a1c065e70 con 0x7f8a1c0aef10 2022-09-20T20:14:01.040 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.027+0000 7f8a0affd700 1 -- 172.21.15.8:0/449021240 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 83870+0+0 (secure 0 0 0) 0x7f8a1002d070 con 0x7f8a1c0aef10 2022-09-20T20:14:01.040 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.028+0000 7f8a0affd700 1 --2- 172.21.15.8:0/449021240 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f89f8065a00 0x7f89f8067eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:01.041 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.028+0000 7f8a0affd700 1 -- 172.21.15.8:0/449021240 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8a10021030 con 0x7f8a1c0aef10 2022-09-20T20:14:01.041 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.028+0000 7f8a1a59c700 1 --2- 172.21.15.8:0/449021240 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f89f8065a00 0x7f89f8067eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:01.041 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.028+0000 7f8a1a59c700 1 --2- 172.21.15.8:0/449021240 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f89f8065a00 0x7f89f8067eb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c000f60 tx=0x7f8a0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:01.041 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.032+0000 7f8a0affd700 1 -- 172.21.15.8:0/449021240 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7f8a10052290 con 0x7f8a1c0aef10 2022-09-20T20:14:01.233 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.231+0000 7f8a20a15700 1 -- 172.21.15.8:0/449021240 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a1c072c60 con 0x7f8a1c0aef10 2022-09-20T20:14:01.234 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.233+0000 7f8a0affd700 1 -- 172.21.15.8:0/449021240 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+13626 (secure 0 0 0) 0x7f8a1002b090 con 0x7f8a1c0aef10 2022-09-20T20:14:01.235 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:14:01.235 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":15,"fsid":"e2fce34f-6561-47ef-8379-911f2b368662","created":"2022-09-20T20:13:47.969272+0000","modified":"2022-09-20T20:14:00.815680+0000","last_up_change":"2022-09-20T20:13:58.804121+0000","last_in_change":"2022-09-20T20:13:50.496167+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-09-20T20:13:59.325616+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2022-09-20T20:13:59.524689+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bd449a06-0637-42f4-9257-e0de045c499e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":99877},{"type":"v1","addr":"172.21.15.8:6817","nonce":99877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":99877},{"type":"v1","addr":"172.21.15.8:6819","nonce":99877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":99877},{"type":"v1","addr":"172.21.15.8:6823","nonce":99877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":99877},{"type":"v1","addr":"172.21.15.8:6821","nonce":99877}]},"public_addr":"172.21.15.8:6817/99877","cluster_addr":"172.21.15.8:6819/99877","heartbeat_back_addr":"172.21.15.8:6823/99877","heartbeat_front_addr":"172.21.15.8:6821/99877","state":["exists","up"]},{"osd":1,"uuid":"db347f63-385a-4b18-85be-65594acb61a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":99876},{"type":"v1","addr":"172.21.15.8:6809","nonce":99876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":99876},{"type":"v1","addr":"172.21.15.8:6811","nonce":99876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":99876},{"type":"v1","addr":"172.21.15.8:6815","nonce":99876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":99876},{"type":"v1","addr":"172.21.15.8:6813","nonce":99876}]},"public_addr":"172.21.15.8:6809/99876","cluster_addr":"172.21.15.8:6811/99876","heartbeat_back_addr":"172.21.15.8:6815/99876","heartbeat_front_addr":"172.21.15.8:6813/99876","state":["exists","up"]},{"osd":2,"uuid":"296cfab0-d996-45d6-bef0-69c311817ffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":99875},{"type":"v1","addr":"172.21.15.8:6801","nonce":99875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":99875},{"type":"v1","addr":"172.21.15.8:6803","nonce":99875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":99875},{"type":"v1","addr":"172.21.15.8:6807","nonce":99875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":99875},{"type":"v1","addr":"172.21.15.8:6805","nonce":99875}]},"public_addr":"172.21.15.8:6801/99875","cluster_addr":"172.21.15.8:6803/99875","heartbeat_back_addr":"172.21.15.8:6807/99875","heartbeat_front_addr":"172.21.15.8:6805/99875","state":["exists","up"]},{"osd":3,"uuid":"77dc730e-ac38-4ac5-b821-53bfe07a7bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":99886},{"type":"v1","addr":"172.21.15.8:6825","nonce":99886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":99886},{"type":"v1","addr":"172.21.15.8:6827","nonce":99886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":99886},{"type":"v1","addr":"172.21.15.8:6831","nonce":99886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":99886},{"type":"v1","addr":"172.21.15.8:6829","nonce":99886}]},"public_addr":"172.21.15.8:6825/99886","cluster_addr":"172.21.15.8:6827/99886","heartbeat_back_addr":"172.21.15.8:6831/99886","heartbeat_front_addr":"172.21.15.8:6829/99886","state":["exists","up"]},{"osd":4,"uuid":"bbb00f2b-07be-4844-bcce-b60c4c693a0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":100137},{"type":"v1","addr":"172.21.15.55:6817","nonce":100137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":100137},{"type":"v1","addr":"172.21.15.55:6819","nonce":100137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":100137},{"type":"v1","addr":"172.21.15.55:6823","nonce":100137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":100137},{"type":"v1","addr":"172.21.15.55:6821","nonce":100137}]},"public_addr":"172.21.15.55:6817/100137","cluster_addr":"172.21.15.55:6819/100137","heartbeat_back_addr":"172.21.15.55:6823/100137","heartbeat_front_addr":"172.21.15.55:6821/100137","state":["exists","up"]},{"osd":5,"uuid":"dad61efb-3c40-4377-ba3d-df1ea6996dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":100136},{"type":"v1","addr":"172.21.15.55:6825","nonce":100136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":100136},{"type":"v1","addr":"172.21.15.55:6827","nonce":100136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":100136},{"type":"v1","addr":"172.21.15.55:6831","nonce":100136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":100136},{"type":"v1","addr":"172.21.15.55:6829","nonce":100136}]},"public_addr":"172.21.15.55:6825/100136","cluster_addr":"172.21.15.55:6827/100136","heartbeat_back_addr":"172.21.15.55:6831/100136","heartbeat_front_addr":"172.21.15.55:6829/100136","state":["exists","up"]},{"osd":6,"uuid":"6b9de588-7ec2-4466-a4a8-561d80a92f5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":100130},{"type":"v1","addr":"172.21.15.55:6801","nonce":100130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":100130},{"type":"v1","addr":"172.21.15.55:6803","nonce":100130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":100130},{"type":"v1","addr":"172.21.15.55:6807","nonce":100130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":100130},{"type":"v1","addr":"172.21.15.55:6805","nonce":100130}]},"public_addr":"172.21.15.55:6801/100130","cluster_addr":"172.21.15.55:6803/100130","heartbeat_back_addr":"172.21.15.55:6807/100130","heartbeat_front_addr":"172.21.15.55:6805/100130","state":["exists","up"]},{"osd":7,"uuid":"e9fbcb44-5753-4b0f-9136-007a17bc8157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":100131},{"type":"v1","addr":"172.21.15.55:6809","nonce":100131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":100131},{"type":"v1","addr":"172.21.15.55:6811","nonce":100131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":100131},{"type":"v1","addr":"172.21.15.55:6815","nonce":100131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":100131},{"type":"v1","addr":"172.21.15.55:6813","nonce":100131}]},"public_addr":"172.21.15.55:6809/100131","cluster_addr":"172.21.15.55:6811/100131","heartbeat_back_addr":"172.21.15.55:6815/100131","heartbeat_front_addr":"172.21.15.55:6813/100131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:13:55.674691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:13:55.629207+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:13:55.612346+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:13:55.668154+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:13:55.723147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:13:55.668202+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:13:55.596313+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:13:55.741167+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-20T20:14:01.236 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.235+0000 7f8a20a15700 1 -- 172.21.15.8:0/449021240 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f89f8065a00 msgr2=0x7f89f8067eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.237 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.235+0000 7f8a20a15700 1 --2- 172.21.15.8:0/449021240 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f89f8065a00 0x7f89f8067eb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c000f60 tx=0x7f8a0c009040 comp rx=0 tx=0).stop 2022-09-20T20:14:01.237 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.235+0000 7f8a20a15700 1 -- 172.21.15.8:0/449021240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a1c0aef10 msgr2=0x7f8a1c1f4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.237 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.235+0000 7f8a20a15700 1 --2- 172.21.15.8:0/449021240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a1c0aef10 0x7f8a1c1f4200 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8a10009c10 tx=0x7f8a10004750 comp rx=0 tx=0).stop 2022-09-20T20:14:01.237 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.235+0000 7f8a20a15700 1 -- 172.21.15.8:0/449021240 shutdown_connections 2022-09-20T20:14:01.238 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.235+0000 7f8a20a15700 1 --2- 172.21.15.8:0/449021240 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f89f8065a00 0x7f89f8067eb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.238 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.235+0000 7f8a20a15700 1 --2- 172.21.15.8:0/449021240 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a1c159510 0x7f8a1c1f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.238 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.235+0000 7f8a20a15700 1 --2- 172.21.15.8:0/449021240 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8a1c06d950 0x7f8a1c152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.238 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.235+0000 7f8a20a15700 1 --2- 172.21.15.8:0/449021240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a1c0aef10 0x7f8a1c1f4200 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.238 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.235+0000 7f8a20a15700 1 -- 172.21.15.8:0/449021240 >> 172.21.15.8:0/449021240 conn(0x7f8a1c0cf900 msgr2=0x7f8a1c06d240 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:01.239 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.235+0000 7f8a20a15700 1 -- 172.21.15.8:0/449021240 shutdown_connections 2022-09-20T20:14:01.239 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.235+0000 7f8a20a15700 1 -- 172.21.15.8:0/449021240 wait complete. 2022-09-20T20:14:01.250 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2022-09-20T20:13:59.325616+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2022-09-20T20:13:59.524689+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2022-09-20T20:14:01.250 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-09-20T20:14:01.384 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.382+0000 7f0b1bd3e700 1 Processor -- start 2022-09-20T20:14:01.384 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.382+0000 7f0b1bd3e700 1 -- start start 2022-09-20T20:14:01.387 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.383+0000 7f0b1bd3e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b1406f7c0 0x7f0b1406fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:01.387 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.383+0000 7f0b1bd3e700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b1406b8c0 con 0x7f0b140cd750 2022-09-20T20:14:01.387 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.383+0000 7f0b1bd3e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b140cbb10 con 0x7f0b14158e00 2022-09-20T20:14:01.387 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.383+0000 7f0b1bd3e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140cdbf0 con 0x7f0b1406f7c0 2022-09-20T20:14:01.388 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.383+0000 7f0b192d9700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f0b140cd750 0x7f0b1406c030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41206/0 (socket says 172.21.15.8:41206) 2022-09-20T20:14:01.388 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.383+0000 7f0b192d9700 1 -- 172.21.15.8:0/3868806914 learned_addr learned my addr 172.21.15.8:0/3868806914 (peer_addr_for_me v1:172.21.15.8:0/0) 2022-09-20T20:14:01.388 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.383+0000 7f0b1a2db700 1 --2- 172.21.15.8:0/3868806914 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b1406f7c0 0x7f0b1406fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:01.388 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.384+0000 7f0b18ad8700 1 -- 172.21.15.8:0/3868806914 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352903191 0 0) 0x7f0b1406b8c0 con 0x7f0b140cd750 2022-09-20T20:14:01.389 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.384+0000 7f0b18ad8700 1 -- 172.21.15.8:0/3868806914 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0afc0035b0 con 0x7f0b140cd750 2022-09-20T20:14:01.389 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.384+0000 7f0b18ad8700 1 -- 172.21.15.8:0/3868806914 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941593930 0 0) 0x7f0b140cbb10 con 0x7f0b14158e00 2022-09-20T20:14:01.389 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.384+0000 7f0b18ad8700 1 -- 172.21.15.8:0/3868806914 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b1406b8c0 con 0x7f0b14158e00 2022-09-20T20:14:01.389 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.384+0000 7f0b1a2db700 1 -- 172.21.15.8:0/3868806914 >> v1:172.21.15.55:6789/0 conn(0x7f0b14158e00 legacy=0x7f0b1415c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.390 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.384+0000 7f0b1a2db700 1 -- 172.21.15.8:0/3868806914 >> v1:172.21.15.8:6789/0 conn(0x7f0b140cd750 legacy=0x7f0b1406c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.390 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.384+0000 7f0b1a2db700 1 -- 172.21.15.8:0/3868806914 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b140cbdf0 con 0x7f0b1406f7c0 2022-09-20T20:14:01.390 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.384+0000 7f0b1a2db700 1 --2- 172.21.15.8:0/3868806914 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b1406f7c0 0x7f0b1406fc20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009dc0 tx=0x7f0b0c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45965fb290714f13 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:01.391 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.384+0000 7f0b18ad8700 1 -- 172.21.15.8:0/3868806914 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c00e070 con 0x7f0b1406f7c0 2022-09-20T20:14:01.391 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.384+0000 7f0b18ad8700 1 -- 172.21.15.8:0/3868806914 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c00bb20 con 0x7f0b1406f7c0 2022-09-20T20:14:01.391 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.384+0000 7f0b18ad8700 1 -- 172.21.15.8:0/3868806914 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c00be90 con 0x7f0b1406f7c0 2022-09-20T20:14:01.392 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.385+0000 7f0b1bd3e700 1 -- 172.21.15.8:0/3868806914 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b1406f7c0 msgr2=0x7f0b1406fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.392 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.385+0000 7f0b1bd3e700 1 --2- 172.21.15.8:0/3868806914 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b1406f7c0 0x7f0b1406fc20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009dc0 tx=0x7f0b0c00b330 comp rx=0 tx=0).stop 2022-09-20T20:14:01.393 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.385+0000 7f0b1bd3e700 1 -- 172.21.15.8:0/3868806914 shutdown_connections 2022-09-20T20:14:01.393 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.385+0000 7f0b1bd3e700 1 --2- 172.21.15.8:0/3868806914 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b1406f7c0 0x7f0b1406fc20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.393 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.385+0000 7f0b1bd3e700 1 -- 172.21.15.8:0/3868806914 >> 172.21.15.8:0/3868806914 conn(0x7f0b140ca9b0 msgr2=0x7f0b140cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:01.394 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.385+0000 7f0b1bd3e700 1 -- 172.21.15.8:0/3868806914 shutdown_connections 2022-09-20T20:14:01.394 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.385+0000 7f0b1bd3e700 1 -- 172.21.15.8:0/3868806914 wait complete. 2022-09-20T20:14:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.386+0000 7f0b1bd3e700 1 Processor -- start 2022-09-20T20:14:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.386+0000 7f0b1bd3e700 1 -- start start 2022-09-20T20:14:01.399 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b1bd3e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b1406f7c0 0x7f0b14155860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:01.400 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b1bd3e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b140cd750 0x7f0b140b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:01.400 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b1bd3e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b14158e00 0x7f0b140aa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:01.400 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b1bd3e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b14155da0 con 0x7f0b140cd750 2022-09-20T20:14:01.400 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b1bd3e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140af2a0 con 0x7f0b14158e00 2022-09-20T20:14:01.401 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b1bd3e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140af580 con 0x7f0b1406f7c0 2022-09-20T20:14:01.401 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b192d9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b140cd750 0x7f0b140b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:01.401 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b192d9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b140cd750 0x7f0b140b1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58414/0 (socket says 172.21.15.8:58414) 2022-09-20T20:14:01.401 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b192d9700 1 -- 172.21.15.8:0/2264689089 learned_addr learned my addr 172.21.15.8:0/2264689089 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:14:01.401 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b19ada700 1 --2- 172.21.15.8:0/2264689089 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b1406f7c0 0x7f0b14155860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:01.402 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b1a2db700 1 --2- 172.21.15.8:0/2264689089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b14158e00 0x7f0b140aa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:01.402 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b192d9700 1 -- 172.21.15.8:0/2264689089 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b1406f7c0 msgr2=0x7f0b14155860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.402 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b192d9700 1 --2- 172.21.15.8:0/2264689089 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b1406f7c0 0x7f0b14155860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.402 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b192d9700 1 -- 172.21.15.8:0/2264689089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b14158e00 msgr2=0x7f0b140aa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.403 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b192d9700 1 --2- 172.21.15.8:0/2264689089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b14158e00 0x7f0b140aa8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.403 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b192d9700 1 -- 172.21.15.8:0/2264689089 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0c009a70 con 0x7f0b140cd750 2022-09-20T20:14:01.403 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b192d9700 1 --2- 172.21.15.8:0/2264689089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b140cd750 0x7f0b140b1d20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400c700 tx=0x7f0b0400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:01.403 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b027fc700 1 -- 172.21.15.8:0/2264689089 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b04005d70 con 0x7f0b140cd750 2022-09-20T20:14:01.403 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b027fc700 1 -- 172.21.15.8:0/2264689089 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b040070d0 con 0x7f0b140cd750 2022-09-20T20:14:01.404 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.387+0000 7f0b1bd3e700 1 -- 172.21.15.8:0/2264689089 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b140af860 con 0x7f0b140cd750 2022-09-20T20:14:01.404 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.388+0000 7f0b027fc700 1 -- 172.21.15.8:0/2264689089 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b04007440 con 0x7f0b140cd750 2022-09-20T20:14:01.404 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.388+0000 7f0b1bd3e700 1 -- 172.21.15.8:0/2264689089 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b140aef50 con 0x7f0b140cd750 2022-09-20T20:14:01.404 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.388+0000 7f0b1bd3e700 1 -- 172.21.15.8:0/2264689089 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b140afd80 con 0x7f0b140cd750 2022-09-20T20:14:01.405 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.389+0000 7f0b027fc700 1 -- 172.21.15.8:0/2264689089 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 83870+0+0 (secure 0 0 0) 0x7f0b04019030 con 0x7f0b140cd750 2022-09-20T20:14:01.405 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.389+0000 7f0b027fc700 1 --2- 172.21.15.8:0/2264689089 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f0af4065a00 0x7f0af4067eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:01.405 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.389+0000 7f0b027fc700 1 -- 172.21.15.8:0/2264689089 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0b04081900 con 0x7f0b140cd750 2022-09-20T20:14:01.405 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.393+0000 7f0b027fc700 1 -- 172.21.15.8:0/2264689089 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7f0b0404aa60 con 0x7f0b140cd750 2022-09-20T20:14:01.405 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.397+0000 7f0b19ada700 1 --2- 172.21.15.8:0/2264689089 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f0af4065a00 0x7f0af4067eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:01.406 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.397+0000 7f0b19ada700 1 --2- 172.21.15.8:0/2264689089 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f0af4065a00 0x7f0af4067eb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0b10001830 tx=0x7f0b10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:01.585 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.584+0000 7f0b1bd3e700 1 -- 172.21.15.8:0/2264689089 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0b14072c60 con 0x7f0b140cd750 2022-09-20T20:14:01.586 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.584+0000 7f0b027fc700 1 -- 172.21.15.8:0/2264689089 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0b04017070 con 0x7f0b140cd750 2022-09-20T20:14:01.586 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2022-09-20T20:14:01.588 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.586+0000 7f0b1bd3e700 1 -- 172.21.15.8:0/2264689089 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f0af4065a00 msgr2=0x7f0af4067eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.588 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.586+0000 7f0b1bd3e700 1 --2- 172.21.15.8:0/2264689089 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f0af4065a00 0x7f0af4067eb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0b10001830 tx=0x7f0b10009040 comp rx=0 tx=0).stop 2022-09-20T20:14:01.589 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.586+0000 7f0b1bd3e700 1 -- 172.21.15.8:0/2264689089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b140cd750 msgr2=0x7f0b140b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.589 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.586+0000 7f0b1bd3e700 1 --2- 172.21.15.8:0/2264689089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b140cd750 0x7f0b140b1d20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400c700 tx=0x7f0b0400ca10 comp rx=0 tx=0).stop 2022-09-20T20:14:01.589 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.586+0000 7f0b1bd3e700 1 -- 172.21.15.8:0/2264689089 shutdown_connections 2022-09-20T20:14:01.589 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.586+0000 7f0b1bd3e700 1 --2- 172.21.15.8:0/2264689089 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f0af4065a00 0x7f0af4067eb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.590 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.586+0000 7f0b1bd3e700 1 --2- 172.21.15.8:0/2264689089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0b14158e00 0x7f0b140aa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.590 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.586+0000 7f0b1bd3e700 1 --2- 172.21.15.8:0/2264689089 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0b1406f7c0 0x7f0b14155860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.590 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.586+0000 7f0b1bd3e700 1 --2- 172.21.15.8:0/2264689089 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0b140cd750 0x7f0b140b1d20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.590 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.586+0000 7f0b1bd3e700 1 -- 172.21.15.8:0/2264689089 >> 172.21.15.8:0/2264689089 conn(0x7f0b140ca9b0 msgr2=0x7f0b14069b10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:01.591 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.586+0000 7f0b1bd3e700 1 -- 172.21.15.8:0/2264689089 shutdown_connections 2022-09-20T20:14:01.591 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.586+0000 7f0b1bd3e700 1 -- 172.21.15.8:0/2264689089 wait complete. 2022-09-20T20:14:01.599 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-09-20T20:14:01.727 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.725+0000 7f6bc3dac700 1 Processor -- start 2022-09-20T20:14:01.728 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.725+0000 7f6bc3dac700 1 -- start start 2022-09-20T20:14:01.739 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.726+0000 7f6bc3dac700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6bbc06ca50 0x7f6bbc070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:01.739 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.726+0000 7f6bc3dac700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6bbc070140 0x7f6bbc068b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:01.740 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.726+0000 7f6bc3dac700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bbc0ce3e0 con 0x7f6bbc15b520 2022-09-20T20:14:01.740 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.726+0000 7f6bc3dac700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bbc0c2a20 con 0x7f6bbc070140 2022-09-20T20:14:01.740 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.726+0000 7f6bc3dac700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bbc0b0dd0 con 0x7f6bbc06ca50 2022-09-20T20:14:01.741 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.726+0000 7f6bc2349700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f6bbc070140 0x7f6bbc068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:01.741 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.726+0000 7f6bc1b48700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f6bbc15b520 0x7f6bbc0c2310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41224/0 (socket says 172.21.15.8:41224) 2022-09-20T20:14:01.742 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.726+0000 7f6bc1b48700 1 -- 172.21.15.8:0/1683328934 learned_addr learned my addr 172.21.15.8:0/1683328934 (peer_addr_for_me v1:172.21.15.8:0/0) 2022-09-20T20:14:01.742 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.726+0000 7f6bc1347700 1 --2- 172.21.15.8:0/1683328934 >> v2:172.21.15.55:3300/0 conn(0x7f6bbc06ca50 0x7f6bbc070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:01.742 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.727+0000 7f6bc0b46700 1 -- 172.21.15.8:0/1683328934 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875868064 0 0) 0x7f6bbc0ce3e0 con 0x7f6bbc15b520 2022-09-20T20:14:01.743 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.727+0000 7f6bc0b46700 1 -- 172.21.15.8:0/1683328934 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ba40035b0 con 0x7f6bbc15b520 2022-09-20T20:14:01.743 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.727+0000 7f6bc2349700 1 -- 172.21.15.8:0/1683328934 >> v2:172.21.15.55:3300/0 conn(0x7f6bbc06ca50 msgr2=0x7f6bbc070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:01.744 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.727+0000 7f6bc2349700 1 --2- 172.21.15.8:0/1683328934 >> v2:172.21.15.55:3300/0 conn(0x7f6bbc06ca50 0x7f6bbc070a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.744 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.727+0000 7f6bc2349700 1 -- 172.21.15.8:0/1683328934 >> v1:172.21.15.8:6789/0 conn(0x7f6bbc15b520 legacy=0x7f6bbc0c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.744 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.727+0000 7f6bc2349700 1 -- 172.21.15.8:0/1683328934 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc0b10b0 con 0x7f6bbc070140 2022-09-20T20:14:01.745 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.727+0000 7f6bc2349700 1 --2- 172.21.15.8:0/1683328934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bbc070140 0x7f6bbc068b20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0ae170 tx=0x7f6bb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cecbfa5e281a6e5 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:01.745 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.727+0000 7f6bc0b46700 1 -- 172.21.15.8:0/1683328934 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb400e070 con 0x7f6bbc070140 2022-09-20T20:14:01.746 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.727+0000 7f6bc0b46700 1 -- 172.21.15.8:0/1683328934 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb400bb20 con 0x7f6bbc070140 2022-09-20T20:14:01.746 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.727+0000 7f6bc0b46700 1 -- 172.21.15.8:0/1683328934 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb400be90 con 0x7f6bbc070140 2022-09-20T20:14:01.746 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.727+0000 7f6bc3dac700 1 -- 172.21.15.8:0/1683328934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bbc070140 msgr2=0x7f6bbc068b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.747 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.728+0000 7f6bc3dac700 1 --2- 172.21.15.8:0/1683328934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bbc070140 0x7f6bbc068b20 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0ae170 tx=0x7f6bb400b330 comp rx=0 tx=0).stop 2022-09-20T20:14:01.747 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.728+0000 7f6bc3dac700 1 -- 172.21.15.8:0/1683328934 shutdown_connections 2022-09-20T20:14:01.748 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.728+0000 7f6bc3dac700 1 --2- 172.21.15.8:0/1683328934 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bbc070140 0x7f6bbc068b20 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.748 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.728+0000 7f6bc3dac700 1 --2- 172.21.15.8:0/1683328934 >> v2:172.21.15.55:3300/0 conn(0x7f6bbc06ca50 0x7f6bbc070a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.748 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.728+0000 7f6bc3dac700 1 -- 172.21.15.8:0/1683328934 >> 172.21.15.8:0/1683328934 conn(0x7f6bbc06e8c0 msgr2=0x7f6bbc06c220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:01.749 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.728+0000 7f6bc3dac700 1 -- 172.21.15.8:0/1683328934 shutdown_connections 2022-09-20T20:14:01.749 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.728+0000 7f6bc3dac700 1 -- 172.21.15.8:0/1683328934 wait complete. 2022-09-20T20:14:01.750 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.729+0000 7f6bc3dac700 1 Processor -- start 2022-09-20T20:14:01.750 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.729+0000 7f6bc3dac700 1 -- start start 2022-09-20T20:14:01.750 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc3dac700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bbc06ca50 0x7f6bbc154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:01.751 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc3dac700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6bbc070140 0x7f6bbc0b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:01.751 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc3dac700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bbc15b520 0x7f6bbc0ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:01.751 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc3dac700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0b2650 con 0x7f6bbc06ca50 2022-09-20T20:14:01.752 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc3dac700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc155270 con 0x7f6bbc15b520 2022-09-20T20:14:01.752 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc3dac700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0b19d0 con 0x7f6bbc070140 2022-09-20T20:14:01.752 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc1b48700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bbc06ca50 0x7f6bbc154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:01.753 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc1b48700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bbc06ca50 0x7f6bbc154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58432/0 (socket says 172.21.15.8:58432) 2022-09-20T20:14:01.753 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc1b48700 1 -- 172.21.15.8:0/4202233181 learned_addr learned my addr 172.21.15.8:0/4202233181 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:14:01.753 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc2349700 1 --2- 172.21.15.8:0/4202233181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bbc15b520 0x7f6bbc0ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:01.754 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc1347700 1 --2- 172.21.15.8:0/4202233181 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6bbc070140 0x7f6bbc0b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:01.754 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc1b48700 1 -- 172.21.15.8:0/4202233181 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6bbc070140 msgr2=0x7f6bbc0b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.755 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc1b48700 1 --2- 172.21.15.8:0/4202233181 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6bbc070140 0x7f6bbc0b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.755 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc1b48700 1 -- 172.21.15.8:0/4202233181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bbc15b520 msgr2=0x7f6bbc0ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.756 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc1b48700 1 --2- 172.21.15.8:0/4202233181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bbc15b520 0x7f6bbc0ab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.756 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc1b48700 1 -- 172.21.15.8:0/4202233181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb4009a70 con 0x7f6bbc06ca50 2022-09-20T20:14:01.756 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc1b48700 1 --2- 172.21.15.8:0/4202233181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bbc06ca50 0x7f6bbc154d30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00c420 tx=0x7f6bac00c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:01.757 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6baa7fc700 1 -- 172.21.15.8:0/4202233181 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac005d70 con 0x7f6bbc06ca50 2022-09-20T20:14:01.757 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6baa7fc700 1 -- 172.21.15.8:0/4202233181 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac00ce30 con 0x7f6bbc06ca50 2022-09-20T20:14:01.758 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc3dac700 1 -- 172.21.15.8:0/4202233181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bbc0b1cb0 con 0x7f6bbc06ca50 2022-09-20T20:14:01.758 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6baa7fc700 1 -- 172.21.15.8:0/4202233181 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac0072d0 con 0x7f6bbc06ca50 2022-09-20T20:14:01.758 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.730+0000 7f6bc3dac700 1 -- 172.21.15.8:0/4202233181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc0b2270 con 0x7f6bbc06ca50 2022-09-20T20:14:01.759 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.731+0000 7f6bc3dac700 1 -- 172.21.15.8:0/4202233181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bbc06ac00 con 0x7f6bbc06ca50 2022-09-20T20:14:01.759 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.732+0000 7f6baa7fc700 1 -- 172.21.15.8:0/4202233181 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 83870+0+0 (secure 0 0 0) 0x7f6bac019030 con 0x7f6bbc06ca50 2022-09-20T20:14:01.760 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.732+0000 7f6baa7fc700 1 --2- 172.21.15.8:0/4202233181 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f6b9c065a00 0x7f6b9c067eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:01.760 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.732+0000 7f6baa7fc700 1 -- 172.21.15.8:0/4202233181 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6bac0816e0 con 0x7f6bbc06ca50 2022-09-20T20:14:01.760 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.732+0000 7f6bc1347700 1 --2- 172.21.15.8:0/4202233181 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f6b9c065a00 0x7f6b9c067eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:01.760 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.733+0000 7f6bc1347700 1 --2- 172.21.15.8:0/4202233181 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f6b9c065a00 0x7f6b9c067eb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc160170 tx=0x7f6bb8009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:01.760 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.736+0000 7f6baa7fc700 1 -- 172.21.15.8:0/4202233181 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7f6bac04aa60 con 0x7f6bbc06ca50 2022-09-20T20:14:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.930+0000 7f6bc3dac700 1 -- 172.21.15.8:0/4202233181 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6bbc0cf320 con 0x7f6bbc06ca50 2022-09-20T20:14:01.932 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.930+0000 7f6baa7fc700 1 -- 172.21.15.8:0/4202233181 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6bac017070 con 0x7f6bbc06ca50 2022-09-20T20:14:01.933 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2022-09-20T20:14:01.934 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.932+0000 7f6bc3dac700 1 -- 172.21.15.8:0/4202233181 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f6b9c065a00 msgr2=0x7f6b9c067eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.935 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.932+0000 7f6bc3dac700 1 --2- 172.21.15.8:0/4202233181 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f6b9c065a00 0x7f6b9c067eb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc160170 tx=0x7f6bb8009210 comp rx=0 tx=0).stop 2022-09-20T20:14:01.935 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.932+0000 7f6bc3dac700 1 -- 172.21.15.8:0/4202233181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bbc06ca50 msgr2=0x7f6bbc154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:01.935 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.932+0000 7f6bc3dac700 1 --2- 172.21.15.8:0/4202233181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bbc06ca50 0x7f6bbc154d30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00c420 tx=0x7f6bac00c730 comp rx=0 tx=0).stop 2022-09-20T20:14:01.935 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.933+0000 7f6bc3dac700 1 -- 172.21.15.8:0/4202233181 shutdown_connections 2022-09-20T20:14:01.935 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.933+0000 7f6bc3dac700 1 --2- 172.21.15.8:0/4202233181 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f6b9c065a00 0x7f6b9c067eb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.936 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.933+0000 7f6bc3dac700 1 --2- 172.21.15.8:0/4202233181 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6bbc06ca50 0x7f6bbc154d30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.936 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.933+0000 7f6bc3dac700 1 --2- 172.21.15.8:0/4202233181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6bbc15b520 0x7f6bbc0ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.936 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.933+0000 7f6bc3dac700 1 --2- 172.21.15.8:0/4202233181 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6bbc070140 0x7f6bbc0b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:01.937 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.933+0000 7f6bc3dac700 1 -- 172.21.15.8:0/4202233181 >> 172.21.15.8:0/4202233181 conn(0x7f6bbc06e8c0 msgr2=0x7f6bbc159560 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:01.937 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.933+0000 7f6bc3dac700 1 -- 172.21.15.8:0/4202233181 shutdown_connections 2022-09-20T20:14:01.937 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:01.933+0000 7f6bc3dac700 1 -- 172.21.15.8:0/4202233181 wait complete. 2022-09-20T20:14:01.946 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-20T20:14:02.074 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.072+0000 7f84459a0700 1 Processor -- start 2022-09-20T20:14:02.075 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.072+0000 7f84459a0700 1 -- start start 2022-09-20T20:14:02.081 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.073+0000 7f84459a0700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f844015b1d0 0x7f84400cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.082 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.073+0000 7f84459a0700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f844006ffd0 0x7f844015edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.082 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.073+0000 7f84459a0700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f844006a4a0 con 0x7f844006c340 2022-09-20T20:14:02.082 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.073+0000 7f84459a0700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8440069ee0 con 0x7f844006ffd0 2022-09-20T20:14:02.082 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.073+0000 7f84459a0700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844006a1c0 con 0x7f844015b1d0 2022-09-20T20:14:02.083 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.073+0000 7f843e7fc700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f844006c340 0x7f844006f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41248/0 (socket says 172.21.15.8:41248) 2022-09-20T20:14:02.083 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.073+0000 7f843e7fc700 1 -- 172.21.15.8:0/2231954643 learned_addr learned my addr 172.21.15.8:0/2231954643 (peer_addr_for_me v1:172.21.15.8:0/0) 2022-09-20T20:14:02.083 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.074+0000 7f843effd700 1 --2- 172.21.15.8:0/2231954643 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f844015b1d0 0x7f84400cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.083 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.074+0000 7f843f7fe700 1 --2- 172.21.15.8:0/2231954643 >> v2:172.21.15.55:3300/0 conn(0x7f844006ffd0 0x7f844015edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.083 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.074+0000 7f843dffb700 1 -- 172.21.15.8:0/2231954643 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985336212 0 0) 0x7f844006a4a0 con 0x7f844006c340 2022-09-20T20:14:02.084 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.074+0000 7f843dffb700 1 -- 172.21.15.8:0/2231954643 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f842c0035b0 con 0x7f844006c340 2022-09-20T20:14:02.084 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.074+0000 7f843dffb700 1 -- 172.21.15.8:0/2231954643 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2259603660 0 0) 0x7f842c0035b0 con 0x7f844006c340 2022-09-20T20:14:02.084 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.074+0000 7f843f7fe700 1 -- 172.21.15.8:0/2231954643 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f844015b1d0 msgr2=0x7f84400cd740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:02.084 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.074+0000 7f843f7fe700 1 --2- 172.21.15.8:0/2231954643 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f844015b1d0 0x7f84400cd740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.085 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.074+0000 7f843f7fe700 1 -- 172.21.15.8:0/2231954643 >> v1:172.21.15.8:6789/0 conn(0x7f844006c340 legacy=0x7f844006f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:02.085 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.074+0000 7f843f7fe700 1 -- 172.21.15.8:0/2231954643 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84400cbc20 con 0x7f844006ffd0 2022-09-20T20:14:02.085 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.074+0000 7f843f7fe700 1 --2- 172.21.15.8:0/2231954643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f844006ffd0 0x7f844015edf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8438009d90 tx=0x7f843800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad11a2590d2f3771 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:02.085 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.074+0000 7f843dffb700 1 -- 172.21.15.8:0/2231954643 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843800e070 con 0x7f844006ffd0 2022-09-20T20:14:02.086 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.074+0000 7f843dffb700 1 -- 172.21.15.8:0/2231954643 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8438003a20 con 0x7f844006ffd0 2022-09-20T20:14:02.086 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.074+0000 7f843dffb700 1 -- 172.21.15.8:0/2231954643 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8434001670 con 0x7f844006ffd0 2022-09-20T20:14:02.086 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.075+0000 7f84459a0700 1 -- 172.21.15.8:0/2231954643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f844006ffd0 msgr2=0x7f844015edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:02.086 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.075+0000 7f84459a0700 1 --2- 172.21.15.8:0/2231954643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f844006ffd0 0x7f844015edf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8438009d90 tx=0x7f843800b330 comp rx=0 tx=0).stop 2022-09-20T20:14:02.086 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.075+0000 7f84459a0700 1 -- 172.21.15.8:0/2231954643 shutdown_connections 2022-09-20T20:14:02.087 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.075+0000 7f84459a0700 1 --2- 172.21.15.8:0/2231954643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f844006ffd0 0x7f844015edf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.087 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.075+0000 7f84459a0700 1 --2- 172.21.15.8:0/2231954643 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f844015b1d0 0x7f84400cd740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.087 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.075+0000 7f84459a0700 1 -- 172.21.15.8:0/2231954643 >> 172.21.15.8:0/2231954643 conn(0x7f84400cdf20 msgr2=0x7f84400ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:02.087 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.075+0000 7f84459a0700 1 -- 172.21.15.8:0/2231954643 shutdown_connections 2022-09-20T20:14:02.088 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.075+0000 7f84459a0700 1 -- 172.21.15.8:0/2231954643 wait complete. 2022-09-20T20:14:02.088 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.076+0000 7f84459a0700 1 Processor -- start 2022-09-20T20:14:02.088 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.076+0000 7f84459a0700 1 -- start start 2022-09-20T20:14:02.088 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.077+0000 7f84459a0700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f844006c340 0x7f84400ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.088 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.077+0000 7f84459a0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f844006ffd0 0x7f84400abb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.089 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.077+0000 7f84459a0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f844015b1d0 0x7f8440150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.089 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.077+0000 7f84459a0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84400acf60 con 0x7f844006ffd0 2022-09-20T20:14:02.089 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.077+0000 7f84459a0700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84400ac0b0 con 0x7f844015b1d0 2022-09-20T20:14:02.089 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.077+0000 7f84459a0700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84400ac350 con 0x7f844006c340 2022-09-20T20:14:02.090 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.077+0000 7f843e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f844006ffd0 0x7f84400abb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.090 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.077+0000 7f843e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f844006ffd0 0x7f84400abb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58456/0 (socket says 172.21.15.8:58456) 2022-09-20T20:14:02.090 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.077+0000 7f843e7fc700 1 -- 172.21.15.8:0/1272732267 learned_addr learned my addr 172.21.15.8:0/1272732267 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:14:02.090 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.077+0000 7f843f7fe700 1 --2- 172.21.15.8:0/1272732267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f844015b1d0 0x7f8440150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.091 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.078+0000 7f843e7fc700 1 -- 172.21.15.8:0/1272732267 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f844006c340 msgr2=0x7f84400ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:02.091 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.078+0000 7f843e7fc700 1 --2- 172.21.15.8:0/1272732267 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f844006c340 0x7f84400ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.091 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.078+0000 7f843e7fc700 1 -- 172.21.15.8:0/1272732267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f844015b1d0 msgr2=0x7f8440150800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:02.091 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.078+0000 7f843e7fc700 1 --2- 172.21.15.8:0/1272732267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f844015b1d0 0x7f8440150800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.091 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.078+0000 7f843e7fc700 1 -- 172.21.15.8:0/1272732267 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8438009a70 con 0x7f844006ffd0 2022-09-20T20:14:02.092 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.078+0000 7f843e7fc700 1 --2- 172.21.15.8:0/1272732267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f844006ffd0 0x7f84400abb70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f843400c750 tx=0x7f843400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:02.092 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.078+0000 7f8427fff700 1 -- 172.21.15.8:0/1272732267 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8434004c80 con 0x7f844006ffd0 2022-09-20T20:14:02.092 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.078+0000 7f8427fff700 1 -- 172.21.15.8:0/1272732267 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8434004de0 con 0x7f844006ffd0 2022-09-20T20:14:02.092 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.078+0000 7f8427fff700 1 -- 172.21.15.8:0/1272732267 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84340072d0 con 0x7f844006ffd0 2022-09-20T20:14:02.093 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.078+0000 7f84459a0700 1 -- 172.21.15.8:0/1272732267 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84400ac630 con 0x7f844006ffd0 2022-09-20T20:14:02.093 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.078+0000 7f84459a0700 1 -- 172.21.15.8:0/1272732267 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84400acbf0 con 0x7f844006ffd0 2022-09-20T20:14:02.093 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.079+0000 7f84459a0700 1 -- 172.21.15.8:0/1272732267 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84400ad240 con 0x7f844006ffd0 2022-09-20T20:14:02.094 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.079+0000 7f8427fff700 1 -- 172.21.15.8:0/1272732267 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 83870+0+0 (secure 0 0 0) 0x7f843401a020 con 0x7f844006ffd0 2022-09-20T20:14:02.094 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.080+0000 7f8427fff700 1 --2- 172.21.15.8:0/1272732267 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f8420065a00 0x7f8420067eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.094 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.080+0000 7f8427fff700 1 -- 172.21.15.8:0/1272732267 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f84340822c0 con 0x7f844006ffd0 2022-09-20T20:14:02.094 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.080+0000 7f843effd700 1 --2- 172.21.15.8:0/1272732267 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f8420065a00 0x7f8420067eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.094 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.080+0000 7f843effd700 1 --2- 172.21.15.8:0/1272732267 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f8420065a00 0x7f8420067eb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8430006b20 tx=0x7f8430006ab0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:02.095 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.084+0000 7f8427fff700 1 -- 172.21.15.8:0/1272732267 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7f84340504d0 con 0x7f844006ffd0 2022-09-20T20:14:02.122 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.120+0000 7f8427fff700 1 -- 172.21.15.8:0/1272732267 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7f8434010030 con 0x7f844006ffd0 2022-09-20T20:14:02.322 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.321+0000 7f84459a0700 1 -- 172.21.15.8:0/1272732267 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84400ad0a0 con 0x7f844006ffd0 2022-09-20T20:14:02.323 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.321+0000 7f8427fff700 1 -- 172.21.15.8:0/1272732267 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3518 (secure 0 0 0) 0x7f84400ad0a0 con 0x7f844006ffd0 2022-09-20T20:14:02.324 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:14:02.324 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/3441700654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":3441700654},{"type":"v1","addr":"172.21.15.55:6833","nonce":3441700654}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3181888834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3181888834},{"type":"v1","addr":"172.21.15.55:6835","nonce":3181888834}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/1161920490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":1161920490},{"type":"v1","addr":"172.21.15.8:6835","nonce":1161920490}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/1261071270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":1261071270},{"type":"v1","addr":"172.21.15.8:6837","nonce":1261071270}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2022-09-20T20:14:02.326 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.323+0000 7f84459a0700 1 -- 172.21.15.8:0/1272732267 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f8420065a00 msgr2=0x7f8420067eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:02.326 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.323+0000 7f84459a0700 1 --2- 172.21.15.8:0/1272732267 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f8420065a00 0x7f8420067eb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8430006b20 tx=0x7f8430006ab0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.326 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.323+0000 7f84459a0700 1 -- 172.21.15.8:0/1272732267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f844006ffd0 msgr2=0x7f84400abb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:02.326 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.323+0000 7f84459a0700 1 --2- 172.21.15.8:0/1272732267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f844006ffd0 0x7f84400abb70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f843400c750 tx=0x7f843400ca60 comp rx=0 tx=0).stop 2022-09-20T20:14:02.327 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.323+0000 7f84459a0700 1 -- 172.21.15.8:0/1272732267 shutdown_connections 2022-09-20T20:14:02.327 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.323+0000 7f84459a0700 1 --2- 172.21.15.8:0/1272732267 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f8420065a00 0x7f8420067eb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.327 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.323+0000 7f84459a0700 1 --2- 172.21.15.8:0/1272732267 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f844015b1d0 0x7f8440150800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.327 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.323+0000 7f84459a0700 1 --2- 172.21.15.8:0/1272732267 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f844006c340 0x7f84400ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.327 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.323+0000 7f84459a0700 1 --2- 172.21.15.8:0/1272732267 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f844006ffd0 0x7f84400abb70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.328 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.323+0000 7f84459a0700 1 -- 172.21.15.8:0/1272732267 >> 172.21.15.8:0/1272732267 conn(0x7f84400cdf20 msgr2=0x7f84401587c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:02.328 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.323+0000 7f84459a0700 1 -- 172.21.15.8:0/1272732267 shutdown_connections 2022-09-20T20:14:02.328 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.323+0000 7f84459a0700 1 -- 172.21.15.8:0/1272732267 wait complete. 2022-09-20T20:14:02.328 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 3 2022-09-20T20:14:02.337 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-20T20:14:02.462 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.461+0000 7fd1b69f5700 1 Processor -- start 2022-09-20T20:14:02.463 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.461+0000 7fd1b69f5700 1 -- start start 2022-09-20T20:14:02.469 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.461+0000 7fd1b69f5700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd1b00cd740 0x7fd1b006c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.469 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.461+0000 7fd1b69f5700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b006c880 con 0x7fd1b015b1d0 2022-09-20T20:14:02.470 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.461+0000 7fd1b69f5700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b006a4a0 con 0x7fd1b006ffd0 2022-09-20T20:14:02.470 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.461+0000 7fd1b69f5700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b00cdb60 con 0x7fd1b00cd740 2022-09-20T20:14:02.470 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1affff700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fd1b015b1d0 0x7fd1b006f8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41262/0 (socket says 172.21.15.8:41262) 2022-09-20T20:14:02.470 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1affff700 1 -- 172.21.15.8:0/208058275 learned_addr learned my addr 172.21.15.8:0/208058275 (peer_addr_for_me v1:172.21.15.8:0/0) 2022-09-20T20:14:02.470 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1b4f92700 1 --2- 172.21.15.8:0/208058275 >> v2:172.21.15.55:3300/0 conn(0x7fd1b00cd740 0x7fd1b006c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.471 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1aeffd700 1 -- 172.21.15.8:0/208058275 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3689149296 0 0) 0x7fd1a0001110 con 0x7fd1b015b1d0 2022-09-20T20:14:02.471 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1aeffd700 1 -- 172.21.15.8:0/208058275 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1900035b0 con 0x7fd1b015b1d0 2022-09-20T20:14:02.471 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1aeffd700 1 -- 172.21.15.8:0/208058275 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 290186781 0 0) 0x7fd1900035b0 con 0x7fd1b015b1d0 2022-09-20T20:14:02.471 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1aeffd700 1 -- 172.21.15.8:0/208058275 >> v2:172.21.15.55:3300/0 conn(0x7fd1b00cd740 msgr2=0x7fd1b006c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:02.472 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1aeffd700 1 --2- 172.21.15.8:0/208058275 >> v2:172.21.15.55:3300/0 conn(0x7fd1b00cd740 0x7fd1b006c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.472 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1aeffd700 1 -- 172.21.15.8:0/208058275 >> v1:172.21.15.55:6789/0 conn(0x7fd1b006ffd0 legacy=0x7fd1b015edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:02.472 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1aeffd700 1 -- 172.21.15.8:0/208058275 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b0069ee0 con 0x7fd1b015b1d0 2022-09-20T20:14:02.472 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1aeffd700 1 -- 172.21.15.8:0/208058275 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2564336580 0 0) 0x7fd1a0001800 con 0x7fd1b015b1d0 2022-09-20T20:14:02.472 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1aeffd700 1 -- 172.21.15.8:0/208058275 >> v1:172.21.15.8:6789/0 conn(0x7fd1b015b1d0 legacy=0x7fd1b006f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:02.473 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1aeffd700 1 --2- 172.21.15.8:0/208058275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd190003a00 0x7fd190003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.473 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1aeffd700 1 --2- 172.21.15.8:0/208058275 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd190004850 0x7fd190004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.473 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1aeffd700 1 --2- 172.21.15.8:0/208058275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd190005200 0x7fd19000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.473 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1aeffd700 1 -- 172.21.15.8:0/208058275 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b00cdb60 con 0x7fd190003a00 2022-09-20T20:14:02.474 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1aeffd700 1 -- 172.21.15.8:0/208058275 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19000c110 con 0x7fd190005200 2022-09-20T20:14:02.474 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1aeffd700 1 -- 172.21.15.8:0/208058275 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19000c2d0 con 0x7fd190004850 2022-09-20T20:14:02.474 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1affff700 1 --2- 172.21.15.8:0/208058275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd190003a00 0x7fd190003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.474 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1af7fe700 1 --2- 172.21.15.8:0/208058275 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd190004850 0x7fd190004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.475 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.462+0000 7fd1b4f92700 1 --2- 172.21.15.8:0/208058275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd190005200 0x7fd19000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.475 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.463+0000 7fd1affff700 1 -- 172.21.15.8:0/208058275 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd190004850 msgr2=0x7fd190004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:02.475 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.463+0000 7fd1affff700 1 --2- 172.21.15.8:0/208058275 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd190004850 0x7fd190004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.475 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.463+0000 7fd1affff700 1 -- 172.21.15.8:0/208058275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd190005200 msgr2=0x7fd19000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:02.475 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.463+0000 7fd1affff700 1 --2- 172.21.15.8:0/208058275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd190005200 0x7fd19000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.476 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.463+0000 7fd1b4f92700 1 -- 172.21.15.8:0/208058275 reap_dead start 2022-09-20T20:14:02.476 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.463+0000 7fd1affff700 1 -- 172.21.15.8:0/208058275 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1900035b0 con 0x7fd190003a00 2022-09-20T20:14:02.476 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.463+0000 7fd1affff700 1 --2- 172.21.15.8:0/208058275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd190003a00 0x7fd190003e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000c240 tx=0x7fd190005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f555c1a1cf2676 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:02.476 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.463+0000 7fd1aeffd700 1 -- 172.21.15.8:0/208058275 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0007db0 con 0x7fd190003a00 2022-09-20T20:14:02.476 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.463+0000 7fd1aeffd700 1 -- 172.21.15.8:0/208058275 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a000cd60 con 0x7fd190003a00 2022-09-20T20:14:02.477 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.463+0000 7fd1aeffd700 1 -- 172.21.15.8:0/208058275 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0005b80 con 0x7fd190003a00 2022-09-20T20:14:02.477 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.463+0000 7fd1b69f5700 1 -- 172.21.15.8:0/208058275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd190003a00 msgr2=0x7fd190003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:02.477 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.463+0000 7fd1b69f5700 1 --2- 172.21.15.8:0/208058275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd190003a00 0x7fd190003e10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000c240 tx=0x7fd190005880 comp rx=0 tx=0).stop 2022-09-20T20:14:02.477 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.463+0000 7fd1b69f5700 1 -- 172.21.15.8:0/208058275 shutdown_connections 2022-09-20T20:14:02.478 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.463+0000 7fd1b69f5700 1 --2- 172.21.15.8:0/208058275 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd190003a00 0x7fd190003e10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.478 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.463+0000 7fd1b69f5700 1 -- 172.21.15.8:0/208058275 >> 172.21.15.8:0/208058275 conn(0x7fd1b00cdf20 msgr2=0x7fd1b00ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:02.478 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.463+0000 7fd1b69f5700 1 -- 172.21.15.8:0/208058275 shutdown_connections 2022-09-20T20:14:02.478 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.463+0000 7fd1b69f5700 1 -- 172.21.15.8:0/208058275 wait complete. 2022-09-20T20:14:02.479 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.465+0000 7fd1b69f5700 1 Processor -- start 2022-09-20T20:14:02.479 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.465+0000 7fd1b69f5700 1 -- start start 2022-09-20T20:14:02.479 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1b69f5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd190003a00 0x7fd1b01f19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.479 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1b69f5700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1b0150570 0x7fd1b00ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.479 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1b69f5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1b0156620 0x7fd1b00caec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.480 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1b69f5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b01f1ee0 con 0x7fd1b0156620 2022-09-20T20:14:02.480 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1b69f5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b00cb400 con 0x7fd190003a00 2022-09-20T20:14:02.480 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1b69f5700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b00c8c80 con 0x7fd1b0150570 2022-09-20T20:14:02.480 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1b4f92700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1b0156620 0x7fd1b00caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.481 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1b4f92700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1b0156620 0x7fd1b00caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58480/0 (socket says 172.21.15.8:58480) 2022-09-20T20:14:02.481 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1af7fe700 1 --2- 172.21.15.8:0/297837120 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1b0150570 0x7fd1b00ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.481 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1b4f92700 1 -- 172.21.15.8:0/297837120 learned_addr learned my addr 172.21.15.8:0/297837120 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:14:02.481 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1affff700 1 --2- 172.21.15.8:0/297837120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd190003a00 0x7fd1b01f19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.481 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1b4f92700 1 -- 172.21.15.8:0/297837120 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1b0150570 msgr2=0x7fd1b00ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:02.482 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1b4f92700 1 --2- 172.21.15.8:0/297837120 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1b0150570 0x7fd1b00ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.482 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1b4f92700 1 -- 172.21.15.8:0/297837120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd190003a00 msgr2=0x7fd1b01f19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:02.482 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1b4f92700 1 --2- 172.21.15.8:0/297837120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd190003a00 0x7fd1b01f19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.482 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1b4f92700 1 -- 172.21.15.8:0/297837120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b00c8ed0 con 0x7fd1b0156620 2022-09-20T20:14:02.483 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1af7fe700 1 --2- 172.21.15.8:0/297837120 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1b0150570 0x7fd1b00ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:14:02.483 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1affff700 1 --2- 172.21.15.8:0/297837120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd190003a00 0x7fd1b01f19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:14:02.483 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1b4f92700 1 --2- 172.21.15.8:0/297837120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1b0156620 0x7fd1b00caec0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd1b006f440 tx=0x7fd1a8011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:02.483 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1acff9700 1 -- 172.21.15.8:0/297837120 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a800e040 con 0x7fd1b0156620 2022-09-20T20:14:02.483 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1acff9700 1 -- 172.21.15.8:0/297837120 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a800f040 con 0x7fd1b0156620 2022-09-20T20:14:02.484 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1b69f5700 1 -- 172.21.15.8:0/297837120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b00c91b0 con 0x7fd1b0156620 2022-09-20T20:14:02.484 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1acff9700 1 -- 172.21.15.8:0/297837120 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a800fc70 con 0x7fd1b0156620 2022-09-20T20:14:02.484 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.466+0000 7fd1b69f5700 1 -- 172.21.15.8:0/297837120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b01589c0 con 0x7fd1b0156620 2022-09-20T20:14:02.484 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.467+0000 7fd1b69f5700 1 -- 172.21.15.8:0/297837120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b00cc520 con 0x7fd1b0156620 2022-09-20T20:14:02.484 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.468+0000 7fd1acff9700 1 -- 172.21.15.8:0/297837120 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7fd1a8022460 con 0x7fd1b0156620 2022-09-20T20:14:02.486 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.468+0000 7fd1acff9700 1 --2- 172.21.15.8:0/297837120 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fd194065a50 0x7fd194067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.486 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.468+0000 7fd1acff9700 1 -- 172.21.15.8:0/297837120 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd1a8082cd0 con 0x7fd1b0156620 2022-09-20T20:14:02.486 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.468+0000 7fd1affff700 1 --2- 172.21.15.8:0/297837120 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fd194065a50 0x7fd194067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.486 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.468+0000 7fd1affff700 1 --2- 172.21.15.8:0/297837120 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fd194065a50 0x7fd194067f00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0000c00 tx=0x7fd1a0007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:02.487 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.472+0000 7fd1acff9700 1 -- 172.21.15.8:0/297837120 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7fd1a8050e30 con 0x7fd1b0156620 2022-09-20T20:14:02.666 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.664+0000 7fd1b69f5700 1 -- 172.21.15.8:0/297837120 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1b0072c60 con 0x7fd1b0156620 2022-09-20T20:14:02.667 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.665+0000 7fd1acff9700 1 -- 172.21.15.8:0/297837120 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13613 (secure 0 0 0) 0x7fd1a8054450 con 0x7fd1b0156620 2022-09-20T20:14:02.667 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:14:02.667 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":16,"fsid":"e2fce34f-6561-47ef-8379-911f2b368662","created":"2022-09-20T20:13:47.969272+0000","modified":"2022-09-20T20:14:01.912843+0000","last_up_change":"2022-09-20T20:13:58.804121+0000","last_in_change":"2022-09-20T20:13:50.496167+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-09-20T20:13:59.325616+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2022-09-20T20:13:59.524689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"bd449a06-0637-42f4-9257-e0de045c499e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":99877},{"type":"v1","addr":"172.21.15.8:6817","nonce":99877}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":99877},{"type":"v1","addr":"172.21.15.8:6819","nonce":99877}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":99877},{"type":"v1","addr":"172.21.15.8:6823","nonce":99877}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":99877},{"type":"v1","addr":"172.21.15.8:6821","nonce":99877}]},"public_addr":"172.21.15.8:6817/99877","cluster_addr":"172.21.15.8:6819/99877","heartbeat_back_addr":"172.21.15.8:6823/99877","heartbeat_front_addr":"172.21.15.8:6821/99877","state":["exists","up"]},{"osd":1,"uuid":"db347f63-385a-4b18-85be-65594acb61a9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":99876},{"type":"v1","addr":"172.21.15.8:6809","nonce":99876}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":99876},{"type":"v1","addr":"172.21.15.8:6811","nonce":99876}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":99876},{"type":"v1","addr":"172.21.15.8:6815","nonce":99876}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":99876},{"type":"v1","addr":"172.21.15.8:6813","nonce":99876}]},"public_addr":"172.21.15.8:6809/99876","cluster_addr":"172.21.15.8:6811/99876","heartbeat_back_addr":"172.21.15.8:6815/99876","heartbeat_front_addr":"172.21.15.8:6813/99876","state":["exists","up"]},{"osd":2,"uuid":"296cfab0-d996-45d6-bef0-69c311817ffa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":99875},{"type":"v1","addr":"172.21.15.8:6801","nonce":99875}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":99875},{"type":"v1","addr":"172.21.15.8:6803","nonce":99875}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":99875},{"type":"v1","addr":"172.21.15.8:6807","nonce":99875}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":99875},{"type":"v1","addr":"172.21.15.8:6805","nonce":99875}]},"public_addr":"172.21.15.8:6801/99875","cluster_addr":"172.21.15.8:6803/99875","heartbeat_back_addr":"172.21.15.8:6807/99875","heartbeat_front_addr":"172.21.15.8:6805/99875","state":["exists","up"]},{"osd":3,"uuid":"77dc730e-ac38-4ac5-b821-53bfe07a7bc1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":99886},{"type":"v1","addr":"172.21.15.8:6825","nonce":99886}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":99886},{"type":"v1","addr":"172.21.15.8:6827","nonce":99886}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":99886},{"type":"v1","addr":"172.21.15.8:6831","nonce":99886}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":99886},{"type":"v1","addr":"172.21.15.8:6829","nonce":99886}]},"public_addr":"172.21.15.8:6825/99886","cluster_addr":"172.21.15.8:6827/99886","heartbeat_back_addr":"172.21.15.8:6831/99886","heartbeat_front_addr":"172.21.15.8:6829/99886","state":["exists","up"]},{"osd":4,"uuid":"bbb00f2b-07be-4844-bcce-b60c4c693a0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":100137},{"type":"v1","addr":"172.21.15.55:6817","nonce":100137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":100137},{"type":"v1","addr":"172.21.15.55:6819","nonce":100137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":100137},{"type":"v1","addr":"172.21.15.55:6823","nonce":100137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":100137},{"type":"v1","addr":"172.21.15.55:6821","nonce":100137}]},"public_addr":"172.21.15.55:6817/100137","cluster_addr":"172.21.15.55:6819/100137","heartbeat_back_addr":"172.21.15.55:6823/100137","heartbeat_front_addr":"172.21.15.55:6821/100137","state":["exists","up"]},{"osd":5,"uuid":"dad61efb-3c40-4377-ba3d-df1ea6996dec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":100136},{"type":"v1","addr":"172.21.15.55:6825","nonce":100136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":100136},{"type":"v1","addr":"172.21.15.55:6827","nonce":100136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":100136},{"type":"v1","addr":"172.21.15.55:6831","nonce":100136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":100136},{"type":"v1","addr":"172.21.15.55:6829","nonce":100136}]},"public_addr":"172.21.15.55:6825/100136","cluster_addr":"172.21.15.55:6827/100136","heartbeat_back_addr":"172.21.15.55:6831/100136","heartbeat_front_addr":"172.21.15.55:6829/100136","state":["exists","up"]},{"osd":6,"uuid":"6b9de588-7ec2-4466-a4a8-561d80a92f5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":100130},{"type":"v1","addr":"172.21.15.55:6801","nonce":100130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":100130},{"type":"v1","addr":"172.21.15.55:6803","nonce":100130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":100130},{"type":"v1","addr":"172.21.15.55:6807","nonce":100130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":100130},{"type":"v1","addr":"172.21.15.55:6805","nonce":100130}]},"public_addr":"172.21.15.55:6801/100130","cluster_addr":"172.21.15.55:6803/100130","heartbeat_back_addr":"172.21.15.55:6807/100130","heartbeat_front_addr":"172.21.15.55:6805/100130","state":["exists","up"]},{"osd":7,"uuid":"e9fbcb44-5753-4b0f-9136-007a17bc8157","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":100131},{"type":"v1","addr":"172.21.15.55:6809","nonce":100131}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":100131},{"type":"v1","addr":"172.21.15.55:6811","nonce":100131}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":100131},{"type":"v1","addr":"172.21.15.55:6815","nonce":100131}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":100131},{"type":"v1","addr":"172.21.15.55:6813","nonce":100131}]},"public_addr":"172.21.15.55:6809/100131","cluster_addr":"172.21.15.55:6811/100131","heartbeat_back_addr":"172.21.15.55:6815/100131","heartbeat_front_addr":"172.21.15.55:6813/100131","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:13:55.674691+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:13:55.629207+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:13:55.612346+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:13:55.668154+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:13:55.723147+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:13:55.668202+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:13:55.596313+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:13:55.741167+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-20T20:14:02.669 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.667+0000 7fd1b69f5700 1 -- 172.21.15.8:0/297837120 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fd194065a50 msgr2=0x7fd194067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:02.669 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.667+0000 7fd1b69f5700 1 --2- 172.21.15.8:0/297837120 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fd194065a50 0x7fd194067f00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0000c00 tx=0x7fd1a0007000 comp rx=0 tx=0).stop 2022-09-20T20:14:02.669 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.667+0000 7fd1b69f5700 1 -- 172.21.15.8:0/297837120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1b0156620 msgr2=0x7fd1b00caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:02.670 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.667+0000 7fd1b69f5700 1 --2- 172.21.15.8:0/297837120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1b0156620 0x7fd1b00caec0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd1b006f440 tx=0x7fd1a8011ed0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.670 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.667+0000 7fd1b69f5700 1 -- 172.21.15.8:0/297837120 shutdown_connections 2022-09-20T20:14:02.670 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.667+0000 7fd1b69f5700 1 --2- 172.21.15.8:0/297837120 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fd194065a50 0x7fd194067f00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.670 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.667+0000 7fd1b69f5700 1 --2- 172.21.15.8:0/297837120 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd1b0156620 0x7fd1b00caec0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.671 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.667+0000 7fd1b69f5700 1 --2- 172.21.15.8:0/297837120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd190003a00 0x7fd1b01f19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.671 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.667+0000 7fd1b69f5700 1 --2- 172.21.15.8:0/297837120 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1b0150570 0x7fd1b00ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.671 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.667+0000 7fd1b69f5700 1 -- 172.21.15.8:0/297837120 >> 172.21.15.8:0/297837120 conn(0x7fd1b00cdf20 msgr2=0x7fd1b00b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:02.671 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.667+0000 7fd1b69f5700 1 -- 172.21.15.8:0/297837120 shutdown_connections 2022-09-20T20:14:02.671 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.667+0000 7fd1b69f5700 1 -- 172.21.15.8:0/297837120 wait complete. 2022-09-20T20:14:02.681 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2022-09-20T20:13:59.325616+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2022-09-20T20:13:59.524689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2022-09-20T20:14:02.682 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-09-20T20:14:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.809+0000 7fdf34352700 1 Processor -- start 2022-09-20T20:14:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.809+0000 7fdf34352700 1 -- start start 2022-09-20T20:14:02.822 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.810+0000 7fdf34352700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdf2c0b0de0 0x7fdf2c070610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.822 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.810+0000 7fdf34352700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdf2c0b0880 0x7fdf2c157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.823 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.810+0000 7fdf34352700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2c06ca50 con 0x7fdf2c0b04b0 2022-09-20T20:14:02.823 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.810+0000 7fdf34352700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2c06cf80 con 0x7fdf2c0b0de0 2022-09-20T20:14:02.823 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.810+0000 7fdf34352700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2c0ccf60 con 0x7fdf2c0b0880 2022-09-20T20:14:02.824 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.810+0000 7fdf318ed700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdf2c0b0de0 0x7fdf2c070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.824 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.810+0000 7fdf318ed700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fdf2c0b0de0 0x7fdf2c070610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58486/0 (socket says 172.21.15.8:58486) 2022-09-20T20:14:02.825 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.810+0000 7fdf318ed700 1 -- 172.21.15.8:0/1910151358 learned_addr learned my addr 172.21.15.8:0/1910151358 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:14:02.825 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.810+0000 7fdf328ef700 1 --2- 172.21.15.8:0/1910151358 >> v2:172.21.15.55:3300/0 conn(0x7fdf2c0b0880 0x7fdf2c157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.826 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.810+0000 7fdf318ed700 1 -- 172.21.15.8:0/1910151358 >> v2:172.21.15.55:3300/0 conn(0x7fdf2c0b0880 msgr2=0x7fdf2c157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:02.826 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.810+0000 7fdf318ed700 1 --2- 172.21.15.8:0/1910151358 >> v2:172.21.15.55:3300/0 conn(0x7fdf2c0b0880 0x7fdf2c157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.827 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.810+0000 7fdf318ed700 1 -- 172.21.15.8:0/1910151358 >> v1:172.21.15.55:6789/0 conn(0x7fdf2c0b04b0 legacy=0x7fdf2c0cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:02.827 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.810+0000 7fdf318ed700 1 -- 172.21.15.8:0/1910151358 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c0adc10 con 0x7fdf2c0b0de0 2022-09-20T20:14:02.827 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.811+0000 7fdf318ed700 1 --2- 172.21.15.8:0/1910151358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf2c0b0de0 0x7fdf2c070610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0ce750 tx=0x7fdf2800be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11f0945b4ba952c server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:02.828 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.811+0000 7fdf310ec700 1 -- 172.21.15.8:0/1910151358 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2800dcf0 con 0x7fdf2c0b0de0 2022-09-20T20:14:02.828 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.811+0000 7fdf310ec700 1 -- 172.21.15.8:0/1910151358 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2800de50 con 0x7fdf2c0b0de0 2022-09-20T20:14:02.829 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.811+0000 7fdf310ec700 1 -- 172.21.15.8:0/1910151358 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28004250 con 0x7fdf2c0b0de0 2022-09-20T20:14:02.829 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.811+0000 7fdf34352700 1 -- 172.21.15.8:0/1910151358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf2c0b0de0 msgr2=0x7fdf2c070610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:02.829 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.811+0000 7fdf34352700 1 --2- 172.21.15.8:0/1910151358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf2c0b0de0 0x7fdf2c070610 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0ce750 tx=0x7fdf2800be70 comp rx=0 tx=0).stop 2022-09-20T20:14:02.830 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.811+0000 7fdf34352700 1 -- 172.21.15.8:0/1910151358 shutdown_connections 2022-09-20T20:14:02.830 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.811+0000 7fdf34352700 1 --2- 172.21.15.8:0/1910151358 >> v2:172.21.15.55:3300/0 conn(0x7fdf2c0b0880 0x7fdf2c157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.831 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.811+0000 7fdf34352700 1 --2- 172.21.15.8:0/1910151358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf2c0b0de0 0x7fdf2c070610 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.831 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.811+0000 7fdf34352700 1 -- 172.21.15.8:0/1910151358 >> 172.21.15.8:0/1910151358 conn(0x7fdf2c06e8c0 msgr2=0x7fdf2c06c220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:02.832 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.811+0000 7fdf34352700 1 -- 172.21.15.8:0/1910151358 shutdown_connections 2022-09-20T20:14:02.832 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.811+0000 7fdf34352700 1 -- 172.21.15.8:0/1910151358 wait complete. 2022-09-20T20:14:02.832 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.813+0000 7fdf34352700 1 Processor -- start 2022-09-20T20:14:02.833 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.813+0000 7fdf34352700 1 -- start start 2022-09-20T20:14:02.833 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.813+0000 7fdf34352700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf2c0b04b0 0x7fdf2c14edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.834 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.813+0000 7fdf34352700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf2c0b0880 0x7fdf2c0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.834 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.813+0000 7fdf34352700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf2c0b0de0 0x7fdf2c153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.835 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.813+0000 7fdf34352700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c14f330 con 0x7fdf2c0b0880 2022-09-20T20:14:02.835 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.813+0000 7fdf34352700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0b3610 con 0x7fdf2c0b0de0 2022-09-20T20:14:02.835 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.813+0000 7fdf34352700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0b3fe0 con 0x7fdf2c0b04b0 2022-09-20T20:14:02.836 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.813+0000 7fdf318ed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf2c0b0880 0x7fdf2c0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.837 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.814+0000 7fdf318ed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf2c0b0880 0x7fdf2c0b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58492/0 (socket says 172.21.15.8:58492) 2022-09-20T20:14:02.837 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.814+0000 7fdf318ed700 1 -- 172.21.15.8:0/3703111679 learned_addr learned my addr 172.21.15.8:0/3703111679 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:14:02.838 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.814+0000 7fdf320ee700 1 --2- 172.21.15.8:0/3703111679 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf2c0b04b0 0x7fdf2c14edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.839 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.814+0000 7fdf328ef700 1 --2- 172.21.15.8:0/3703111679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf2c0b0de0 0x7fdf2c153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.839 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.814+0000 7fdf318ed700 1 -- 172.21.15.8:0/3703111679 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf2c0b04b0 msgr2=0x7fdf2c14edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:02.840 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.814+0000 7fdf318ed700 1 --2- 172.21.15.8:0/3703111679 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf2c0b04b0 0x7fdf2c14edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.840 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.814+0000 7fdf318ed700 1 -- 172.21.15.8:0/3703111679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf2c0b0de0 msgr2=0x7fdf2c153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:02.841 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.814+0000 7fdf318ed700 1 --2- 172.21.15.8:0/3703111679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf2c0b0de0 0x7fdf2c153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:02.841 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.814+0000 7fdf318ed700 1 -- 172.21.15.8:0/3703111679 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2800b7f0 con 0x7fdf2c0b0880 2022-09-20T20:14:02.842 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.814+0000 7fdf318ed700 1 --2- 172.21.15.8:0/3703111679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf2c0b0880 0x7fdf2c0b3aa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdf28000c00 tx=0x7fdf28004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:02.842 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.814+0000 7fdf1affd700 1 -- 172.21.15.8:0/3703111679 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28020070 con 0x7fdf2c0b0880 2022-09-20T20:14:02.842 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.814+0000 7fdf1affd700 1 -- 172.21.15.8:0/3703111679 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf28004030 con 0x7fdf2c0b0880 2022-09-20T20:14:02.843 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.814+0000 7fdf34352700 1 -- 172.21.15.8:0/3703111679 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2c0b2a00 con 0x7fdf2c0b0880 2022-09-20T20:14:02.843 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.814+0000 7fdf1affd700 1 -- 172.21.15.8:0/3703111679 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28010470 con 0x7fdf2c0b0880 2022-09-20T20:14:02.844 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.814+0000 7fdf34352700 1 -- 172.21.15.8:0/3703111679 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2c0b2fc0 con 0x7fdf2c0b0880 2022-09-20T20:14:02.844 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.815+0000 7fdf34352700 1 -- 172.21.15.8:0/3703111679 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf2c0b3780 con 0x7fdf2c0b0880 2022-09-20T20:14:02.845 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.815+0000 7fdf1affd700 1 -- 172.21.15.8:0/3703111679 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7fdf280193f0 con 0x7fdf2c0b0880 2022-09-20T20:14:02.845 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.816+0000 7fdf1affd700 1 --2- 172.21.15.8:0/3703111679 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fdf0c065a50 0x7fdf0c067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:02.846 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.816+0000 7fdf1affd700 1 -- 172.21.15.8:0/3703111679 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fdf28085c50 con 0x7fdf2c0b0880 2022-09-20T20:14:02.846 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.816+0000 7fdf320ee700 1 --2- 172.21.15.8:0/3703111679 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fdf0c065a50 0x7fdf0c067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:02.846 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.816+0000 7fdf320ee700 1 --2- 172.21.15.8:0/3703111679 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fdf0c065a50 0x7fdf0c067f00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c007fd0 tx=0x7fdf1c007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:02.847 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:02.820+0000 7fdf1affd700 1 -- 172.21.15.8:0/3703111679 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7fdf28053db0 con 0x7fdf2c0b0880 2022-09-20T20:14:03.012 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.010+0000 7fdf34352700 1 -- 172.21.15.8:0/3703111679 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdf2c072c60 con 0x7fdf2c0b0880 2022-09-20T20:14:03.012 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.010+0000 7fdf1affd700 1 -- 172.21.15.8:0/3703111679 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdf280573d0 con 0x7fdf2c0b0880 2022-09-20T20:14:03.012 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 8 2022-09-20T20:14:03.015 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.013+0000 7fdf34352700 1 -- 172.21.15.8:0/3703111679 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fdf0c065a50 msgr2=0x7fdf0c067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.015 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.013+0000 7fdf34352700 1 --2- 172.21.15.8:0/3703111679 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fdf0c065a50 0x7fdf0c067f00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c007fd0 tx=0x7fdf1c007ec0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.015 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.013+0000 7fdf34352700 1 -- 172.21.15.8:0/3703111679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf2c0b0880 msgr2=0x7fdf2c0b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.015 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.013+0000 7fdf34352700 1 --2- 172.21.15.8:0/3703111679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf2c0b0880 0x7fdf2c0b3aa0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fdf28000c00 tx=0x7fdf28004750 comp rx=0 tx=0).stop 2022-09-20T20:14:03.016 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.013+0000 7fdf34352700 1 -- 172.21.15.8:0/3703111679 shutdown_connections 2022-09-20T20:14:03.016 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.013+0000 7fdf34352700 1 --2- 172.21.15.8:0/3703111679 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fdf0c065a50 0x7fdf0c067f00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.016 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.013+0000 7fdf34352700 1 --2- 172.21.15.8:0/3703111679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf2c0b0de0 0x7fdf2c153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.017 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.013+0000 7fdf34352700 1 --2- 172.21.15.8:0/3703111679 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf2c0b04b0 0x7fdf2c14edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.017 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.013+0000 7fdf34352700 1 --2- 172.21.15.8:0/3703111679 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf2c0b0880 0x7fdf2c0b3aa0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.018 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.013+0000 7fdf34352700 1 -- 172.21.15.8:0/3703111679 >> 172.21.15.8:0/3703111679 conn(0x7fdf2c06e8c0 msgr2=0x7fdf2c0ae220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:03.018 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.013+0000 7fdf34352700 1 -- 172.21.15.8:0/3703111679 shutdown_connections 2022-09-20T20:14:03.019 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.013+0000 7fdf34352700 1 -- 172.21.15.8:0/3703111679 wait complete. 2022-09-20T20:14:03.027 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-09-20T20:14:03.154 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.152+0000 7fc2182a5700 1 Processor -- start 2022-09-20T20:14:03.155 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.152+0000 7fc2182a5700 1 -- start start 2022-09-20T20:14:03.162 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.153+0000 7fc2182a5700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc210157a50 0x7fc2100c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.162 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.153+0000 7fc2182a5700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc21006fed0 0x7fc2100c9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.162 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.153+0000 7fc2182a5700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc21006c640 con 0x7fc210157680 2022-09-20T20:14:03.162 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.153+0000 7fc2182a5700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc21006c920 con 0x7fc21006fed0 2022-09-20T20:14:03.163 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.153+0000 7fc2182a5700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2100cc620 con 0x7fc210157a50 2022-09-20T20:14:03.163 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.153+0000 7fc216041700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fc210157680 0x7fc21006f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41296/0 (socket says 172.21.15.8:41296) 2022-09-20T20:14:03.163 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.153+0000 7fc216041700 1 -- 172.21.15.8:0/715852473 learned_addr learned my addr 172.21.15.8:0/715852473 (peer_addr_for_me v1:172.21.15.8:0/0) 2022-09-20T20:14:03.163 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc216842700 1 --2- 172.21.15.8:0/715852473 >> v2:172.21.15.55:3300/0 conn(0x7fc21006fed0 0x7fc2100c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.164 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc215840700 1 --2- 172.21.15.8:0/715852473 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc210157a50 0x7fc2100c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.164 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc21503f700 1 -- 172.21.15.8:0/715852473 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747930865 0 0) 0x7fc21006c640 con 0x7fc210157680 2022-09-20T20:14:03.164 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc21503f700 1 -- 172.21.15.8:0/715852473 --> v1:172.21.15.8:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1f80035b0 con 0x7fc210157680 2022-09-20T20:14:03.164 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc21503f700 1 -- 172.21.15.8:0/715852473 <== mon.0 v1:172.21.15.8:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3882252854 0 0) 0x7fc1f80035b0 con 0x7fc210157680 2022-09-20T20:14:03.165 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc21503f700 1 -- 172.21.15.8:0/715852473 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc210157a50 msgr2=0x7fc2100c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:03.165 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc21503f700 1 --2- 172.21.15.8:0/715852473 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc210157a50 0x7fc2100c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.165 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc21503f700 1 -- 172.21.15.8:0/715852473 >> v2:172.21.15.55:3300/0 conn(0x7fc21006fed0 msgr2=0x7fc2100c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:03.165 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc21503f700 1 --2- 172.21.15.8:0/715852473 >> v2:172.21.15.55:3300/0 conn(0x7fc21006fed0 0x7fc2100c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.166 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc21503f700 1 -- 172.21.15.8:0/715852473 --> v1:172.21.15.8:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2100cc900 con 0x7fc210157680 2022-09-20T20:14:03.166 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc21503f700 1 -- 172.21.15.8:0/715852473 <== mon.0 v1:172.21.15.8:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2564336580 0 0) 0x7fc200001670 con 0x7fc210157680 2022-09-20T20:14:03.167 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc21503f700 1 -- 172.21.15.8:0/715852473 >> v1:172.21.15.8:6789/0 conn(0x7fc210157680 legacy=0x7fc21006f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.167 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc21503f700 1 --2- 172.21.15.8:0/715852473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f8003a00 0x7fc1f8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.168 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc21503f700 1 --2- 172.21.15.8:0/715852473 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc210157a50 0x7fc1f8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.168 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc21503f700 1 --2- 172.21.15.8:0/715852473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1f8004d90 0x7fc1f8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.169 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc21503f700 1 -- 172.21.15.8:0/715852473 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21006c920 con 0x7fc1f8004d90 2022-09-20T20:14:03.169 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc21503f700 1 -- 172.21.15.8:0/715852473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2100cc620 con 0x7fc1f8003a00 2022-09-20T20:14:03.170 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc21503f700 1 -- 172.21.15.8:0/715852473 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f80059e0 con 0x7fc210157a50 2022-09-20T20:14:03.170 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc216842700 1 --2- 172.21.15.8:0/715852473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1f8004d90 0x7fc1f8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.170 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc216041700 1 --2- 172.21.15.8:0/715852473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f8003a00 0x7fc1f8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.171 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc215840700 1 --2- 172.21.15.8:0/715852473 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc210157a50 0x7fc1f8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.171 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc216842700 1 -- 172.21.15.8:0/715852473 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc210157a50 msgr2=0x7fc1f8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:03.172 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc216842700 1 --2- 172.21.15.8:0/715852473 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc210157a50 0x7fc1f8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.172 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc216842700 1 -- 172.21.15.8:0/715852473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f8003a00 msgr2=0x7fc1f8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:03.173 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc216842700 1 --2- 172.21.15.8:0/715852473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc1f8003a00 0x7fc1f8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.173 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.154+0000 7fc216842700 1 -- 172.21.15.8:0/715852473 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f80035b0 con 0x7fc1f8004d90 2022-09-20T20:14:03.174 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.155+0000 7fc216842700 1 --2- 172.21.15.8:0/715852473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1f8004d90 0x7fc1f8005200 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc208009fc0 tx=0x7fc1f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8252b8ee00c2220 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:03.174 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.155+0000 7fc21503f700 1 -- 172.21.15.8:0/715852473 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20800ebd0 con 0x7fc1f8004d90 2022-09-20T20:14:03.174 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.155+0000 7fc21503f700 1 -- 172.21.15.8:0/715852473 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20800f040 con 0x7fc1f8004d90 2022-09-20T20:14:03.175 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.155+0000 7fc21503f700 1 -- 172.21.15.8:0/715852473 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208014480 con 0x7fc1f8004d90 2022-09-20T20:14:03.175 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.155+0000 7fc2182a5700 1 -- 172.21.15.8:0/715852473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1f8004d90 msgr2=0x7fc1f8005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.176 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.155+0000 7fc2182a5700 1 --2- 172.21.15.8:0/715852473 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1f8004d90 0x7fc1f8005200 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc208009fc0 tx=0x7fc1f8005880 comp rx=0 tx=0).stop 2022-09-20T20:14:03.176 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.155+0000 7fc216842700 1 -- 172.21.15.8:0/715852473 reap_dead start 2022-09-20T20:14:03.177 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.155+0000 7fc2182a5700 1 -- 172.21.15.8:0/715852473 shutdown_connections 2022-09-20T20:14:03.177 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.155+0000 7fc2182a5700 1 -- 172.21.15.8:0/715852473 >> 172.21.15.8:0/715852473 conn(0x7fc2100ca9b0 msgr2=0x7fc2100cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:03.177 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.155+0000 7fc2182a5700 1 -- 172.21.15.8:0/715852473 shutdown_connections 2022-09-20T20:14:03.178 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.155+0000 7fc2182a5700 1 -- 172.21.15.8:0/715852473 wait complete. 2022-09-20T20:14:03.178 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.157+0000 7fc2182a5700 1 Processor -- start 2022-09-20T20:14:03.179 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.157+0000 7fc2182a5700 1 -- start start 2022-09-20T20:14:03.179 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.157+0000 7fc2182a5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1f8004d90 0x7fc21014d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.179 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.157+0000 7fc2182a5700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2101544d0 0x7fc2100c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.180 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.157+0000 7fc2182a5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2100c5fc0 0x7fc2101e0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.180 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.157+0000 7fc2182a5700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21014d890 con 0x7fc1f8004d90 2022-09-20T20:14:03.181 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.157+0000 7fc2182a5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2100c7d80 con 0x7fc2100c5fc0 2022-09-20T20:14:03.181 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.157+0000 7fc2182a5700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2100c67a0 con 0x7fc2101544d0 2022-09-20T20:14:03.181 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.157+0000 7fc216041700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1f8004d90 0x7fc21014d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.182 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.157+0000 7fc216041700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1f8004d90 0x7fc21014d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58510/0 (socket says 172.21.15.8:58510) 2022-09-20T20:14:03.182 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.157+0000 7fc216041700 1 -- 172.21.15.8:0/793162311 learned_addr learned my addr 172.21.15.8:0/793162311 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:14:03.182 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.158+0000 7fc215840700 1 --2- 172.21.15.8:0/793162311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2101544d0 0x7fc2100c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.183 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.158+0000 7fc216842700 1 --2- 172.21.15.8:0/793162311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2100c5fc0 0x7fc2101e0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.183 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.158+0000 7fc216041700 1 -- 172.21.15.8:0/793162311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2101544d0 msgr2=0x7fc2100c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.184 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.158+0000 7fc216041700 1 --2- 172.21.15.8:0/793162311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2101544d0 0x7fc2100c7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.184 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.158+0000 7fc216041700 1 -- 172.21.15.8:0/793162311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2100c5fc0 msgr2=0x7fc2101e0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.184 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.158+0000 7fc216041700 1 --2- 172.21.15.8:0/793162311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2100c5fc0 0x7fc2101e0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.185 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.158+0000 7fc216041700 1 -- 172.21.15.8:0/793162311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2100c6a80 con 0x7fc1f8004d90 2022-09-20T20:14:03.185 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.158+0000 7fc216041700 1 --2- 172.21.15.8:0/793162311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1f8004d90 0x7fc21014d350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc200000fb0 tx=0x7fc2000075f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:03.186 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.158+0000 7fc1feffd700 1 -- 172.21.15.8:0/793162311 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20000f690 con 0x7fc1f8004d90 2022-09-20T20:14:03.186 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.158+0000 7fc1feffd700 1 -- 172.21.15.8:0/793162311 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc20000f810 con 0x7fc1f8004d90 2022-09-20T20:14:03.186 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.158+0000 7fc2182a5700 1 -- 172.21.15.8:0/793162311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2100c6d60 con 0x7fc1f8004d90 2022-09-20T20:14:03.187 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.158+0000 7fc1feffd700 1 -- 172.21.15.8:0/793162311 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20000fbc0 con 0x7fc1f8004d90 2022-09-20T20:14:03.187 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.158+0000 7fc2182a5700 1 -- 172.21.15.8:0/793162311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2100c7320 con 0x7fc1f8004d90 2022-09-20T20:14:03.188 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.159+0000 7fc2182a5700 1 -- 172.21.15.8:0/793162311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc210072c60 con 0x7fc1f8004d90 2022-09-20T20:14:03.188 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.159+0000 7fc1feffd700 1 -- 172.21.15.8:0/793162311 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7fc20000fd20 con 0x7fc1f8004d90 2022-09-20T20:14:03.188 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.160+0000 7fc1feffd700 1 --2- 172.21.15.8:0/793162311 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fc1f0065a50 0x7fc1f0067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.189 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.160+0000 7fc1feffd700 1 -- 172.21.15.8:0/793162311 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc2000827d0 con 0x7fc1f8004d90 2022-09-20T20:14:03.189 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.160+0000 7fc215840700 1 --2- 172.21.15.8:0/793162311 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fc1f0065a50 0x7fc1f0067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.190 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.160+0000 7fc215840700 1 --2- 172.21.15.8:0/793162311 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fc1f0065a50 0x7fc1f0067f00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc2101e1c20 tx=0x7fc20c009210 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:03.191 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.164+0000 7fc1feffd700 1 -- 172.21.15.8:0/793162311 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7fc200050990 con 0x7fc1f8004d90 2022-09-20T20:14:03.352 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.350+0000 7fc2182a5700 1 -- 172.21.15.8:0/793162311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc2100c8630 con 0x7fc1f8004d90 2022-09-20T20:14:03.353 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.351+0000 7fc1feffd700 1 -- 172.21.15.8:0/793162311 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc200053fb0 con 0x7fc1f8004d90 2022-09-20T20:14:03.353 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2022-09-20T20:14:03.355 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.353+0000 7fc2182a5700 1 -- 172.21.15.8:0/793162311 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fc1f0065a50 msgr2=0x7fc1f0067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.355 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.353+0000 7fc2182a5700 1 --2- 172.21.15.8:0/793162311 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fc1f0065a50 0x7fc1f0067f00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc2101e1c20 tx=0x7fc20c009210 comp rx=0 tx=0).stop 2022-09-20T20:14:03.356 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.353+0000 7fc2182a5700 1 -- 172.21.15.8:0/793162311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1f8004d90 msgr2=0x7fc21014d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.356 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.353+0000 7fc2182a5700 1 --2- 172.21.15.8:0/793162311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1f8004d90 0x7fc21014d350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc200000fb0 tx=0x7fc2000075f0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.357 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.353+0000 7fc2182a5700 1 -- 172.21.15.8:0/793162311 shutdown_connections 2022-09-20T20:14:03.357 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.353+0000 7fc2182a5700 1 --2- 172.21.15.8:0/793162311 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fc1f0065a50 0x7fc1f0067f00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.358 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.353+0000 7fc2182a5700 1 --2- 172.21.15.8:0/793162311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1f8004d90 0x7fc21014d350 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.358 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.353+0000 7fc2182a5700 1 --2- 172.21.15.8:0/793162311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2100c5fc0 0x7fc2101e0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.359 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.353+0000 7fc2182a5700 1 --2- 172.21.15.8:0/793162311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2101544d0 0x7fc2100c7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.359 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.353+0000 7fc2182a5700 1 -- 172.21.15.8:0/793162311 >> 172.21.15.8:0/793162311 conn(0x7fc2100ca9b0 msgr2=0x7fc2100699b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:03.359 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.353+0000 7fc2182a5700 1 -- 172.21.15.8:0/793162311 shutdown_connections 2022-09-20T20:14:03.359 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.353+0000 7fc2182a5700 1 -- 172.21.15.8:0/793162311 wait complete. 2022-09-20T20:14:03.366 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-09-20T20:14:03.492 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.490+0000 7f02a24e6700 1 Processor -- start 2022-09-20T20:14:03.492 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.490+0000 7f02a24e6700 1 -- start start 2022-09-20T20:14:03.495 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.491+0000 7f02a24e6700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f029c15b630 0x7f029c0b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.496 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.491+0000 7f02a24e6700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f029c0cdb50 0x7f029c15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.496 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.491+0000 7f02a24e6700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029c06b7b0 con 0x7f029c069ca0 2022-09-20T20:14:03.496 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.491+0000 7f02a24e6700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f029c0b1380 con 0x7f029c0cdb50 2022-09-20T20:14:03.497 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.491+0000 7f02a24e6700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c06ba90 con 0x7f029c15b630 2022-09-20T20:14:03.497 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.491+0000 7f02a0a83700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f029c0cdb50 0x7f029c15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.497 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.491+0000 7f029b7fe700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7f029c069ca0 0x7f029c0cd440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41316/0 (socket says 172.21.15.8:41316) 2022-09-20T20:14:03.497 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.491+0000 7f029b7fe700 1 -- 172.21.15.8:0/868678797 learned_addr learned my addr 172.21.15.8:0/868678797 (peer_addr_for_me v1:172.21.15.8:0/0) 2022-09-20T20:14:03.497 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.491+0000 7f029bfff700 1 --2- 172.21.15.8:0/868678797 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f029c15b630 0x7f029c0b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.498 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.491+0000 7f02a0a83700 1 -- 172.21.15.8:0/868678797 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f029c15b630 msgr2=0x7f029c0b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:03.498 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.491+0000 7f02a0a83700 1 --2- 172.21.15.8:0/868678797 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f029c15b630 0x7f029c0b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.498 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.491+0000 7f02a0a83700 1 -- 172.21.15.8:0/868678797 >> v1:172.21.15.8:6789/0 conn(0x7f029c069ca0 legacy=0x7f029c0cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.499 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.491+0000 7f02a0a83700 1 -- 172.21.15.8:0/868678797 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f029c0b1590 con 0x7f029c0cdb50 2022-09-20T20:14:03.499 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.491+0000 7f029affd700 1 -- 172.21.15.8:0/868678797 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430766048 0 0) 0x7f029c06b7b0 con 0x7f029c069ca0 2022-09-20T20:14:03.499 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.491+0000 7f029bfff700 1 --2- 172.21.15.8:0/868678797 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f029c15b630 0x7f029c0b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-20T20:14:03.501 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.492+0000 7f02a0a83700 1 --2- 172.21.15.8:0/868678797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f029c0cdb50 0x7f029c15ba00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0294009d90 tx=0x7f029400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66391955c479c450 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:03.502 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.492+0000 7f029affd700 1 -- 172.21.15.8:0/868678797 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029400e070 con 0x7f029c0cdb50 2022-09-20T20:14:03.502 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.492+0000 7f029affd700 1 -- 172.21.15.8:0/868678797 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029400bbd0 con 0x7f029c0cdb50 2022-09-20T20:14:03.503 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.492+0000 7f029affd700 1 -- 172.21.15.8:0/868678797 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0294012430 con 0x7f029c0cdb50 2022-09-20T20:14:03.503 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.492+0000 7f02a24e6700 1 -- 172.21.15.8:0/868678797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f029c0cdb50 msgr2=0x7f029c15ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.504 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.492+0000 7f02a24e6700 1 --2- 172.21.15.8:0/868678797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f029c0cdb50 0x7f029c15ba00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0294009d90 tx=0x7f029400b330 comp rx=0 tx=0).stop 2022-09-20T20:14:03.504 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.492+0000 7f02a24e6700 1 -- 172.21.15.8:0/868678797 shutdown_connections 2022-09-20T20:14:03.505 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.492+0000 7f02a24e6700 1 --2- 172.21.15.8:0/868678797 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f029c15b630 0x7f029c0b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.505 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.492+0000 7f02a24e6700 1 --2- 172.21.15.8:0/868678797 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f029c0cdb50 0x7f029c15ba00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.506 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.492+0000 7f02a24e6700 1 -- 172.21.15.8:0/868678797 >> 172.21.15.8:0/868678797 conn(0x7f029c0cf900 msgr2=0x7f029c0cfd00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:03.506 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.492+0000 7f02a24e6700 1 -- 172.21.15.8:0/868678797 shutdown_connections 2022-09-20T20:14:03.506 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.492+0000 7f02a24e6700 1 -- 172.21.15.8:0/868678797 wait complete. 2022-09-20T20:14:03.507 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.494+0000 7f02a24e6700 1 Processor -- start 2022-09-20T20:14:03.507 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.494+0000 7f02a24e6700 1 -- start start 2022-09-20T20:14:03.514 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.494+0000 7f02a24e6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029c069ca0 0x7f029c153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.514 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f02a24e6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f029c0cdb50 0x7f029c0c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.515 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f02a24e6700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f029c15b630 0x7f029c156540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.515 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f02a24e6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c1537d0 con 0x7f029c0cdb50 2022-09-20T20:14:03.516 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f02a24e6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029c0c4e20 con 0x7f029c069ca0 2022-09-20T20:14:03.516 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f02a24e6700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029c0c5100 con 0x7f029c15b630 2022-09-20T20:14:03.516 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f029b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f029c0cdb50 0x7f029c0c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.517 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f029b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f029c0cdb50 0x7f029c0c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58526/0 (socket says 172.21.15.8:58526) 2022-09-20T20:14:03.518 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f029b7fe700 1 -- 172.21.15.8:0/2199802576 learned_addr learned my addr 172.21.15.8:0/2199802576 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:14:03.518 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f02a0a83700 1 --2- 172.21.15.8:0/2199802576 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f029c15b630 0x7f029c156540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f029bfff700 1 --2- 172.21.15.8:0/2199802576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029c069ca0 0x7f029c153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.519 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f029b7fe700 1 -- 172.21.15.8:0/2199802576 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f029c15b630 msgr2=0x7f029c156540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.520 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f029b7fe700 1 --2- 172.21.15.8:0/2199802576 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f029c15b630 0x7f029c156540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.520 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f029b7fe700 1 -- 172.21.15.8:0/2199802576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029c069ca0 msgr2=0x7f029c153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.520 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f029b7fe700 1 --2- 172.21.15.8:0/2199802576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029c069ca0 0x7f029c153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.521 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f029b7fe700 1 -- 172.21.15.8:0/2199802576 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0294009a70 con 0x7f029c0cdb50 2022-09-20T20:14:03.521 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f029b7fe700 1 --2- 172.21.15.8:0/2199802576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f029c0cdb50 0x7f029c0c5ec0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f029000c520 tx=0x7f029000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f0298ff9700 1 -- 172.21.15.8:0/2199802576 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0290004c80 con 0x7f029c0cdb50 2022-09-20T20:14:03.522 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f0298ff9700 1 -- 172.21.15.8:0/2199802576 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0290004de0 con 0x7f029c0cdb50 2022-09-20T20:14:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f0298ff9700 1 -- 172.21.15.8:0/2199802576 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02900072d0 con 0x7f029c0cdb50 2022-09-20T20:14:03.523 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f02a24e6700 1 -- 172.21.15.8:0/2199802576 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f029c0c53e0 con 0x7f029c0cdb50 2022-09-20T20:14:03.524 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.495+0000 7f02a24e6700 1 -- 172.21.15.8:0/2199802576 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f029c0c59a0 con 0x7f029c0cdb50 2022-09-20T20:14:03.524 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.496+0000 7f02a24e6700 1 -- 172.21.15.8:0/2199802576 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029c0c5bc0 con 0x7f029c0cdb50 2022-09-20T20:14:03.525 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.497+0000 7f0298ff9700 1 -- 172.21.15.8:0/2199802576 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7f029001a020 con 0x7f029c0cdb50 2022-09-20T20:14:03.525 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.497+0000 7f0298ff9700 1 --2- 172.21.15.8:0/2199802576 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f027c065a50 0x7f027c067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.526 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.498+0000 7f029bfff700 1 --2- 172.21.15.8:0/2199802576 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f027c065a50 0x7f027c067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.526 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.498+0000 7f0298ff9700 1 -- 172.21.15.8:0/2199802576 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0290082180 con 0x7f029c0cdb50 2022-09-20T20:14:03.526 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.498+0000 7f029bfff700 1 --2- 172.21.15.8:0/2199802576 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f027c065a50 0x7f027c067f00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f028c0099d0 tx=0x7f028c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:03.526 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.502+0000 7f0298ff9700 1 -- 172.21.15.8:0/2199802576 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7f0290050340 con 0x7f029c0cdb50 2022-09-20T20:14:03.696 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.694+0000 7f02a24e6700 1 -- 172.21.15.8:0/2199802576 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f029c065e70 con 0x7f029c0cdb50 2022-09-20T20:14:03.697 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.694+0000 7f0298ff9700 1 -- 172.21.15.8:0/2199802576 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f0290053960 con 0x7f029c0cdb50 2022-09-20T20:14:03.698 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:14:03.698 INFO:teuthology.orchestra.run.smithi008.stdout:[ 2022-09-20T20:14:03.698 INFO:teuthology.orchestra.run.smithi008.stdout: { 2022-09-20T20:14:03.699 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 1, 2022-09-20T20:14:03.699 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": "rbd" 2022-09-20T20:14:03.700 INFO:teuthology.orchestra.run.smithi008.stdout: }, 2022-09-20T20:14:03.700 INFO:teuthology.orchestra.run.smithi008.stdout: { 2022-09-20T20:14:03.701 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 2, 2022-09-20T20:14:03.701 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": ".mgr" 2022-09-20T20:14:03.701 INFO:teuthology.orchestra.run.smithi008.stdout: } 2022-09-20T20:14:03.702 INFO:teuthology.orchestra.run.smithi008.stdout:] 2022-09-20T20:14:03.704 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.696+0000 7f02a24e6700 1 -- 172.21.15.8:0/2199802576 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f027c065a50 msgr2=0x7f027c067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.704 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.696+0000 7f02a24e6700 1 --2- 172.21.15.8:0/2199802576 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f027c065a50 0x7f027c067f00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f028c0099d0 tx=0x7f028c008040 comp rx=0 tx=0).stop 2022-09-20T20:14:03.705 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.696+0000 7f02a24e6700 1 -- 172.21.15.8:0/2199802576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f029c0cdb50 msgr2=0x7f029c0c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.705 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.696+0000 7f02a24e6700 1 --2- 172.21.15.8:0/2199802576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f029c0cdb50 0x7f029c0c5ec0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f029000c520 tx=0x7f029000c830 comp rx=0 tx=0).stop 2022-09-20T20:14:03.706 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.696+0000 7f02a24e6700 1 -- 172.21.15.8:0/2199802576 shutdown_connections 2022-09-20T20:14:03.706 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.696+0000 7f02a24e6700 1 --2- 172.21.15.8:0/2199802576 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f027c065a50 0x7f027c067f00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.696+0000 7f02a24e6700 1 --2- 172.21.15.8:0/2199802576 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f029c15b630 0x7f029c156540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.696+0000 7f02a24e6700 1 --2- 172.21.15.8:0/2199802576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f029c069ca0 0x7f029c153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.707 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.696+0000 7f02a24e6700 1 --2- 172.21.15.8:0/2199802576 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f029c0cdb50 0x7f029c0c5ec0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.708 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.696+0000 7f02a24e6700 1 -- 172.21.15.8:0/2199802576 >> 172.21.15.8:0/2199802576 conn(0x7f029c0cf900 msgr2=0x7f029c0b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:03.708 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.696+0000 7f02a24e6700 1 -- 172.21.15.8:0/2199802576 shutdown_connections 2022-09-20T20:14:03.709 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.696+0000 7f02a24e6700 1 -- 172.21.15.8:0/2199802576 wait complete. 2022-09-20T20:14:03.711 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-09-20T20:14:03.712 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2022-09-20T20:14:03.841 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.839+0000 7fbe88fd9700 1 Processor -- start 2022-09-20T20:14:03.841 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.839+0000 7fbe88fd9700 1 -- start start 2022-09-20T20:14:03.844 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.840+0000 7fbe88fd9700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbe84070a70 0x7fbe84068b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.844 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.840+0000 7fbe88fd9700 1 -- --> v1:172.21.15.8:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe840ce3e0 con 0x7fbe8406ca50 2022-09-20T20:14:03.844 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.840+0000 7fbe88fd9700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe840b0dd0 con 0x7fbe8415b520 2022-09-20T20:14:03.844 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.840+0000 7fbe88fd9700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe840c2a20 con 0x7fbe84070a70 2022-09-20T20:14:03.845 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.840+0000 7fbe82d9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbe84070a70 0x7fbe84068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.845 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.840+0000 7fbe81d9b700 1 --1- >> v1:172.21.15.8:6789/0 conn(0x7fbe8406ca50 0x7fbe84070140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.8:6789/0 says I am v1:172.21.15.8:41330/0 (socket says 172.21.15.8:41330) 2022-09-20T20:14:03.845 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.840+0000 7fbe82d9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7fbe84070a70 0x7fbe84068b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58534/0 (socket says 172.21.15.8:58534) 2022-09-20T20:14:03.845 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.840+0000 7fbe81d9b700 1 -- 172.21.15.8:0/4263922330 learned_addr learned my addr 172.21.15.8:0/4263922330 (peer_addr_for_me v1:172.21.15.8:0/0) 2022-09-20T20:14:03.845 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.841+0000 7fbe82d9d700 1 -- 172.21.15.8:0/4263922330 >> v1:172.21.15.55:6789/0 conn(0x7fbe8415b520 legacy=0x7fbe840c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.846 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.841+0000 7fbe82d9d700 1 -- 172.21.15.8:0/4263922330 >> v1:172.21.15.8:6789/0 conn(0x7fbe8406ca50 legacy=0x7fbe84070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.846 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.841+0000 7fbe82d9d700 1 -- 172.21.15.8:0/4263922330 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe840b10b0 con 0x7fbe84070a70 2022-09-20T20:14:03.846 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.841+0000 7fbe8159a700 1 -- 172.21.15.8:0/4263922330 <== mon.0 v1:172.21.15.8:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624633741 0 0) 0x7fbe840ce3e0 con 0x7fbe8406ca50 2022-09-20T20:14:03.846 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.841+0000 7fbe82d9d700 1 --2- 172.21.15.8:0/4263922330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe84070a70 0x7fbe84068b20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009d90 tx=0x7fbe7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c073eff2f7c3cf server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:03.847 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.841+0000 7fbe8159a700 1 -- 172.21.15.8:0/4263922330 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c00e070 con 0x7fbe84070a70 2022-09-20T20:14:03.847 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.841+0000 7fbe8159a700 1 -- 172.21.15.8:0/4263922330 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c00bbd0 con 0x7fbe84070a70 2022-09-20T20:14:03.847 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.841+0000 7fbe8159a700 1 -- 172.21.15.8:0/4263922330 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c012430 con 0x7fbe84070a70 2022-09-20T20:14:03.847 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.841+0000 7fbe88fd9700 1 -- 172.21.15.8:0/4263922330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe84070a70 msgr2=0x7fbe84068b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.847 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.841+0000 7fbe88fd9700 1 --2- 172.21.15.8:0/4263922330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe84070a70 0x7fbe84068b20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009d90 tx=0x7fbe7c00b330 comp rx=0 tx=0).stop 2022-09-20T20:14:03.848 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.841+0000 7fbe88fd9700 1 -- 172.21.15.8:0/4263922330 shutdown_connections 2022-09-20T20:14:03.848 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.841+0000 7fbe88fd9700 1 --2- 172.21.15.8:0/4263922330 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe84070a70 0x7fbe84068b20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.848 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.841+0000 7fbe88fd9700 1 -- 172.21.15.8:0/4263922330 >> 172.21.15.8:0/4263922330 conn(0x7fbe8406e8c0 msgr2=0x7fbe8406c220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:03.848 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.842+0000 7fbe88fd9700 1 -- 172.21.15.8:0/4263922330 shutdown_connections 2022-09-20T20:14:03.849 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.842+0000 7fbe88fd9700 1 -- 172.21.15.8:0/4263922330 wait complete. 2022-09-20T20:14:03.854 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.843+0000 7fbe88fd9700 1 Processor -- start 2022-09-20T20:14:03.855 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.843+0000 7fbe88fd9700 1 -- start start 2022-09-20T20:14:03.855 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe88fd9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe8406ca50 0x7fbe84154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.856 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe88fd9700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe84070a70 0x7fbe84156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.856 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe88fd9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe8415b520 0x7fbe84156c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.857 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe88fd9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe840aa980 con 0x7fbe8415b520 2022-09-20T20:14:03.857 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe88fd9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe840aac60 con 0x7fbe8406ca50 2022-09-20T20:14:03.858 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe88fd9700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe840aaf40 con 0x7fbe84070a70 2022-09-20T20:14:03.858 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe82d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe8415b520 0x7fbe84156c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.858 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe82d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe8415b520 0x7fbe84156c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58540/0 (socket says 172.21.15.8:58540) 2022-09-20T20:14:03.859 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe82d9d700 1 -- 172.21.15.8:0/3666679791 learned_addr learned my addr 172.21.15.8:0/3666679791 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:14:03.859 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe8259c700 1 --2- 172.21.15.8:0/3666679791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe8406ca50 0x7fbe84154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe82d9d700 1 -- 172.21.15.8:0/3666679791 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe84070a70 msgr2=0x7fbe84156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe81d9b700 1 --2- 172.21.15.8:0/3666679791 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe84070a70 0x7fbe84156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe82d9d700 1 --2- 172.21.15.8:0/3666679791 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe84070a70 0x7fbe84156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.860 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe82d9d700 1 -- 172.21.15.8:0/3666679791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe8406ca50 msgr2=0x7fbe84154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:03.861 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe82d9d700 1 --2- 172.21.15.8:0/3666679791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe8406ca50 0x7fbe84154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:03.861 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe82d9d700 1 -- 172.21.15.8:0/3666679791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c009a70 con 0x7fbe8415b520 2022-09-20T20:14:03.861 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe8259c700 1 --2- 172.21.15.8:0/3666679791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe8406ca50 0x7fbe84154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-09-20T20:14:03.861 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe81d9b700 1 --2- 172.21.15.8:0/3666679791 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe84070a70 0x7fbe84156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-09-20T20:14:03.862 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe82d9d700 1 --2- 172.21.15.8:0/3666679791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe8415b520 0x7fbe84156c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c014040 tx=0x7fbe7c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:03.862 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe72ffd700 1 -- 172.21.15.8:0/3666679791 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c01b810 con 0x7fbe8415b520 2022-09-20T20:14:03.862 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe72ffd700 1 -- 172.21.15.8:0/3666679791 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c020070 con 0x7fbe8415b520 2022-09-20T20:14:03.862 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe88fd9700 1 -- 172.21.15.8:0/3666679791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe840ab220 con 0x7fbe8415b520 2022-09-20T20:14:03.863 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.844+0000 7fbe72ffd700 1 -- 172.21.15.8:0/3666679791 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c01bbb0 con 0x7fbe8415b520 2022-09-20T20:14:03.863 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.845+0000 7fbe88fd9700 1 -- 172.21.15.8:0/3666679791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe84154a60 con 0x7fbe8415b520 2022-09-20T20:14:03.863 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.845+0000 7fbe88fd9700 1 -- 172.21.15.8:0/3666679791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe840ab740 con 0x7fbe8415b520 2022-09-20T20:14:03.863 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.846+0000 7fbe72ffd700 1 -- 172.21.15.8:0/3666679791 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7fbe7c02e070 con 0x7fbe8415b520 2022-09-20T20:14:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.846+0000 7fbe72ffd700 1 --2- 172.21.15.8:0/3666679791 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fbe60065a50 0x7fbe60067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.846+0000 7fbe72ffd700 1 -- 172.21.15.8:0/3666679791 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fbe7c022070 con 0x7fbe8415b520 2022-09-20T20:14:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.846+0000 7fbe8259c700 1 --2- 172.21.15.8:0/3666679791 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fbe60065a50 0x7fbe60067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.847+0000 7fbe8259c700 1 --2- 172.21.15.8:0/3666679791 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fbe60065a50 0x7fbe60067f00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbe78000f60 tx=0x7fbe78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:03.864 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:03.850+0000 7fbe72ffd700 1 -- 172.21.15.8:0/3666679791 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7fbe840ab740 con 0x7fbe8415b520 2022-09-20T20:14:04.044 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:04.042+0000 7fbe88fd9700 1 -- 172.21.15.8:0/3666679791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbe840ab740 con 0x7fbe8415b520 2022-09-20T20:14:05.029 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.027+0000 7fbe72ffd700 1 -- 172.21.15.8:0/3666679791 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbe840ab740 con 0x7fbe8415b520 2022-09-20T20:14:05.032 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.031+0000 7fbe88fd9700 1 -- 172.21.15.8:0/3666679791 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fbe60065a50 msgr2=0x7fbe60067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:05.033 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.031+0000 7fbe88fd9700 1 --2- 172.21.15.8:0/3666679791 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fbe60065a50 0x7fbe60067f00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbe78000f60 tx=0x7fbe78009040 comp rx=0 tx=0).stop 2022-09-20T20:14:05.033 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.031+0000 7fbe88fd9700 1 -- 172.21.15.8:0/3666679791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe8415b520 msgr2=0x7fbe84156c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:05.033 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.031+0000 7fbe88fd9700 1 --2- 172.21.15.8:0/3666679791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe8415b520 0x7fbe84156c50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c014040 tx=0x7fbe7c004ad0 comp rx=0 tx=0).stop 2022-09-20T20:14:05.034 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.031+0000 7fbe88fd9700 1 -- 172.21.15.8:0/3666679791 shutdown_connections 2022-09-20T20:14:05.034 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.031+0000 7fbe88fd9700 1 --2- 172.21.15.8:0/3666679791 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7fbe60065a50 0x7fbe60067f00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:05.035 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.031+0000 7fbe88fd9700 1 --2- 172.21.15.8:0/3666679791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe8415b520 0x7fbe84156c50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:05.035 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.031+0000 7fbe88fd9700 1 --2- 172.21.15.8:0/3666679791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe8406ca50 0x7fbe84154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:05.035 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.031+0000 7fbe88fd9700 1 --2- 172.21.15.8:0/3666679791 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe84070a70 0x7fbe84156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:05.035 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.031+0000 7fbe88fd9700 1 -- 172.21.15.8:0/3666679791 >> 172.21.15.8:0/3666679791 conn(0x7fbe8406e8c0 msgr2=0x7fbe8415a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:05.036 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.032+0000 7fbe88fd9700 1 -- 172.21.15.8:0/3666679791 shutdown_connections 2022-09-20T20:14:05.036 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.032+0000 7fbe88fd9700 1 -- 172.21.15.8:0/3666679791 wait complete. 2022-09-20T20:14:05.039 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' created 2022-09-20T20:14:05.052 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2022-09-20T20:14:05.189 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.188+0000 7f47c0c9b700 1 Processor -- start 2022-09-20T20:14:05.190 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.188+0000 7f47c0c9b700 1 -- start start 2022-09-20T20:14:05.193 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.189+0000 7f47c0c9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47bc1593b0 0x7f47bc15a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:05.193 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.189+0000 7f47c0c9b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc0c9e80 0x7f47bc06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:05.193 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.189+0000 7f47c0c9b700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f47bc06d7e0 0x7f47bc0b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:05.194 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.189+0000 7f47c0c9b700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47bc15da50 con 0x7f47bc06d7e0 2022-09-20T20:14:05.194 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.189+0000 7f47c0c9b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47bc06dc40 con 0x7f47bc1593b0 2022-09-20T20:14:05.194 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.189+0000 7f47c0c9b700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc15de70 con 0x7f47bc0c9e80 2022-09-20T20:14:05.194 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.189+0000 7f47bad9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f47bc06d7e0 0x7f47bc0b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:05.195 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.189+0000 7f47bad9d700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f47bc06d7e0 0x7f47bc0b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58548/0 (socket says 172.21.15.8:58548) 2022-09-20T20:14:05.195 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.189+0000 7f47bad9d700 1 -- 172.21.15.8:0/3622499632 learned_addr learned my addr 172.21.15.8:0/3622499632 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:14:05.195 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.189+0000 7f47ba59c700 1 --2- 172.21.15.8:0/3622499632 >> v2:172.21.15.55:3300/0 conn(0x7f47bc1593b0 0x7f47bc15a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:05.195 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.189+0000 7f47b9d9b700 1 --2- 172.21.15.8:0/3622499632 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc0c9e80 0x7f47bc06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:05.195 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.189+0000 7f47bad9d700 1 -- 172.21.15.8:0/3622499632 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc0c9e80 msgr2=0x7f47bc06d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:05.196 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.189+0000 7f47bad9d700 1 --2- 172.21.15.8:0/3622499632 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc0c9e80 0x7f47bc06d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:05.196 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.189+0000 7f47bad9d700 1 -- 172.21.15.8:0/3622499632 >> v2:172.21.15.55:3300/0 conn(0x7f47bc1593b0 msgr2=0x7f47bc15a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:05.196 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.189+0000 7f47bad9d700 1 --2- 172.21.15.8:0/3622499632 >> v2:172.21.15.55:3300/0 conn(0x7f47bc1593b0 0x7f47bc15a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:05.196 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.189+0000 7f47bad9d700 1 -- 172.21.15.8:0/3622499632 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc159780 con 0x7f47bc06d7e0 2022-09-20T20:14:05.197 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.190+0000 7f47bad9d700 1 --2- 172.21.15.8:0/3622499632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47bc06d7e0 0x7f47bc0b1340 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0cd3b0 tx=0x7f47b400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15a409bd329f8bd server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:05.197 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.190+0000 7f47b959a700 1 -- 172.21.15.8:0/3622499632 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b400e070 con 0x7f47bc06d7e0 2022-09-20T20:14:05.197 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.190+0000 7f47b959a700 1 -- 172.21.15.8:0/3622499632 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b400b9c0 con 0x7f47bc06d7e0 2022-09-20T20:14:05.197 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.190+0000 7f47b959a700 1 -- 172.21.15.8:0/3622499632 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b400bd70 con 0x7f47bc06d7e0 2022-09-20T20:14:05.197 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.190+0000 7f47c0c9b700 1 -- 172.21.15.8:0/3622499632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47bc06d7e0 msgr2=0x7f47bc0b1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:05.198 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.190+0000 7f47c0c9b700 1 --2- 172.21.15.8:0/3622499632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47bc06d7e0 0x7f47bc0b1340 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0cd3b0 tx=0x7f47b400b330 comp rx=0 tx=0).stop 2022-09-20T20:14:05.198 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.190+0000 7f47c0c9b700 1 -- 172.21.15.8:0/3622499632 shutdown_connections 2022-09-20T20:14:05.198 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.190+0000 7f47c0c9b700 1 --2- 172.21.15.8:0/3622499632 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47bc06d7e0 0x7f47bc0b1340 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:05.198 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.190+0000 7f47c0c9b700 1 --2- 172.21.15.8:0/3622499632 >> v2:172.21.15.55:3300/0 conn(0x7f47bc1593b0 0x7f47bc15a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:05.199 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.190+0000 7f47c0c9b700 1 --2- 172.21.15.8:0/3622499632 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc0c9e80 0x7f47bc06d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:05.199 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.190+0000 7f47c0c9b700 1 -- 172.21.15.8:0/3622499632 >> 172.21.15.8:0/3622499632 conn(0x7f47bc0cf8c0 msgr2=0x7f47bc0cfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:05.199 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.190+0000 7f47c0c9b700 1 -- 172.21.15.8:0/3622499632 shutdown_connections 2022-09-20T20:14:05.199 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.190+0000 7f47c0c9b700 1 -- 172.21.15.8:0/3622499632 wait complete. 2022-09-20T20:14:05.202 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.192+0000 7f47c0c9b700 1 Processor -- start 2022-09-20T20:14:05.203 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.192+0000 7f47c0c9b700 1 -- start start 2022-09-20T20:14:05.203 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.193+0000 7f47c0c9b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc06d7e0 0x7f47bc150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:05.203 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.193+0000 7f47c0c9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47bc0c9e80 0x7f47bc1529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:05.203 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.193+0000 7f47c0c9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47bc1593b0 0x7f47bc152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:05.204 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.193+0000 7f47c0c9b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0b09f0 con 0x7f47bc0c9e80 2022-09-20T20:14:05.204 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.193+0000 7f47c0c9b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0b5230 con 0x7f47bc1593b0 2022-09-20T20:14:05.204 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.193+0000 7f47c0c9b700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0b5510 con 0x7f47bc06d7e0 2022-09-20T20:14:05.204 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.193+0000 7f47b9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47bc0c9e80 0x7f47bc1529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:05.205 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.193+0000 7f47b9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47bc0c9e80 0x7f47bc1529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58552/0 (socket says 172.21.15.8:58552) 2022-09-20T20:14:05.205 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.193+0000 7f47b9d9b700 1 -- 172.21.15.8:0/3010138917 learned_addr learned my addr 172.21.15.8:0/3010138917 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:14:05.205 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.193+0000 7f47bad9d700 1 --2- 172.21.15.8:0/3010138917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47bc1593b0 0x7f47bc152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:05.205 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.194+0000 7f47ba59c700 1 --2- 172.21.15.8:0/3010138917 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc06d7e0 0x7f47bc150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:05.205 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.194+0000 7f47b9d9b700 1 -- 172.21.15.8:0/3010138917 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc06d7e0 msgr2=0x7f47bc150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:05.206 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.194+0000 7f47b9d9b700 1 --2- 172.21.15.8:0/3010138917 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc06d7e0 0x7f47bc150a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:05.206 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.194+0000 7f47b9d9b700 1 -- 172.21.15.8:0/3010138917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47bc1593b0 msgr2=0x7f47bc152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:05.206 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.194+0000 7f47b9d9b700 1 --2- 172.21.15.8:0/3010138917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47bc1593b0 0x7f47bc152ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:05.206 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.194+0000 7f47b9d9b700 1 -- 172.21.15.8:0/3010138917 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b4009b30 con 0x7f47bc0c9e80 2022-09-20T20:14:05.207 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.194+0000 7f47b9d9b700 1 --2- 172.21.15.8:0/3010138917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47bc0c9e80 0x7f47bc1529a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00e810 tx=0x7f47ac00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:05.207 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.194+0000 7f47aaffd700 1 -- 172.21.15.8:0/3010138917 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac013610 con 0x7f47bc0c9e80 2022-09-20T20:14:05.207 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.194+0000 7f47aaffd700 1 -- 172.21.15.8:0/3010138917 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac013770 con 0x7f47bc0c9e80 2022-09-20T20:14:05.207 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.194+0000 7f47aaffd700 1 -- 172.21.15.8:0/3010138917 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac013b00 con 0x7f47bc0c9e80 2022-09-20T20:14:05.208 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.194+0000 7f47c0c9b700 1 -- 172.21.15.8:0/3010138917 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc0b0610 con 0x7f47bc0c9e80 2022-09-20T20:14:05.208 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.194+0000 7f47c0c9b700 1 -- 172.21.15.8:0/3010138917 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc0b4f50 con 0x7f47bc0c9e80 2022-09-20T20:14:05.208 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.195+0000 7f47c0c9b700 1 -- 172.21.15.8:0/3010138917 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc0b0c60 con 0x7f47bc0c9e80 2022-09-20T20:14:05.208 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.195+0000 7f47aaffd700 1 -- 172.21.15.8:0/3010138917 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7f47ac023070 con 0x7f47bc0c9e80 2022-09-20T20:14:05.208 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.196+0000 7f47aaffd700 1 --2- 172.21.15.8:0/3010138917 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f4798065a50 0x7f4798067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:05.209 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.196+0000 7f47aaffd700 1 -- 172.21.15.8:0/3010138917 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f47ac082470 con 0x7f47bc0c9e80 2022-09-20T20:14:05.209 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.196+0000 7f47ba59c700 1 --2- 172.21.15.8:0/3010138917 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f4798065a50 0x7f4798067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:05.209 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.196+0000 7f47ba59c700 1 --2- 172.21.15.8:0/3010138917 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f4798065a50 0x7f4798067f00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009950 tx=0x7f47b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:05.209 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.200+0000 7f47aaffd700 1 -- 172.21.15.8:0/3010138917 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7f47ac0504c0 con 0x7f47bc0c9e80 2022-09-20T20:14:05.391 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:05.390+0000 7f47c0c9b700 1 -- 172.21.15.8:0/3010138917 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f47bc065e70 con 0x7f47bc0c9e80 2022-09-20T20:14:06.035 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.033+0000 7f47aaffd700 1 -- 172.21.15.8:0/3010138917 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f47ac009440 con 0x7f47bc0c9e80 2022-09-20T20:14:06.043 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.040+0000 7f47c0c9b700 1 -- 172.21.15.8:0/3010138917 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f4798065a50 msgr2=0x7f4798067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:06.043 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.040+0000 7f47c0c9b700 1 --2- 172.21.15.8:0/3010138917 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f4798065a50 0x7f4798067f00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009950 tx=0x7f47b0008040 comp rx=0 tx=0).stop 2022-09-20T20:14:06.044 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.040+0000 7f47c0c9b700 1 -- 172.21.15.8:0/3010138917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47bc0c9e80 msgr2=0x7f47bc1529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:06.044 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.040+0000 7f47c0c9b700 1 --2- 172.21.15.8:0/3010138917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47bc0c9e80 0x7f47bc1529a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00e810 tx=0x7f47ac00ebd0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.045 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.040+0000 7f47c0c9b700 1 -- 172.21.15.8:0/3010138917 shutdown_connections 2022-09-20T20:14:06.045 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.040+0000 7f47c0c9b700 1 --2- 172.21.15.8:0/3010138917 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f4798065a50 0x7f4798067f00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.046 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.040+0000 7f47c0c9b700 1 --2- 172.21.15.8:0/3010138917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47bc1593b0 0x7f47bc152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.046 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.040+0000 7f47c0c9b700 1 --2- 172.21.15.8:0/3010138917 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47bc06d7e0 0x7f47bc150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.046 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.040+0000 7f47c0c9b700 1 --2- 172.21.15.8:0/3010138917 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f47bc0c9e80 0x7f47bc1529a0 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00e810 tx=0x7f47ac00ebd0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.047 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.040+0000 7f47c0c9b700 1 -- 172.21.15.8:0/3010138917 >> 172.21.15.8:0/3010138917 conn(0x7f47bc0cf8c0 msgr2=0x7f47bc158220 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:06.048 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.042+0000 7f47c0c9b700 1 -- 172.21.15.8:0/3010138917 shutdown_connections 2022-09-20T20:14:06.049 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.043+0000 7f47c0c9b700 1 -- 172.21.15.8:0/3010138917 wait complete. 2022-09-20T20:14:06.049 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' created 2022-09-20T20:14:06.068 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2022-09-20T20:14:06.212 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.200+0000 7f0772929700 1 Processor -- start 2022-09-20T20:14:06.213 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.200+0000 7f0772929700 1 -- start start 2022-09-20T20:14:06.213 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.201+0000 7f0772929700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f076c158e00 0x7f076c0cd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:06.213 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.201+0000 7f0772929700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f076c15c330 0x7f076c06c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:06.214 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.201+0000 7f0772929700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f076c06c570 0x7f076c06f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:06.214 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.201+0000 7f0772929700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076c06b8c0 con 0x7f076c158e00 2022-09-20T20:14:06.215 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.201+0000 7f0772929700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f076c0cbb10 con 0x7f076c06c570 2022-09-20T20:14:06.215 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.201+0000 7f0772929700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076c0cbdf0 con 0x7f076c15c330 2022-09-20T20:14:06.216 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.201+0000 7f076bfff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f076c158e00 0x7f076c0cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:06.216 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.201+0000 7f076bfff700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f076c158e00 0x7f076c0cd750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58558/0 (socket says 172.21.15.8:58558) 2022-09-20T20:14:06.217 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.201+0000 7f076bfff700 1 -- 172.21.15.8:0/2258680501 learned_addr learned my addr 172.21.15.8:0/2258680501 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:14:06.217 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.201+0000 7f076b7fe700 1 --2- 172.21.15.8:0/2258680501 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f076c15c330 0x7f076c06c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:06.218 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.201+0000 7f0770ec6700 1 --2- 172.21.15.8:0/2258680501 >> v2:172.21.15.55:3300/0 conn(0x7f076c06c570 0x7f076c06f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:06.218 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.201+0000 7f076bfff700 1 -- 172.21.15.8:0/2258680501 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f076c15c330 msgr2=0x7f076c06c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:06.219 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.201+0000 7f076bfff700 1 --2- 172.21.15.8:0/2258680501 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f076c15c330 0x7f076c06c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.219 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.201+0000 7f076bfff700 1 -- 172.21.15.8:0/2258680501 >> v2:172.21.15.55:3300/0 conn(0x7f076c06c570 msgr2=0x7f076c06f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:06.220 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.201+0000 7f076bfff700 1 --2- 172.21.15.8:0/2258680501 >> v2:172.21.15.55:3300/0 conn(0x7f076c06c570 0x7f076c06f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.220 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.201+0000 7f076bfff700 1 -- 172.21.15.8:0/2258680501 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f076c0cc0d0 con 0x7f076c158e00 2022-09-20T20:14:06.221 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.201+0000 7f076bfff700 1 --2- 172.21.15.8:0/2258680501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f076c158e00 0x7f076c0cd750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f076c06f200 tx=0x7f0760009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7f52052fc9a4a5 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:06.221 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.202+0000 7f076affd700 1 -- 172.21.15.8:0/2258680501 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076000b870 con 0x7f076c158e00 2022-09-20T20:14:06.223 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.202+0000 7f076affd700 1 -- 172.21.15.8:0/2258680501 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f076000b9d0 con 0x7f076c158e00 2022-09-20T20:14:06.223 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.202+0000 7f076affd700 1 -- 172.21.15.8:0/2258680501 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f076000bd60 con 0x7f076c158e00 2022-09-20T20:14:06.224 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.202+0000 7f0772929700 1 -- 172.21.15.8:0/2258680501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f076c158e00 msgr2=0x7f076c0cd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:06.224 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.202+0000 7f0772929700 1 --2- 172.21.15.8:0/2258680501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f076c158e00 0x7f076c0cd750 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f076c06f200 tx=0x7f0760009bd0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.224 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.202+0000 7f0772929700 1 -- 172.21.15.8:0/2258680501 shutdown_connections 2022-09-20T20:14:06.224 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.202+0000 7f0772929700 1 --2- 172.21.15.8:0/2258680501 >> v2:172.21.15.55:3300/0 conn(0x7f076c06c570 0x7f076c06f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.224 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.202+0000 7f0772929700 1 --2- 172.21.15.8:0/2258680501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f076c158e00 0x7f076c0cd750 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.225 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.202+0000 7f0772929700 1 --2- 172.21.15.8:0/2258680501 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f076c15c330 0x7f076c06c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.225 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.202+0000 7f0772929700 1 -- 172.21.15.8:0/2258680501 >> 172.21.15.8:0/2258680501 conn(0x7f076c0ca9b0 msgr2=0x7f076c0cadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:06.225 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.202+0000 7f0772929700 1 -- 172.21.15.8:0/2258680501 shutdown_connections 2022-09-20T20:14:06.225 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.202+0000 7f0772929700 1 -- 172.21.15.8:0/2258680501 wait complete. 2022-09-20T20:14:06.226 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.203+0000 7f0772929700 1 Processor -- start 2022-09-20T20:14:06.226 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.204+0000 7f0772929700 1 -- start start 2022-09-20T20:14:06.226 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.204+0000 7f0772929700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f076c06c570 0x7f076c1f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:06.226 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.204+0000 7f0772929700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f076c158e00 0x7f076c0b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:06.227 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.204+0000 7f0772929700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f076c15c330 0x7f076c156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:06.227 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.204+0000 7f0772929700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c152110 con 0x7f076c158e00 2022-09-20T20:14:06.227 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.204+0000 7f0772929700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076c1523f0 con 0x7f076c15c330 2022-09-20T20:14:06.227 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.204+0000 7f0772929700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f076c1526d0 con 0x7f076c06c570 2022-09-20T20:14:06.228 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.204+0000 7f076b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f076c158e00 0x7f076c0b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:06.228 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.204+0000 7f076b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f076c158e00 0x7f076c0b27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58564/0 (socket says 172.21.15.8:58564) 2022-09-20T20:14:06.228 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.204+0000 7f076b7fe700 1 -- 172.21.15.8:0/2968006066 learned_addr learned my addr 172.21.15.8:0/2968006066 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:14:06.228 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.205+0000 7f076bfff700 1 --2- 172.21.15.8:0/2968006066 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f076c06c570 0x7f076c1f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:06.229 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.205+0000 7f0770ec6700 1 --2- 172.21.15.8:0/2968006066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f076c15c330 0x7f076c156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:06.229 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.205+0000 7f076b7fe700 1 -- 172.21.15.8:0/2968006066 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f076c06c570 msgr2=0x7f076c1f5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:06.229 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.205+0000 7f076b7fe700 1 --2- 172.21.15.8:0/2968006066 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f076c06c570 0x7f076c1f5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.229 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.205+0000 7f076b7fe700 1 -- 172.21.15.8:0/2968006066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f076c15c330 msgr2=0x7f076c156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:06.229 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.205+0000 7f076b7fe700 1 --2- 172.21.15.8:0/2968006066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f076c15c330 0x7f076c156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.230 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.205+0000 7f076b7fe700 1 -- 172.21.15.8:0/2968006066 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0760009550 con 0x7f076c158e00 2022-09-20T20:14:06.230 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.205+0000 7f076b7fe700 1 --2- 172.21.15.8:0/2968006066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f076c158e00 0x7f076c0b27f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f075c00d800 tx=0x7f075c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:06.230 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.205+0000 7f0768ff9700 1 -- 172.21.15.8:0/2968006066 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c0125f0 con 0x7f076c158e00 2022-09-20T20:14:06.230 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.205+0000 7f0768ff9700 1 -- 172.21.15.8:0/2968006066 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075c012750 con 0x7f076c158e00 2022-09-20T20:14:06.231 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.205+0000 7f0772929700 1 -- 172.21.15.8:0/2968006066 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076c1529b0 con 0x7f076c158e00 2022-09-20T20:14:06.231 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.205+0000 7f0768ff9700 1 -- 172.21.15.8:0/2968006066 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c012b00 con 0x7f076c158e00 2022-09-20T20:14:06.231 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.205+0000 7f0772929700 1 -- 172.21.15.8:0/2968006066 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f076c0b39d0 con 0x7f076c158e00 2022-09-20T20:14:06.231 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.206+0000 7f0772929700 1 -- 172.21.15.8:0/2968006066 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f076c072c60 con 0x7f076c158e00 2022-09-20T20:14:06.231 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.207+0000 7f0768ff9700 1 -- 172.21.15.8:0/2968006066 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7f075c012c60 con 0x7f076c158e00 2022-09-20T20:14:06.232 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.207+0000 7f0768ff9700 1 --2- 172.21.15.8:0/2968006066 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f074c065a50 0x7f074c067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:06.232 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.207+0000 7f0768ff9700 1 -- 172.21.15.8:0/2968006066 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f075c082ed0 con 0x7f076c158e00 2022-09-20T20:14:06.232 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.207+0000 7f076bfff700 1 --2- 172.21.15.8:0/2968006066 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f074c065a50 0x7f074c067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:06.232 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.207+0000 7f076bfff700 1 --2- 172.21.15.8:0/2968006066 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f074c065a50 0x7f074c067f00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0760000c00 tx=0x7f0760008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:06.234 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.212+0000 7f0768ff9700 1 -- 172.21.15.8:0/2968006066 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7f075c050da0 con 0x7f076c158e00 2022-09-20T20:14:06.448 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.446+0000 7f0772929700 1 -- 172.21.15.8:0/2968006066 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f076c15c110 con 0x7f076c158e00 2022-09-20T20:14:06.454 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.452+0000 7f0768ff9700 1 -- 172.21.15.8:0/2968006066 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f075c0543c0 con 0x7f076c158e00 2022-09-20T20:14:06.459 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.457+0000 7f0772929700 1 -- 172.21.15.8:0/2968006066 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f074c065a50 msgr2=0x7f074c067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:06.460 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.457+0000 7f0772929700 1 --2- 172.21.15.8:0/2968006066 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f074c065a50 0x7f074c067f00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0760000c00 tx=0x7f0760008030 comp rx=0 tx=0).stop 2022-09-20T20:14:06.460 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.457+0000 7f0772929700 1 -- 172.21.15.8:0/2968006066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f076c158e00 msgr2=0x7f076c0b27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:06.460 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.457+0000 7f0772929700 1 --2- 172.21.15.8:0/2968006066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f076c158e00 0x7f076c0b27f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f075c00d800 tx=0x7f075c00dbc0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.461 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.458+0000 7f0772929700 1 -- 172.21.15.8:0/2968006066 shutdown_connections 2022-09-20T20:14:06.461 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.458+0000 7f0772929700 1 --2- 172.21.15.8:0/2968006066 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f074c065a50 0x7f074c067f00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.462 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.458+0000 7f0772929700 1 --2- 172.21.15.8:0/2968006066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f076c15c330 0x7f076c156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.462 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.458+0000 7f0772929700 1 --2- 172.21.15.8:0/2968006066 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f076c06c570 0x7f076c1f5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.462 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.458+0000 7f0772929700 1 --2- 172.21.15.8:0/2968006066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f076c158e00 0x7f076c0b27f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.462 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.458+0000 7f0772929700 1 -- 172.21.15.8:0/2968006066 >> 172.21.15.8:0/2968006066 conn(0x7f076c0ca9b0 msgr2=0x7f076c069ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:06.463 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.459+0000 7f0772929700 1 -- 172.21.15.8:0/2968006066 shutdown_connections 2022-09-20T20:14:06.463 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.460+0000 7f0772929700 1 -- 172.21.15.8:0/2968006066 wait complete. 2022-09-20T20:14:06.463 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 3 and data pool 4 2022-09-20T20:14:06.483 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-20T20:14:06.608 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.607+0000 7f1eddaa1700 1 Processor -- start 2022-09-20T20:14:06.609 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.607+0000 7f1eddaa1700 1 -- start start 2022-09-20T20:14:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.608+0000 7f1eddaa1700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1ed815b1d0 0x7f1ed80cd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.608+0000 7f1eddaa1700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1ed806ffd0 0x7f1ed815edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:06.615 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.608+0000 7f1eddaa1700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ed806a4a0 con 0x7f1ed806c340 2022-09-20T20:14:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.608+0000 7f1eddaa1700 1 -- --> v2:172.21.15.8:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed8069ee0 con 0x7f1ed815b1d0 2022-09-20T20:14:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.608+0000 7f1eddaa1700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ed806a1c0 con 0x7f1ed806ffd0 2022-09-20T20:14:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.608+0000 7f1ed77fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1ed815b1d0 0x7f1ed80cd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.608+0000 7f1ed77fe700 1 --2- >> v2:172.21.15.8:3300/0 conn(0x7f1ed815b1d0 0x7f1ed80cd740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58584/0 (socket says 172.21.15.8:58584) 2022-09-20T20:14:06.616 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.608+0000 7f1ed77fe700 1 -- 172.21.15.8:0/442305461 learned_addr learned my addr 172.21.15.8:0/442305461 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:14:06.617 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.608+0000 7f1ed7fff700 1 --2- 172.21.15.8:0/442305461 >> v2:172.21.15.55:3300/0 conn(0x7f1ed806ffd0 0x7f1ed815edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:06.617 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.608+0000 7f1ed77fe700 1 -- 172.21.15.8:0/442305461 >> v2:172.21.15.55:3300/0 conn(0x7f1ed806ffd0 msgr2=0x7f1ed815edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:06.617 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.608+0000 7f1ed77fe700 1 --2- 172.21.15.8:0/442305461 >> v2:172.21.15.55:3300/0 conn(0x7f1ed806ffd0 0x7f1ed815edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.617 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.608+0000 7f1ed77fe700 1 -- 172.21.15.8:0/442305461 >> v1:172.21.15.55:6789/0 conn(0x7f1ed806c340 legacy=0x7f1ed806f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:14:06.618 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.608+0000 7f1ed77fe700 1 -- 172.21.15.8:0/442305461 --> v2:172.21.15.8:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ed80cbc20 con 0x7f1ed815b1d0 2022-09-20T20:14:06.618 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.608+0000 7f1ed7fff700 1 --2- 172.21.15.8:0/442305461 >> v2:172.21.15.55:3300/0 conn(0x7f1ed806ffd0 0x7f1ed815edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-09-20T20:14:06.618 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.608+0000 7f1ed77fe700 1 --2- 172.21.15.8:0/442305461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ed815b1d0 0x7f1ed80cd740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80cded0 tx=0x7f1ec8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb68c8634aeeb91 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:06.618 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.609+0000 7f1ed67fc700 1 -- 172.21.15.8:0/442305461 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8004230 con 0x7f1ed815b1d0 2022-09-20T20:14:06.619 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.609+0000 7f1ed67fc700 1 -- 172.21.15.8:0/442305461 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec8004390 con 0x7f1ed815b1d0 2022-09-20T20:14:06.619 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.609+0000 7f1ed67fc700 1 -- 172.21.15.8:0/442305461 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec80036a0 con 0x7f1ed815b1d0 2022-09-20T20:14:06.619 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.609+0000 7f1eddaa1700 1 -- 172.21.15.8:0/442305461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ed815b1d0 msgr2=0x7f1ed80cd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:06.619 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.609+0000 7f1eddaa1700 1 --2- 172.21.15.8:0/442305461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ed815b1d0 0x7f1ed80cd740 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80cded0 tx=0x7f1ec8009bd0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.619 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.609+0000 7f1eddaa1700 1 -- 172.21.15.8:0/442305461 shutdown_connections 2022-09-20T20:14:06.620 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.609+0000 7f1eddaa1700 1 --2- 172.21.15.8:0/442305461 >> v2:172.21.15.55:3300/0 conn(0x7f1ed806ffd0 0x7f1ed815edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.620 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.609+0000 7f1eddaa1700 1 --2- 172.21.15.8:0/442305461 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ed815b1d0 0x7f1ed80cd740 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.620 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.609+0000 7f1eddaa1700 1 -- 172.21.15.8:0/442305461 >> 172.21.15.8:0/442305461 conn(0x7f1ed80cdf20 msgr2=0x7f1ed80ce320 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:14:06.620 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.609+0000 7f1eddaa1700 1 -- 172.21.15.8:0/442305461 shutdown_connections 2022-09-20T20:14:06.621 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.609+0000 7f1eddaa1700 1 -- 172.21.15.8:0/442305461 wait complete. 2022-09-20T20:14:06.621 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.610+0000 7f1eddaa1700 1 Processor -- start 2022-09-20T20:14:06.621 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.611+0000 7f1eddaa1700 1 -- start start 2022-09-20T20:14:06.621 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.611+0000 7f1eddaa1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ed806c340 0x7f1ed80ad390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:06.622 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.611+0000 7f1eddaa1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed806ffd0 0x7f1ed814a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:06.622 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.611+0000 7f1eddaa1700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ed815b1d0 0x7f1ed814b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:06.622 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.611+0000 7f1eddaa1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed80acf00 con 0x7f1ed806c340 2022-09-20T20:14:06.622 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.611+0000 7f1eddaa1700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed80ac2f0 con 0x7f1ed806ffd0 2022-09-20T20:14:06.623 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.611+0000 7f1eddaa1700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ed80ac5d0 con 0x7f1ed815b1d0 2022-09-20T20:14:06.623 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.611+0000 7f1ed77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ed806c340 0x7f1ed80ad390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:06.623 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.612+0000 7f1ed77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ed806c340 0x7f1ed80ad390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58590/0 (socket says 172.21.15.8:58590) 2022-09-20T20:14:06.623 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.612+0000 7f1ed77fe700 1 -- 172.21.15.8:0/2267461767 learned_addr learned my addr 172.21.15.8:0/2267461767 (peer_addr_for_me v2:172.21.15.8:0/0) 2022-09-20T20:14:06.623 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.612+0000 7f1ed6ffd700 1 --2- 172.21.15.8:0/2267461767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed806ffd0 0x7f1ed814a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:06.624 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.612+0000 7f1ed7fff700 1 --2- 172.21.15.8:0/2267461767 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ed815b1d0 0x7f1ed814b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:06.624 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.612+0000 7f1ed77fe700 1 -- 172.21.15.8:0/2267461767 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ed815b1d0 msgr2=0x7f1ed814b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:06.624 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.612+0000 7f1ed77fe700 1 --2- 172.21.15.8:0/2267461767 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ed815b1d0 0x7f1ed814b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.625 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.612+0000 7f1ed77fe700 1 -- 172.21.15.8:0/2267461767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed806ffd0 msgr2=0x7f1ed814a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:14:06.625 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.612+0000 7f1ed77fe700 1 --2- 172.21.15.8:0/2267461767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ed806ffd0 0x7f1ed814a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:14:06.625 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.612+0000 7f1ed77fe700 1 -- 172.21.15.8:0/2267461767 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ec8009550 con 0x7f1ed806c340 2022-09-20T20:14:06.625 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.612+0000 7f1ed7fff700 1 --2- 172.21.15.8:0/2267461767 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1ed815b1d0 0x7f1ed814b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-09-20T20:14:06.626 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.612+0000 7f1ed77fe700 1 --2- 172.21.15.8:0/2267461767 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1ed806c340 0x7f1ed80ad390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1ec8009130 tx=0x7f1ec8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:06.626 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.612+0000 7f1ecffff700 1 -- 172.21.15.8:0/2267461767 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8003dc0 con 0x7f1ed806c340 2022-09-20T20:14:06.626 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.612+0000 7f1ecffff700 1 -- 172.21.15.8:0/2267461767 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ec801f070 con 0x7f1ed806c340 2022-09-20T20:14:06.626 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.612+0000 7f1ecffff700 1 -- 172.21.15.8:0/2267461767 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ec8011870 con 0x7f1ed806c340 2022-09-20T20:14:06.627 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.612+0000 7f1eddaa1700 1 -- 172.21.15.8:0/2267461767 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ed80ac8b0 con 0x7f1ed806c340 2022-09-20T20:14:06.627 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.612+0000 7f1eddaa1700 1 -- 172.21.15.8:0/2267461767 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ed814a830 con 0x7f1ed806c340 2022-09-20T20:14:06.627 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.613+0000 7f1eddaa1700 1 -- 172.21.15.8:0/2267461767 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ed8072c60 con 0x7f1ed806c340 2022-09-20T20:14:06.628 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.613+0000 7f1ecffff700 1 -- 172.21.15.8:0/2267461767 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7f1ec8017020 con 0x7f1ed806c340 2022-09-20T20:14:06.629 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.614+0000 7f1ecffff700 1 --2- 172.21.15.8:0/2267461767 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f1ebc065a50 0x7f1ebc067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:14:06.629 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.614+0000 7f1ecffff700 1 -- 172.21.15.8:0/2267461767 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1ec80842a0 con 0x7f1ed806c340 2022-09-20T20:14:06.630 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.614+0000 7f1ed6ffd700 1 --2- 172.21.15.8:0/2267461767 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f1ebc065a50 0x7f1ebc067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:14:06.630 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.614+0000 7f1ed6ffd700 1 --2- 172.21.15.8:0/2267461767 >> [v2:172.21.15.8:6832/99603,v1:172.21.15.8:6833/99603] conn(0x7f1ebc065a50 0x7f1ebc067f00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1ed81f3a60 tx=0x7f1ec0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:14:06.630 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.618+0000 7f1ecffff700 1 -- 172.21.15.8:0/2267461767 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7f1ec8052110 con 0x7f1ed806c340 2022-09-20T20:14:06.813 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.812+0000 7f1eddaa1700 1 -- 172.21.15.8:0/2267461767 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ed8064940 con 0x7f1ed806c340 2022-09-20T20:14:06.814 INFO:teuthology.orchestra.run.smithi008.stderr:2022-09-20T20:14:06.813+0000 7f1ecffff700 1 -- 172.21.15.8:0/2267461767 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16831 (secure 0 0 0) 0x7f1ec8055730 con 0x7f1ed806c340 2022-09-20T20:14:06.815 INFO:teuthology.orchestra.run.smithi008.stdout: 2022-09-20T20:14:06.815 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":20,"fsid":"e2fce34f-6561-47ef-8379-911f2b368662","created":"2022-09-20T20:13:47.969272+0000","modified":"2022-09-20T20:14:06.448325+0000","last_up_change":"2022-09-20T20:13:58.804121+0000","last_in_change":"2022-09-20T20:13:50.496167+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2022-09-20T20:13:59.325616+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_