2022-11-27T16:22:34.895 INFO:root:teuthology version: 0.0.1.dev3+g4da97cf 2022-11-27T16:22:34.897 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2022-11-23_17:24:26-fs-main-distro-default-smithi/7088660 --name yuriw-2022-11-23_17:24:26-fs-main-distro-default-smithi -- /home/teuthworker/archive/yuriw-2022-11-23_17:24:26-fs-main-distro-default-smithi/7088660/orig.config.yaml 2022-11-27T16:22:34.949 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-11-27T16:22:35.025 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2022-11-23_17:24:26-fs-main-distro-default-smithi/7088660 branch: main description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}} email: ceph-qa@ceph.io first_in_suite: false job_id: '7088660' kernel: client: sha1: distro kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2022-11-23_17:24:26-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 697b0d99d9a52df92b20c8e053dcd46c75f364a9 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 697b0d99d9a52df92b20c8e053dcd46c75f364a9 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 697b0d99d9a52df92b20c8e053dcd46c75f364a9 owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 697b0d99d9a52df92b20c8e053dcd46c75f364a9 sleep_before_teardown: 0 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_697b0d99d9a52df92b20c8e053dcd46c75f364a9/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 697b0d99d9a52df92b20c8e053dcd46c75f364a9 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi006.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCJN1ugGeXPsGEuGH5ewNMMxJOH/KiLFk4VTJf7ANy6YwBvXnIKkLUjegXxrADB8J/pGXHJ2QGKuoAuqzXibHG/n1O7SfeEQTRYz6KW6Ywe3Zfhu6vLBgh45LlWjtGO52FBGKavdWwc7MgJYJPiLe6oLuDFOaHMDD9xRHHyk8/wOBDlq1HvMnY6C3mKGx7GleDfibQ9NumH4+/dm42NjKY7x66M65i1XlVGDBBpQ8nMwUEo7FwO+uU9zihntWJpn+sXs9v0w1FIBTMJlqDmxbZVzuclnVe+5kAt1ndeXSjZ3Gnb3NAJtGV31Mp9ppEtLATiCY5c4UdXNXwQNEQmGlfZmKygi2/+ChcrPHovAx0rVQI4sYD25ck1YahSHp8BkIz12Vy11VLF07Paz+f2YPtT27zHcDt+Do1wy4KUmLCudoMpsujUe6kTH9LBzwlGpcOG9iVAufqAczv0KvhJq6LXFqc4UcbU2btOkKFyF1ohmMiKozctbdZyRBO+Q+VU+M= smithi055.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0fUECT3SW9Ppvd76JZDOyQE7f29pwtpCCiFeMbsfWJSp1LzSjH7tr0oG6gJ2MoJIZuF4fLtrKdFjeDYdrKV38rpZ64BrzePuaaPqgstLpCT9H1G77Xe776Qhj7s5FN+7rSpQt/zzB/tAW5ZZ8m3PwIKH5+3A2idxs+pJvAo28Q86tDrBKEIFF/jmdWn0MC5SXueiSG8WrkrYKwVZ9Me6+NqUu4bUU6X16cMVRQ1NHTb96gpA43HZuggK1peAp3XgLlj9OY4KvgtCrjevU7CC9ua5UFonMBFm1j4CCeXjXnAVK0TpW/0VfkZsVcaZuS3dzyY3YRigVy4UaEEYst3W/9xX3kERLn9XcLel4ULo1RNXddu35J5WIlYbkjnlNdxQqUpEpLfAgg0nyf5gkrOSH15wlgWdzd/dk8XDEK9brASrVBSR0O7hpiJ5PcVt5rRv49jr/LIp/9KCl9BRP0vUk/JawyDwwy9w+M2nvwrWZC0JPDYb+A86p3epSPw0jAB0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots - tasks.cephfs.test_volumes.TestSubvolumeSnapshots teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 4da97cf64e542f347ec47b7bdbe5eca99759f9b7 timestamp: 2022-11-23_17:24:26 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.20399 2022-11-27T16:22:35.025 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_697b0d99d9a52df92b20c8e053dcd46c75f364a9/qa; will attempt to use it 2022-11-27T16:22:35.026 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_697b0d99d9a52df92b20c8e053dcd46c75f364a9/qa/tasks 2022-11-27T16:22:35.026 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-11-27T16:22:35.028 INFO:teuthology.task.internal:Checking packages... 2022-11-27T16:22:35.053 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '697b0d99d9a52df92b20c8e053dcd46c75f364a9' 2022-11-27T16:22:35.054 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-11-27T16:22:35.054 INFO:teuthology.packaging:ref: None 2022-11-27T16:22:35.055 INFO:teuthology.packaging:tag: None 2022-11-27T16:22:35.055 INFO:teuthology.packaging:branch: main 2022-11-27T16:22:35.055 INFO:teuthology.packaging:sha1: 697b0d99d9a52df92b20c8e053dcd46c75f364a9 2022-11-27T16:22:35.056 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=main 2022-11-27T16:22:35.314 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-995.gaf6ed506 2022-11-27T16:22:35.315 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-11-27T16:22:35.322 INFO:teuthology.task.internal:no buildpackages task found 2022-11-27T16:22:35.322 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-11-27T16:22:35.329 INFO:teuthology.task.internal:Saving configuration 2022-11-27T16:22:35.356 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-11-27T16:22:35.366 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-11-27T16:22:35.395 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-11-23_17:24:26-fs-main-distro-default-smithi/7088660', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-11-27 16:17:54.997570', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGiFWy6Mb8vvp03oO/LPAj9XbUG02uGXMVM0xBw0/T/6jKCZj8AjodAGX1XNptmQYD8AqNQAzAcxPEiF2YlezuE='} 2022-11-27T16:22:35.421 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-11-23_17:24:26-fs-main-distro-default-smithi/7088660', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-11-27 16:17:54.996056', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKBV2yCeccJni9B9DdXMPcB1oXUfoScComIpVtH6f3ql4AV+rIQdmuv8NOuQzMTqHwwo5HaEZZu8RZ/EEbDx2E8='} 2022-11-27T16:22:35.421 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-11-27T16:22:35.431 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2022-11-27T16:22:35.432 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2022-11-27T16:22:35.432 INFO:teuthology.run_tasks:Running task console_log... 2022-11-27T16:22:35.510 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f13fa6b3840>, signals=[15]) 2022-11-27T16:22:35.512 INFO:teuthology.run_tasks:Running task internal.connect... 2022-11-27T16:22:35.519 INFO:teuthology.task.internal:Opening connections... 2022-11-27T16:22:35.520 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2022-11-27T16:22:35.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-11-27T16:22:35.650 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi055.front.sepia.ceph.com 2022-11-27T16:22:35.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-11-27T16:22:35.737 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-11-27T16:22:35.745 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2022-11-27T16:22:35.767 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2022-11-27T16:22:35.768 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2022-11-27T16:22:35.828 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux" 2022-11-27T16:22:35.828 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.6 (Ootpa)" 2022-11-27T16:22:35.829 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel" 2022-11-27T16:22:35.829 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora" 2022-11-27T16:22:35.830 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.6" 2022-11-27T16:22:35.830 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2022-11-27T16:22:35.831 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-11-27T16:22:35.831 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2022-11-27T16:22:35.831 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-11-27T16:22:35.831 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/" 2022-11-27T16:22:35.832 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-11-27T16:22:35.832 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-11-27T16:22:35.832 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:22:35.833 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-11-27T16:22:35.833 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-11-27T16:22:35.833 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-11-27T16:22:35.834 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-11-27T16:22:35.834 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2022-11-27T16:22:35.864 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2022-11-27T16:22:35.886 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2022-11-27T16:22:35.887 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2022-11-27T16:22:35.950 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Red Hat Enterprise Linux" 2022-11-27T16:22:35.950 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="8.6 (Ootpa)" 2022-11-27T16:22:35.951 INFO:teuthology.orchestra.run.smithi055.stdout:ID="rhel" 2022-11-27T16:22:35.951 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE="fedora" 2022-11-27T16:22:35.951 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="8.6" 2022-11-27T16:22:35.952 INFO:teuthology.orchestra.run.smithi055.stdout:PLATFORM_ID="platform:el8" 2022-11-27T16:22:35.952 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2022-11-27T16:22:35.952 INFO:teuthology.orchestra.run.smithi055.stdout:ANSI_COLOR="0;31" 2022-11-27T16:22:35.953 INFO:teuthology.orchestra.run.smithi055.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2022-11-27T16:22:35.953 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.redhat.com/" 2022-11-27T16:22:35.953 INFO:teuthology.orchestra.run.smithi055.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2022-11-27T16:22:35.953 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-11-27T16:22:35.954 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:22:35.954 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2022-11-27T16:22:35.954 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2022-11-27T16:22:35.954 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2022-11-27T16:22:35.954 INFO:teuthology.orchestra.run.smithi055.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2022-11-27T16:22:35.955 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2022-11-27T16:22:35.978 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-11-27T16:22:35.991 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-11-27T16:22:35.999 INFO:teuthology.task.internal:Checking for old test directory... 2022-11-27T16:22:36.000 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2022-11-27T16:22:36.012 DEBUG:teuthology.orchestra.run.smithi055:> test '!' -e /home/ubuntu/cephtest 2022-11-27T16:22:36.032 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-11-27T16:22:36.039 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-11-27T16:22:36.040 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2022-11-27T16:22:36.064 DEBUG:teuthology.orchestra.run.smithi055:> test -z $(ls -A /var/lib/ceph) 2022-11-27T16:22:36.096 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-11-27T16:22:36.152 INFO:teuthology.run_tasks:Running task kernel... 2022-11-27T16:22:36.179 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2022-11-27T16:22:36.180 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2022-11-27T16:22:36.180 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2022-11-27T16:22:36.181 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2022-11-27T16:22:36.182 DEBUG:teuthology.orchestra.run.smithi055:> test -f /run/.containerenv -o -f /.dockerenv 2022-11-27T16:22:36.203 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-11-27T16:22:36.204 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2022-11-27T16:22:36.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-11-27T16:22:36.207 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2022-11-27T16:22:36.265 INFO:teuthology.orchestra.run.smithi055.stdout:4.18.0-372.9.1.el8.x86_64 2022-11-27T16:22:36.266 INFO:teuthology.task.kernel:Running kernel on smithi055: 4.18.0-372.9.1.el8.x86_64 2022-11-27T16:22:36.266 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum install -y kernel 2022-11-27T16:22:36.268 INFO:teuthology.orchestra.run.smithi006.stdout:4.18.0-372.9.1.el8.x86_64 2022-11-27T16:22:36.268 INFO:teuthology.task.kernel:Running kernel on smithi006: 4.18.0-372.9.1.el8.x86_64 2022-11-27T16:22:36.268 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum install -y kernel 2022-11-27T16:22:37.195 INFO:teuthology.orchestra.run.smithi055.stdout:Updating Subscription Management repositories. 2022-11-27T16:22:37.196 INFO:teuthology.orchestra.run.smithi055.stdout:Unable to read consumer identity 2022-11-27T16:22:37.265 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2022-11-27T16:22:37.266 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2022-11-27T16:22:37.296 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:22:37.296 INFO:teuthology.orchestra.run.smithi055.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-11-27T16:22:37.296 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:22:37.334 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:22:37.335 INFO:teuthology.orchestra.run.smithi006.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-11-27T16:22:37.335 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:22:41.060 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for python3-asyncssh owned by ceph 1.3 kB/s | 3.5 kB 00:02 2022-11-27T16:22:42.044 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 14 MB/s | 13 MB 00:00 2022-11-27T16:22:42.542 INFO:teuthology.orchestra.run.smithi055.stdout:Copr repo for python3-asyncssh owned by ceph 886 B/s | 3.5 kB 00:04 2022-11-27T16:22:43.526 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 14 MB/s | 13 MB 00:00 2022-11-27T16:22:45.277 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 441 kB/s | 24 kB 00:00 2022-11-27T16:22:45.971 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2022-11-27T16:22:46.029 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2022-11-27T16:22:46.030 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do. 2022-11-27T16:22:46.031 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2022-11-27T16:22:46.150 DEBUG:teuthology.orchestra.run.smithi006:> echo no | sudo yum reinstall kernel || true 2022-11-27T16:22:46.500 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2022-11-27T16:22:46.501 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2022-11-27T16:22:46.572 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:22:46.572 INFO:teuthology.orchestra.run.smithi006.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-11-27T16:22:46.573 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:22:46.692 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 417 kB/s | 24 kB 00:00 2022-11-27T16:22:46.824 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:00:01 ago on Sun 27 Nov 2022 04:22:45 PM UTC. 2022-11-27T16:22:46.868 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2022-11-27T16:22:46.904 INFO:teuthology.orchestra.run.smithi006.stderr:Error: No packages marked for reinstall. 2022-11-27T16:22:46.952 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum reinstall -y kernel || true 2022-11-27T16:22:47.303 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2022-11-27T16:22:47.303 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2022-11-27T16:22:47.357 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:22:47.357 INFO:teuthology.orchestra.run.smithi006.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-11-27T16:22:47.358 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:22:47.403 INFO:teuthology.orchestra.run.smithi055.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2022-11-27T16:22:47.454 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2022-11-27T16:22:47.455 INFO:teuthology.orchestra.run.smithi055.stdout:Nothing to do. 2022-11-27T16:22:47.455 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2022-11-27T16:22:47.593 DEBUG:teuthology.orchestra.run.smithi055:> echo no | sudo yum reinstall kernel || true 2022-11-27T16:22:47.609 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:00:02 ago on Sun 27 Nov 2022 04:22:45 PM UTC. 2022-11-27T16:22:47.651 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2022-11-27T16:22:47.679 INFO:teuthology.orchestra.run.smithi006.stderr:Error: No packages marked for reinstall. 2022-11-27T16:22:47.731 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel --last | head -n 1 2022-11-27T16:22:47.813 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2022-11-27T16:22:47.815 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2022-11-27T16:22:47.815 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-11-27T16:22:47.816 DEBUG:teuthology.parallel:result is None 2022-11-27T16:22:47.985 INFO:teuthology.orchestra.run.smithi055.stdout:Updating Subscription Management repositories. 2022-11-27T16:22:47.985 INFO:teuthology.orchestra.run.smithi055.stdout:Unable to read consumer identity 2022-11-27T16:22:48.026 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:22:48.027 INFO:teuthology.orchestra.run.smithi055.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-11-27T16:22:48.027 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:22:48.279 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:00:02 ago on Sun 27 Nov 2022 04:22:46 PM UTC. 2022-11-27T16:22:48.325 INFO:teuthology.orchestra.run.smithi055.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2022-11-27T16:22:48.366 INFO:teuthology.orchestra.run.smithi055.stderr:Error: No packages marked for reinstall. 2022-11-27T16:22:48.413 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum reinstall -y kernel || true 2022-11-27T16:22:48.760 INFO:teuthology.orchestra.run.smithi055.stdout:Updating Subscription Management repositories. 2022-11-27T16:22:48.761 INFO:teuthology.orchestra.run.smithi055.stdout:Unable to read consumer identity 2022-11-27T16:22:48.805 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:22:48.805 INFO:teuthology.orchestra.run.smithi055.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2022-11-27T16:22:48.805 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:22:49.052 INFO:teuthology.orchestra.run.smithi055.stdout:Last metadata expiration check: 0:00:03 ago on Sun 27 Nov 2022 04:22:46 PM UTC. 2022-11-27T16:22:49.095 INFO:teuthology.orchestra.run.smithi055.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2022-11-27T16:22:49.122 INFO:teuthology.orchestra.run.smithi055.stderr:Error: No packages marked for reinstall. 2022-11-27T16:22:49.170 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q kernel --last | head -n 1 2022-11-27T16:22:49.253 INFO:teuthology.orchestra.run.smithi055.stdout:kernel-4.18.0-372.9.1.el8.x86_64 Thu 14 Jul 2022 06:23:21 PM UTC 2022-11-27T16:22:49.254 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2022-11-27T16:22:49.255 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-11-27T16:22:49.255 DEBUG:teuthology.parallel:result is None 2022-11-27T16:22:49.256 INFO:teuthology.run_tasks:Running task internal.base... 2022-11-27T16:22:49.266 INFO:teuthology.task.internal:Creating test directory... 2022-11-27T16:22:49.267 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-11-27T16:22:49.272 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-11-27T16:22:49.291 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-11-27T16:22:49.300 INFO:teuthology.run_tasks:Running task internal.archive... 2022-11-27T16:22:49.309 INFO:teuthology.task.internal:Creating archive directory... 2022-11-27T16:22:49.310 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-11-27T16:22:49.334 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-11-27T16:22:49.375 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-11-27T16:22:49.383 INFO:teuthology.task.internal:Enabling coredump saving... 2022-11-27T16:22:49.383 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-11-27T16:22:49.402 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-11-27T16:22:49.438 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-11-27T16:22:49.450 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-11-27T16:22:49.458 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-11-27T16:22:49.470 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-11-27T16:22:49.473 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-11-27T16:22:49.485 INFO:teuthology.task.internal:Configuring sudo... 2022-11-27T16:22:49.486 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-11-27T16:22:49.503 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-11-27T16:22:49.541 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-11-27T16:22:49.550 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-11-27T16:22:49.551 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-11-27T16:22:49.576 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-11-27T16:22:49.598 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-11-27T16:22:49.677 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-11-27T16:22:49.767 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-11-27T16:22:49.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-11-27T16:22:49.856 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:22:49.858 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-11-27T16:22:49.926 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-11-27T16:22:49.972 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-11-27T16:22:50.069 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-11-27T16:22:50.122 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-11-27T16:22:50.156 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:22:50.157 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-11-27T16:22:50.225 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2022-11-27T16:22:50.227 DEBUG:teuthology.orchestra.run.smithi055:> sudo service rsyslog restart 2022-11-27T16:22:50.274 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-11-27T16:22:50.315 INFO:teuthology.orchestra.run.smithi055.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-11-27T16:22:50.708 INFO:teuthology.run_tasks:Running task internal.timer... 2022-11-27T16:22:50.720 INFO:teuthology.task.internal:Starting timer... 2022-11-27T16:22:50.720 INFO:teuthology.run_tasks:Running task pcp... 2022-11-27T16:22:50.731 INFO:teuthology.run_tasks:Running task selinux... 2022-11-27T16:22:50.740 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2022-11-27T16:22:50.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo service auditd rotate 2022-11-27T16:22:50.793 INFO:teuthology.orchestra.run.smithi006.stdout:Rotating logs: 2022-11-27T16:22:50.795 DEBUG:teuthology.orchestra.run.smithi055:> sudo service auditd rotate 2022-11-27T16:22:50.861 INFO:teuthology.orchestra.run.smithi055.stdout:Rotating logs: 2022-11-27T16:22:50.863 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-11-27T16:22:50.863 DEBUG:teuthology.orchestra.run.smithi006:> /usr/sbin/getenforce 2022-11-27T16:22:50.891 INFO:teuthology.orchestra.run.smithi006.stdout:Permissive 2022-11-27T16:22:50.892 DEBUG:teuthology.orchestra.run.smithi055:> /usr/sbin/getenforce 2022-11-27T16:22:50.916 INFO:teuthology.orchestra.run.smithi055.stdout:Permissive 2022-11-27T16:22:50.917 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi006.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi055.front.sepia.ceph.com': 'permissive'} 2022-11-27T16:22:50.917 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-11-27T16:22:50.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-11-27T16:22:50.960 DEBUG:teuthology.orchestra.run.smithi055:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-11-27T16:22:50.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-11-27T16:22:50.989 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-11-27T16:22:50.990 DEBUG:teuthology.orchestra.run.smithi006:> sudo /usr/sbin/setenforce permissive 2022-11-27T16:22:51.031 DEBUG:teuthology.orchestra.run.smithi055:> sudo /usr/sbin/setenforce permissive 2022-11-27T16:22:51.062 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-11-27T16:22:51.072 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2022-11-27T16:22:51.073 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2022-11-27T16:22:51.097 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-11-27T16:22:51.098 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi055.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2022-11-27T16:31:04.068 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi055.front.sepia.ceph.com')] 2022-11-27T16:31:04.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2022-11-27T16:31:04.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-11-27T16:31:04.183 DEBUG:teuthology.orchestra.run.smithi006:> true 2022-11-27T16:31:04.255 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2022-11-27T16:31:04.256 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-11-27T16:31:04.338 DEBUG:teuthology.orchestra.run.smithi055:> true 2022-11-27T16:31:04.407 INFO:teuthology.run_tasks:Running task clock... 2022-11-27T16:31:04.420 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-11-27T16:31:04.421 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-11-27T16:31:04.423 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-11-27T16:31:04.426 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-11-27T16:31:04.427 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-11-27T16:31:04.460 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-11-27T16:31:04.477 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-11-27T16:31:04.486 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-11-27T16:31:04.502 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-11-27T16:31:04.546 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: ntpd: command not found 2022-11-27T16:31:04.559 INFO:teuthology.orchestra.run.smithi006.stdout:506 Cannot talk to daemon 2022-11-27T16:31:04.575 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: ntpd: command not found 2022-11-27T16:31:04.576 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-11-27T16:31:04.588 INFO:teuthology.orchestra.run.smithi055.stdout:506 Cannot talk to daemon 2022-11-27T16:31:04.591 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-11-27T16:31:04.603 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-11-27T16:31:04.618 INFO:teuthology.orchestra.run.smithi055.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-11-27T16:31:04.670 INFO:teuthology.orchestra.run.smithi006.stderr:bash: ntpq: command not found 2022-11-27T16:31:04.674 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-11-27T16:31:04.675 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2022-11-27T16:31:04.675 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-11-27T16:31:04.676 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-11-27T16:31:04.676 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-11-27T16:31:04.676 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-11-27T16:31:04.692 INFO:teuthology.orchestra.run.smithi055.stderr:bash: ntpq: command not found 2022-11-27T16:31:04.696 INFO:teuthology.orchestra.run.smithi055.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-11-27T16:31:04.697 INFO:teuthology.orchestra.run.smithi055.stdout:=============================================================================== 2022-11-27T16:31:04.697 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-11-27T16:31:04.697 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-11-27T16:31:04.697 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-11-27T16:31:04.698 INFO:teuthology.orchestra.run.smithi055.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-11-27T16:31:04.698 INFO:teuthology.run_tasks:Running task install... 2022-11-27T16:31:04.710 DEBUG:teuthology.task.install:project ceph 2022-11-27T16:31:04.711 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '697b0d99d9a52df92b20c8e053dcd46c75f364a9'}} 2022-11-27T16:31:04.711 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '697b0d99d9a52df92b20c8e053dcd46c75f364a9'} 2022-11-27T16:31:04.712 INFO:teuthology.task.install:Using flavor: default 2022-11-27T16:31:04.726 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-11-27T16:31:04.727 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2022-11-27T16:31:04.728 DEBUG:teuthology.orchestra.run.smithi006:> sudo lsb_release -is 2022-11-27T16:31:04.773 INFO:teuthology.orchestra.run.smithi006.stdout:RedHatEnterprise 2022-11-27T16:31:04.775 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-11-27T16:31:04.775 DEBUG:teuthology.orchestra.run.smithi055:> sudo lsb_release -is 2022-11-27T16:31:04.776 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '697b0d99d9a52df92b20c8e053dcd46c75f364a9', 'tag': None, 'wait_for_package': False} 2022-11-27T16:31:04.777 DEBUG:teuthology.orchestra.run.smithi006:> sudo lsb_release -is 2022-11-27T16:31:04.819 INFO:teuthology.orchestra.run.smithi055.stdout:RedHatEnterprise 2022-11-27T16:31:04.821 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-11-27T16:31:04.821 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '697b0d99d9a52df92b20c8e053dcd46c75f364a9', 'tag': None, 'wait_for_package': False} 2022-11-27T16:31:04.821 DEBUG:teuthology.orchestra.run.smithi055:> sudo lsb_release -is 2022-11-27T16:31:04.858 INFO:teuthology.orchestra.run.smithi006.stdout:RedHatEnterprise 2022-11-27T16:31:04.859 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-11-27T16:31:04.860 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=697b0d99d9a52df92b20c8e053dcd46c75f364a9 2022-11-27T16:31:04.907 INFO:teuthology.orchestra.run.smithi055.stdout:RedHatEnterprise 2022-11-27T16:31:04.908 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-11-27T16:31:04.909 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=697b0d99d9a52df92b20c8e053dcd46c75f364a9 2022-11-27T16:31:05.020 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/697b0d99d9a52df92b20c8e053dcd46c75f364a9/centos/8/flavors/default/ 2022-11-27T16:31:05.021 INFO:teuthology.task.install.rpm:Package version is 18.0.0-594.g697b0d99 2022-11-27T16:31:05.057 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/697b0d99d9a52df92b20c8e053dcd46c75f364a9/centos/8/flavors/default/ 2022-11-27T16:31:05.057 INFO:teuthology.task.install.rpm:Package version is 18.0.0-594.g697b0d99 2022-11-27T16:31:05.178 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/697b0d99d9a52df92b20c8e053dcd46c75f364a9/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/697b0d99d9a52df92b20c8e053dcd46c75f364a9/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/697b0d99d9a52df92b20c8e053dcd46c75f364a9/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-11-27T16:31:05.178 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:31:05.179 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-11-27T16:31:05.209 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2022-11-27T16:31:05.210 DEBUG:teuthology.orchestra.run.smithi006:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/697b0d99d9a52df92b20c8e053dcd46c75f364a9/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-11-27T16:31:05.220 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/697b0d99d9a52df92b20c8e053dcd46c75f364a9/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/697b0d99d9a52df92b20c8e053dcd46c75f364a9/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/697b0d99d9a52df92b20c8e053dcd46c75f364a9/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-11-27T16:31:05.221 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:31:05.222 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-11-27T16:31:05.251 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2022-11-27T16:31:05.252 DEBUG:teuthology.orchestra.run.smithi055:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/697b0d99d9a52df92b20c8e053dcd46c75f364a9/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-11-27T16:31:05.280 DEBUG:teuthology.orchestra.run.smithi006:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-11-27T16:31:05.321 DEBUG:teuthology.orchestra.run.smithi055:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-11-27T16:31:05.360 DEBUG:teuthology.orchestra.run.smithi006:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-11-27T16:31:05.400 DEBUG:teuthology.orchestra.run.smithi055:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-11-27T16:31:05.427 INFO:teuthology.orchestra.run.smithi006.stdout:check_obsoletes = 1 2022-11-27T16:31:05.429 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum clean all 2022-11-27T16:31:05.473 INFO:teuthology.orchestra.run.smithi055.stdout:check_obsoletes = 1 2022-11-27T16:31:05.474 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum clean all 2022-11-27T16:31:05.824 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2022-11-27T16:31:05.865 INFO:teuthology.orchestra.run.smithi055.stdout:Updating Subscription Management repositories. 2022-11-27T16:31:06.034 INFO:teuthology.orchestra.run.smithi006.stdout:54 files removed 2022-11-27T16:31:06.076 INFO:teuthology.orchestra.run.smithi055.stdout:54 files removed 2022-11-27T16:31:06.082 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2022-11-27T16:31:06.124 DEBUG:teuthology.orchestra.run.smithi055:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2022-11-27T16:31:06.431 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2022-11-27T16:31:06.482 INFO:teuthology.orchestra.run.smithi055.stdout:Updating Subscription Management repositories. 2022-11-27T16:31:07.216 INFO:teuthology.orchestra.run.smithi006.stdout:ceph packages for x86_64 182 kB/s | 81 kB 00:00 2022-11-27T16:31:07.286 INFO:teuthology.orchestra.run.smithi055.stdout:ceph packages for x86_64 174 kB/s | 81 kB 00:00 2022-11-27T16:31:07.642 INFO:teuthology.orchestra.run.smithi006.stdout:ceph noarch packages 24 kB/s | 9.4 kB 00:00 2022-11-27T16:31:07.728 INFO:teuthology.orchestra.run.smithi055.stdout:ceph noarch packages 23 kB/s | 9.4 kB 00:00 2022-11-27T16:31:08.209 INFO:teuthology.orchestra.run.smithi006.stdout:ceph source packages 2.8 kB/s | 1.5 kB 00:00 2022-11-27T16:31:08.287 INFO:teuthology.orchestra.run.smithi055.stdout:ceph source packages 2.8 kB/s | 1.5 kB 00:00 2022-11-27T16:31:12.029 INFO:teuthology.orchestra.run.smithi055.stdout:Copr repo for python3-asyncssh owned by ceph 954 B/s | 3.5 kB 00:03 2022-11-27T16:31:12.134 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for python3-asyncssh owned by ceph 909 B/s | 3.5 kB 00:03 2022-11-27T16:31:13.035 INFO:teuthology.orchestra.run.smithi055.stdout:Extra Packages for Enterprise Linux 13 MB/s | 13 MB 00:00 2022-11-27T16:31:13.193 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 13 MB/s | 13 MB 00:01 2022-11-27T16:31:16.205 INFO:teuthology.orchestra.run.smithi055.stdout:lab-extras 354 kB/s | 24 kB 00:00 2022-11-27T16:31:16.335 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 466 kB/s | 24 kB 00:00 2022-11-27T16:31:17.040 INFO:teuthology.orchestra.run.smithi055.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 62 MB/s | 48 MB 00:00 2022-11-27T16:31:17.095 INFO:teuthology.orchestra.run.smithi006.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 69 MB/s | 48 MB 00:00 2022-11-27T16:31:25.846 INFO:teuthology.orchestra.run.smithi006.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 68 MB/s | 53 MB 00:00 2022-11-27T16:31:25.866 INFO:teuthology.orchestra.run.smithi055.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 49 MB/s | 53 MB 00:01 2022-11-27T16:31:37.739 INFO:teuthology.orchestra.run.smithi006.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-11-27T16:31:37.740 INFO:teuthology.orchestra.run.smithi006.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-11-27T16:31:37.756 INFO:teuthology.orchestra.run.smithi006.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2022-11-27T16:31:37.757 INFO:teuthology.orchestra.run.smithi006.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2022-11-27T16:31:37.758 INFO:teuthology.orchestra.run.smithi006.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2022-11-27T16:31:37.760 INFO:teuthology.orchestra.run.smithi006.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-11-27T16:31:37.762 INFO:teuthology.orchestra.run.smithi006.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-11-27T16:31:37.766 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2022-11-27T16:31:37.767 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-11-27T16:31:37.865 INFO:teuthology.orchestra.run.smithi055.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-11-27T16:31:37.867 INFO:teuthology.orchestra.run.smithi055.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-11-27T16:31:37.882 INFO:teuthology.orchestra.run.smithi055.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2022-11-27T16:31:37.883 INFO:teuthology.orchestra.run.smithi055.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2022-11-27T16:31:37.884 INFO:teuthology.orchestra.run.smithi055.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2022-11-27T16:31:37.885 INFO:teuthology.orchestra.run.smithi055.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-11-27T16:31:37.887 INFO:teuthology.orchestra.run.smithi055.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-11-27T16:31:37.891 INFO:teuthology.orchestra.run.smithi055.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2022-11-27T16:31:37.892 INFO:teuthology.orchestra.run.smithi055.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-11-27T16:31:37.911 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2022-11-27T16:31:37.925 INFO:teuthology.orchestra.run.smithi006.stdout:=========================================================================================================================== 2022-11-27T16:31:37.925 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2022-11-27T16:31:37.926 INFO:teuthology.orchestra.run.smithi006.stdout:=========================================================================================================================== 2022-11-27T16:31:37.926 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2022-11-27T16:31:37.926 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2022-11-27T16:31:37.926 INFO:teuthology.orchestra.run.smithi006.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-11-27T16:31:37.927 INFO:teuthology.orchestra.run.smithi006.stdout: ceph x86_64 2:18.0.0-594.g697b0d99.el8 ceph 6.4 k 2022-11-27T16:31:37.927 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base x86_64 2:18.0.0-594.g697b0d99.el8 ceph 5.2 M 2022-11-27T16:31:37.927 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse x86_64 2:18.0.0-594.g697b0d99.el8 ceph 845 k 2022-11-27T16:31:37.927 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-594.g697b0d99.el8 ceph 165 k 2022-11-27T16:31:37.928 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr x86_64 2:18.0.0-594.g697b0d99.el8 ceph 1.5 M 2022-11-27T16:31:37.928 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 118 k 2022-11-27T16:31:37.928 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 1.7 M 2022-11-27T16:31:37.928 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 7.4 M 2022-11-27T16:31:37.928 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 47 k 2022-11-27T16:31:37.929 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw x86_64 2:18.0.0-594.g697b0d99.el8 ceph 18 M 2022-11-27T16:31:37.929 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test x86_64 2:18.0.0-594.g697b0d99.el8 ceph 55 M 2022-11-27T16:31:37.929 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 263 k 2022-11-27T16:31:37.929 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 81 k 2022-11-27T16:31:37.930 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror x86_64 2:18.0.0-594.g697b0d99.el8 ceph 257 k 2022-11-27T16:31:37.930 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 15 k 2022-11-27T16:31:37.930 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2022-11-27T16:31:37.930 INFO:teuthology.orchestra.run.smithi006.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-11-27T16:31:37.931 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-11-27T16:31:37.931 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel x86_64 2:18.0.0-594.g697b0d99.el8 ceph 30 k 2022-11-27T16:31:37.931 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2 x86_64 2:18.0.0-594.g697b0d99.el8 ceph 767 k 2022-11-27T16:31:37.931 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel x86_64 2:18.0.0-594.g697b0d99.el8 ceph 139 k 2022-11-27T16:31:37.932 INFO:teuthology.orchestra.run.smithi006.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-11-27T16:31:37.932 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2022-11-27T16:31:37.932 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-11-27T16:31:37.932 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2022-11-27T16:31:37.933 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2022-11-27T16:31:37.933 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2022-11-27T16:31:37.933 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs x86_64 2:18.0.0-594.g697b0d99.el8 ceph 190 k 2022-11-27T16:31:37.933 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados x86_64 2:18.0.0-594.g697b0d99.el8 ceph 371 k 2022-11-27T16:31:37.933 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd x86_64 2:18.0.0-594.g697b0d99.el8 ceph 357 k 2022-11-27T16:31:37.934 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw x86_64 2:18.0.0-594.g697b0d99.el8 ceph 107 k 2022-11-27T16:31:37.934 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse x86_64 2:18.0.0-594.g697b0d99.el8 ceph 94 k 2022-11-27T16:31:37.934 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror x86_64 2:18.0.0-594.g697b0d99.el8 ceph 3.5 M 2022-11-27T16:31:37.934 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd x86_64 2:18.0.0-594.g697b0d99.el8 ceph 175 k 2022-11-27T16:31:37.935 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2022-11-27T16:31:37.935 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrading: 2022-11-27T16:31:37.935 INFO:teuthology.orchestra.run.smithi006.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2022-11-27T16:31:37.935 INFO:teuthology.orchestra.run.smithi006.stdout: librados2 x86_64 2:18.0.0-594.g697b0d99.el8 ceph 3.6 M 2022-11-27T16:31:37.936 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1 x86_64 2:18.0.0-594.g697b0d99.el8 ceph 3.6 M 2022-11-27T16:31:37.936 INFO:teuthology.orchestra.run.smithi006.stdout: openssl x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 709 k 2022-11-27T16:31:37.936 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-libs x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 1.5 M 2022-11-27T16:31:37.936 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2022-11-27T16:31:37.936 INFO:teuthology.orchestra.run.smithi006.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-11-27T16:31:37.937 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common x86_64 2:18.0.0-594.g697b0d99.el8 ceph 24 M 2022-11-27T16:31:37.937 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 23 k 2022-11-27T16:31:37.937 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds x86_64 2:18.0.0-594.g697b0d99.el8 ceph 2.3 M 2022-11-27T16:31:37.937 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 234 k 2022-11-27T16:31:37.938 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon x86_64 2:18.0.0-594.g697b0d99.el8 ceph 3.9 M 2022-11-27T16:31:37.938 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd x86_64 2:18.0.0-594.g697b0d99.el8 ceph 17 M 2022-11-27T16:31:37.938 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 14 k 2022-11-27T16:31:37.938 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux x86_64 2:18.0.0-594.g697b0d99.el8 ceph 24 k 2022-11-27T16:31:37.938 INFO:teuthology.orchestra.run.smithi006.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-11-27T16:31:37.939 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-11-27T16:31:37.939 INFO:teuthology.orchestra.run.smithi006.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2022-11-27T16:31:37.939 INFO:teuthology.orchestra.run.smithi006.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-11-27T16:31:37.939 INFO:teuthology.orchestra.run.smithi006.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2022-11-27T16:31:37.940 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite x86_64 2:18.0.0-594.g697b0d99.el8 ceph 137 k 2022-11-27T16:31:37.940 INFO:teuthology.orchestra.run.smithi006.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2022-11-27T16:31:37.940 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2022-11-27T16:31:37.940 INFO:teuthology.orchestra.run.smithi006.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-11-27T16:31:37.940 INFO:teuthology.orchestra.run.smithi006.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2022-11-27T16:31:37.941 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2022-11-27T16:31:37.941 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-11-27T16:31:37.941 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 x86_64 2:18.0.0-594.g697b0d99.el8 ceph 474 k 2022-11-27T16:31:37.941 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2022-11-27T16:31:37.942 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2 x86_64 2:18.0.0-594.g697b0d99.el8 ceph 6.5 M 2022-11-27T16:31:37.942 INFO:teuthology.orchestra.run.smithi006.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-11-27T16:31:37.942 INFO:teuthology.orchestra.run.smithi006.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2022-11-27T16:31:37.942 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-11-27T16:31:37.942 INFO:teuthology.orchestra.run.smithi006.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-11-27T16:31:37.943 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-11-27T16:31:37.943 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-11-27T16:31:37.943 INFO:teuthology.orchestra.run.smithi006.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-11-27T16:31:37.943 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2022-11-27T16:31:37.944 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-11-27T16:31:37.944 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-11-27T16:31:37.944 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-11-27T16:31:37.944 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-11-27T16:31:37.944 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-11-27T16:31:37.945 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-11-27T16:31:37.945 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-11-27T16:31:37.945 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-11-27T16:31:37.945 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse x86_64 2:18.0.0-594.g697b0d99.el8 ceph 45 k 2022-11-27T16:31:37.945 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common x86_64 2:18.0.0-594.g697b0d99.el8 ceph 109 k 2022-11-27T16:31:37.946 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-11-27T16:31:37.946 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-11-27T16:31:37.946 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-11-27T16:31:37.946 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-11-27T16:31:37.947 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-11-27T16:31:37.947 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-11-27T16:31:37.947 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-11-27T16:31:37.947 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-11-27T16:31:37.947 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2022-11-27T16:31:37.948 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-11-27T16:31:37.948 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-11-27T16:31:37.948 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-11-27T16:31:37.948 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-11-27T16:31:37.948 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-11-27T16:31:37.949 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-11-27T16:31:37.949 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-11-27T16:31:37.949 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-11-27T16:31:37.949 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-11-27T16:31:37.950 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-11-27T16:31:37.950 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-11-27T16:31:37.950 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-11-27T16:31:37.950 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-11-27T16:31:37.950 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-11-27T16:31:37.951 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-11-27T16:31:37.951 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-11-27T16:31:37.951 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-11-27T16:31:37.951 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-11-27T16:31:37.952 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-11-27T16:31:37.952 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-11-27T16:31:37.952 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-11-27T16:31:37.952 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-11-27T16:31:37.952 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-11-27T16:31:37.953 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-11-27T16:31:37.953 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2022-11-27T16:31:37.953 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-11-27T16:31:37.953 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-11-27T16:31:37.953 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-11-27T16:31:37.954 INFO:teuthology.orchestra.run.smithi006.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-11-27T16:31:37.954 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-11-27T16:31:37.954 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-11-27T16:31:37.954 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-11-27T16:31:37.955 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-11-27T16:31:37.955 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-11-27T16:31:37.955 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-11-27T16:31:37.955 INFO:teuthology.orchestra.run.smithi006.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2022-11-27T16:31:37.955 INFO:teuthology.orchestra.run.smithi006.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-11-27T16:31:37.956 INFO:teuthology.orchestra.run.smithi006.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2022-11-27T16:31:37.956 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2022-11-27T16:31:37.956 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2022-11-27T16:31:37.956 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling module streams: 2022-11-27T16:31:37.956 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql 10 2022-11-27T16:31:37.957 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:31:37.957 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2022-11-27T16:31:37.957 INFO:teuthology.orchestra.run.smithi006.stdout:=========================================================================================================================== 2022-11-27T16:31:37.957 INFO:teuthology.orchestra.run.smithi006.stdout:Install 128 Packages 2022-11-27T16:31:37.958 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade 5 Packages 2022-11-27T16:31:37.958 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:31:37.958 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 219 M 2022-11-27T16:31:37.959 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2022-11-27T16:31:38.033 INFO:teuthology.orchestra.run.smithi055.stdout:Dependencies resolved. 2022-11-27T16:31:38.047 INFO:teuthology.orchestra.run.smithi055.stdout:=========================================================================================================================== 2022-11-27T16:31:38.047 INFO:teuthology.orchestra.run.smithi055.stdout: Package Arch Version Repository Size 2022-11-27T16:31:38.047 INFO:teuthology.orchestra.run.smithi055.stdout:=========================================================================================================================== 2022-11-27T16:31:38.047 INFO:teuthology.orchestra.run.smithi055.stdout:Installing: 2022-11-27T16:31:38.048 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2022-11-27T16:31:38.048 INFO:teuthology.orchestra.run.smithi055.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2022-11-27T16:31:38.048 INFO:teuthology.orchestra.run.smithi055.stdout: ceph x86_64 2:18.0.0-594.g697b0d99.el8 ceph 6.4 k 2022-11-27T16:31:38.048 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base x86_64 2:18.0.0-594.g697b0d99.el8 ceph 5.2 M 2022-11-27T16:31:38.049 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse x86_64 2:18.0.0-594.g697b0d99.el8 ceph 845 k 2022-11-27T16:31:38.049 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-594.g697b0d99.el8 ceph 165 k 2022-11-27T16:31:38.049 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr x86_64 2:18.0.0-594.g697b0d99.el8 ceph 1.5 M 2022-11-27T16:31:38.049 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 118 k 2022-11-27T16:31:38.050 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 1.7 M 2022-11-27T16:31:38.050 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 7.4 M 2022-11-27T16:31:38.050 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 47 k 2022-11-27T16:31:38.050 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw x86_64 2:18.0.0-594.g697b0d99.el8 ceph 18 M 2022-11-27T16:31:38.051 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test x86_64 2:18.0.0-594.g697b0d99.el8 ceph 55 M 2022-11-27T16:31:38.051 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-volume noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 263 k 2022-11-27T16:31:38.051 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 81 k 2022-11-27T16:31:38.051 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror x86_64 2:18.0.0-594.g697b0d99.el8 ceph 257 k 2022-11-27T16:31:38.052 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-top noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 15 k 2022-11-27T16:31:38.052 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2022-11-27T16:31:38.052 INFO:teuthology.orchestra.run.smithi055.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2022-11-27T16:31:38.053 INFO:teuthology.orchestra.run.smithi055.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2022-11-27T16:31:38.053 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel x86_64 2:18.0.0-594.g697b0d99.el8 ceph 30 k 2022-11-27T16:31:38.053 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2 x86_64 2:18.0.0-594.g697b0d99.el8 ceph 767 k 2022-11-27T16:31:38.053 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel x86_64 2:18.0.0-594.g697b0d99.el8 ceph 139 k 2022-11-27T16:31:38.054 INFO:teuthology.orchestra.run.smithi055.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2022-11-27T16:31:38.054 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2022-11-27T16:31:38.054 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2022-11-27T16:31:38.054 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2022-11-27T16:31:38.055 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2022-11-27T16:31:38.055 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2022-11-27T16:31:38.055 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs x86_64 2:18.0.0-594.g697b0d99.el8 ceph 190 k 2022-11-27T16:31:38.055 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados x86_64 2:18.0.0-594.g697b0d99.el8 ceph 371 k 2022-11-27T16:31:38.056 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd x86_64 2:18.0.0-594.g697b0d99.el8 ceph 357 k 2022-11-27T16:31:38.056 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw x86_64 2:18.0.0-594.g697b0d99.el8 ceph 107 k 2022-11-27T16:31:38.056 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse x86_64 2:18.0.0-594.g697b0d99.el8 ceph 94 k 2022-11-27T16:31:38.056 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror x86_64 2:18.0.0-594.g697b0d99.el8 ceph 3.5 M 2022-11-27T16:31:38.056 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd x86_64 2:18.0.0-594.g697b0d99.el8 ceph 175 k 2022-11-27T16:31:38.057 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2022-11-27T16:31:38.057 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrading: 2022-11-27T16:31:38.057 INFO:teuthology.orchestra.run.smithi055.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2022-11-27T16:31:38.057 INFO:teuthology.orchestra.run.smithi055.stdout: librados2 x86_64 2:18.0.0-594.g697b0d99.el8 ceph 3.6 M 2022-11-27T16:31:38.058 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1 x86_64 2:18.0.0-594.g697b0d99.el8 ceph 3.6 M 2022-11-27T16:31:38.058 INFO:teuthology.orchestra.run.smithi055.stdout: openssl x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 709 k 2022-11-27T16:31:38.058 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-libs x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 1.5 M 2022-11-27T16:31:38.058 INFO:teuthology.orchestra.run.smithi055.stdout:Installing dependencies: 2022-11-27T16:31:38.059 INFO:teuthology.orchestra.run.smithi055.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2022-11-27T16:31:38.059 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common x86_64 2:18.0.0-594.g697b0d99.el8 ceph 24 M 2022-11-27T16:31:38.059 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 23 k 2022-11-27T16:31:38.059 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds x86_64 2:18.0.0-594.g697b0d99.el8 ceph 2.3 M 2022-11-27T16:31:38.060 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 234 k 2022-11-27T16:31:38.060 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon x86_64 2:18.0.0-594.g697b0d99.el8 ceph 3.9 M 2022-11-27T16:31:38.060 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd x86_64 2:18.0.0-594.g697b0d99.el8 ceph 17 M 2022-11-27T16:31:38.061 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts noarch 2:18.0.0-594.g697b0d99.el8 ceph-noarch 14 k 2022-11-27T16:31:38.061 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux x86_64 2:18.0.0-594.g697b0d99.el8 ceph 24 k 2022-11-27T16:31:38.061 INFO:teuthology.orchestra.run.smithi055.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2022-11-27T16:31:38.061 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-11-27T16:31:38.061 INFO:teuthology.orchestra.run.smithi055.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2022-11-27T16:31:38.062 INFO:teuthology.orchestra.run.smithi055.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2022-11-27T16:31:38.062 INFO:teuthology.orchestra.run.smithi055.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2022-11-27T16:31:38.062 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite x86_64 2:18.0.0-594.g697b0d99.el8 ceph 137 k 2022-11-27T16:31:38.062 INFO:teuthology.orchestra.run.smithi055.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2022-11-27T16:31:38.063 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2022-11-27T16:31:38.063 INFO:teuthology.orchestra.run.smithi055.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-11-27T16:31:38.063 INFO:teuthology.orchestra.run.smithi055.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2022-11-27T16:31:38.063 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2022-11-27T16:31:38.064 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2022-11-27T16:31:38.064 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1 x86_64 2:18.0.0-594.g697b0d99.el8 ceph 474 k 2022-11-27T16:31:38.064 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2022-11-27T16:31:38.064 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2 x86_64 2:18.0.0-594.g697b0d99.el8 ceph 6.5 M 2022-11-27T16:31:38.065 INFO:teuthology.orchestra.run.smithi055.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2022-11-27T16:31:38.065 INFO:teuthology.orchestra.run.smithi055.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2022-11-27T16:31:38.065 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-11-27T16:31:38.065 INFO:teuthology.orchestra.run.smithi055.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2022-11-27T16:31:38.066 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2022-11-27T16:31:38.066 INFO:teuthology.orchestra.run.smithi055.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2022-11-27T16:31:38.066 INFO:teuthology.orchestra.run.smithi055.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2022-11-27T16:31:38.066 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2022-11-27T16:31:38.066 INFO:teuthology.orchestra.run.smithi055.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2022-11-27T16:31:38.067 INFO:teuthology.orchestra.run.smithi055.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2022-11-27T16:31:38.067 INFO:teuthology.orchestra.run.smithi055.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2022-11-27T16:31:38.067 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-11-27T16:31:38.067 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2022-11-27T16:31:38.068 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-11-27T16:31:38.068 INFO:teuthology.orchestra.run.smithi055.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-11-27T16:31:38.068 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-11-27T16:31:38.068 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse x86_64 2:18.0.0-594.g697b0d99.el8 ceph 45 k 2022-11-27T16:31:38.069 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common x86_64 2:18.0.0-594.g697b0d99.el8 ceph 109 k 2022-11-27T16:31:38.069 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-11-27T16:31:38.069 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2022-11-27T16:31:38.069 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-11-27T16:31:38.070 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-11-27T16:31:38.070 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2022-11-27T16:31:38.070 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-11-27T16:31:38.070 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-11-27T16:31:38.070 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-11-27T16:31:38.071 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2022-11-27T16:31:38.071 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2022-11-27T16:31:38.071 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2022-11-27T16:31:38.072 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-11-27T16:31:38.072 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-11-27T16:31:38.072 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-11-27T16:31:38.072 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2022-11-27T16:31:38.072 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2022-11-27T16:31:38.073 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-11-27T16:31:38.073 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-11-27T16:31:38.073 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2022-11-27T16:31:38.073 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2022-11-27T16:31:38.074 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2022-11-27T16:31:38.074 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-11-27T16:31:38.074 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-11-27T16:31:38.074 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2022-11-27T16:31:38.075 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2022-11-27T16:31:38.075 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2022-11-27T16:31:38.075 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2022-11-27T16:31:38.075 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2022-11-27T16:31:38.075 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2022-11-27T16:31:38.076 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-11-27T16:31:38.076 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2022-11-27T16:31:38.076 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-11-27T16:31:38.076 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-11-27T16:31:38.077 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2022-11-27T16:31:38.077 INFO:teuthology.orchestra.run.smithi055.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-11-27T16:31:38.077 INFO:teuthology.orchestra.run.smithi055.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-11-27T16:31:38.078 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-11-27T16:31:38.078 INFO:teuthology.orchestra.run.smithi055.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-11-27T16:31:38.078 INFO:teuthology.orchestra.run.smithi055.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-11-27T16:31:38.078 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-11-27T16:31:38.079 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-11-27T16:31:38.079 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-11-27T16:31:38.079 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2022-11-27T16:31:38.079 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-11-27T16:31:38.080 INFO:teuthology.orchestra.run.smithi055.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2022-11-27T16:31:38.080 INFO:teuthology.orchestra.run.smithi055.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-11-27T16:31:38.081 INFO:teuthology.orchestra.run.smithi055.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2022-11-27T16:31:38.081 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2022-11-27T16:31:38.082 INFO:teuthology.orchestra.run.smithi055.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2022-11-27T16:31:38.082 INFO:teuthology.orchestra.run.smithi055.stdout:Enabling module streams: 2022-11-27T16:31:38.083 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql 10 2022-11-27T16:31:38.083 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:31:38.084 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction Summary 2022-11-27T16:31:38.084 INFO:teuthology.orchestra.run.smithi055.stdout:=========================================================================================================================== 2022-11-27T16:31:38.085 INFO:teuthology.orchestra.run.smithi055.stdout:Install 128 Packages 2022-11-27T16:31:38.085 INFO:teuthology.orchestra.run.smithi055.stdout:Upgrade 5 Packages 2022-11-27T16:31:38.086 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:31:38.087 INFO:teuthology.orchestra.run.smithi055.stdout:Total download size: 219 M 2022-11-27T16:31:38.088 INFO:teuthology.orchestra.run.smithi055.stdout:Downloading Packages: 2022-11-27T16:31:38.272 INFO:teuthology.orchestra.run.smithi006.stdout:(1/133): ceph-18.0.0-594.g697b0d99.el8.x86_64.r 20 kB/s | 6.4 kB 00:00 2022-11-27T16:31:38.383 INFO:teuthology.orchestra.run.smithi055.stdout:(1/133): ceph-18.0.0-594.g697b0d99.el8.x86_64.r 20 kB/s | 6.4 kB 00:00 2022-11-27T16:31:38.880 INFO:teuthology.orchestra.run.smithi006.stdout:(2/133): ceph-fuse-18.0.0-594.g697b0d99.el8.x86 1.4 MB/s | 845 kB 00:00 2022-11-27T16:31:38.989 INFO:teuthology.orchestra.run.smithi006.stdout:(3/133): ceph-immutable-object-cache-18.0.0-594 1.5 MB/s | 165 kB 00:00 2022-11-27T16:31:39.358 INFO:teuthology.orchestra.run.smithi055.stdout:(2/133): ceph-fuse-18.0.0-594.g697b0d99.el8.x86 867 kB/s | 845 kB 00:00 2022-11-27T16:31:39.525 INFO:teuthology.orchestra.run.smithi055.stdout:(3/133): ceph-immutable-object-cache-18.0.0-594 993 kB/s | 165 kB 00:00 2022-11-27T16:31:40.131 INFO:teuthology.orchestra.run.smithi006.stdout:(4/133): ceph-mds-18.0.0-594.g697b0d99.el8.x86_ 2.0 MB/s | 2.3 MB 00:01 2022-11-27T16:31:40.356 INFO:teuthology.orchestra.run.smithi006.stdout:(5/133): ceph-base-18.0.0-594.g697b0d99.el8.x86 2.2 MB/s | 5.2 MB 00:02 2022-11-27T16:31:40.400 INFO:teuthology.orchestra.run.smithi055.stdout:(4/133): ceph-mds-18.0.0-594.g697b0d99.el8.x86_ 2.6 MB/s | 2.3 MB 00:00 2022-11-27T16:31:40.690 INFO:teuthology.orchestra.run.smithi006.stdout:(6/133): ceph-mgr-18.0.0-594.g697b0d99.el8.x86_ 2.7 MB/s | 1.5 MB 00:00 2022-11-27T16:31:40.800 INFO:teuthology.orchestra.run.smithi055.stdout:(5/133): ceph-mgr-18.0.0-594.g697b0d99.el8.x86_ 3.8 MB/s | 1.5 MB 00:00 2022-11-27T16:31:41.518 INFO:teuthology.orchestra.run.smithi055.stdout:(6/133): ceph-mon-18.0.0-594.g697b0d99.el8.x86_ 5.4 MB/s | 3.9 MB 00:00 2022-11-27T16:31:41.557 INFO:teuthology.orchestra.run.smithi006.stdout:(7/133): ceph-mon-18.0.0-594.g697b0d99.el8.x86_ 3.2 MB/s | 3.9 MB 00:01 2022-11-27T16:31:42.251 INFO:teuthology.orchestra.run.smithi055.stdout:(7/133): ceph-base-18.0.0-594.g697b0d99.el8.x86 1.2 MB/s | 5.2 MB 00:04 2022-11-27T16:31:43.243 INFO:teuthology.orchestra.run.smithi055.stdout:(8/133): ceph-osd-18.0.0-594.g697b0d99.el8.x86_ 9.7 MB/s | 17 MB 00:01 2022-11-27T16:31:43.302 INFO:teuthology.orchestra.run.smithi055.stdout:(9/133): ceph-selinux-18.0.0-594.g697b0d99.el8. 419 kB/s | 24 kB 00:00 2022-11-27T16:31:47.290 INFO:teuthology.orchestra.run.smithi006.stdout:(8/133): ceph-common-18.0.0-594.g697b0d99.el8.x 2.6 MB/s | 24 MB 00:09 2022-11-27T16:31:47.365 INFO:teuthology.orchestra.run.smithi006.stdout:(9/133): ceph-selinux-18.0.0-594.g697b0d99.el8. 325 kB/s | 24 kB 00:00 2022-11-27T16:31:48.037 INFO:teuthology.orchestra.run.smithi006.stdout:(10/133): ceph-osd-18.0.0-594.g697b0d99.el8.x86 2.3 MB/s | 17 MB 00:07 2022-11-27T16:31:48.182 INFO:teuthology.orchestra.run.smithi006.stdout:(11/133): cephfs-mirror-18.0.0-594.g697b0d99.el 1.7 MB/s | 257 kB 00:00 2022-11-27T16:31:48.266 INFO:teuthology.orchestra.run.smithi006.stdout:(12/133): libcephfs-devel-18.0.0-594.g697b0d99. 365 kB/s | 30 kB 00:00 2022-11-27T16:31:48.533 INFO:teuthology.orchestra.run.smithi006.stdout:(13/133): libcephfs2-18.0.0-594.g697b0d99.el8.x 2.8 MB/s | 767 kB 00:00 2022-11-27T16:31:48.717 INFO:teuthology.orchestra.run.smithi006.stdout:(14/133): ceph-radosgw-18.0.0-594.g697b0d99.el8 2.6 MB/s | 18 MB 00:07 2022-11-27T16:31:48.742 INFO:teuthology.orchestra.run.smithi006.stdout:(15/133): libcephsqlite-18.0.0-594.g697b0d99.el 657 kB/s | 137 kB 00:00 2022-11-27T16:31:48.767 INFO:teuthology.orchestra.run.smithi006.stdout:(16/133): librados-devel-18.0.0-594.g697b0d99.e 2.7 MB/s | 139 kB 00:00 2022-11-27T16:31:48.852 INFO:teuthology.orchestra.run.smithi055.stdout:(10/133): ceph-test-18.0.0-594.g697b0d99.el8.x8 9.9 MB/s | 55 MB 00:05 2022-11-27T16:31:48.901 INFO:teuthology.orchestra.run.smithi006.stdout:(17/133): libradosstriper1-18.0.0-594.g697b0d99 2.9 MB/s | 474 kB 00:00 2022-11-27T16:31:48.960 INFO:teuthology.orchestra.run.smithi055.stdout:(11/133): cephfs-mirror-18.0.0-594.g697b0d99.el 2.3 MB/s | 257 kB 00:00 2022-11-27T16:31:48.968 INFO:teuthology.orchestra.run.smithi006.stdout:(18/133): python3-ceph-argparse-18.0.0-594.g697 669 kB/s | 45 kB 00:00 2022-11-27T16:31:49.002 INFO:teuthology.orchestra.run.smithi055.stdout:(12/133): libcephfs-devel-18.0.0-594.g697b0d99. 733 kB/s | 30 kB 00:00 2022-11-27T16:31:49.035 INFO:teuthology.orchestra.run.smithi006.stdout:(19/133): python3-ceph-common-18.0.0-594.g697b0 1.6 MB/s | 109 kB 00:00 2022-11-27T16:31:49.136 INFO:teuthology.orchestra.run.smithi055.stdout:(13/133): libcephfs2-18.0.0-594.g697b0d99.el8.x 5.6 MB/s | 767 kB 00:00 2022-11-27T16:31:49.168 INFO:teuthology.orchestra.run.smithi006.stdout:(20/133): python3-cephfs-18.0.0-594.g697b0d99.e 1.4 MB/s | 190 kB 00:00 2022-11-27T16:31:49.203 INFO:teuthology.orchestra.run.smithi055.stdout:(14/133): libcephsqlite-18.0.0-594.g697b0d99.el 2.0 MB/s | 137 kB 00:00 2022-11-27T16:31:49.270 INFO:teuthology.orchestra.run.smithi055.stdout:(15/133): librados-devel-18.0.0-594.g697b0d99.e 2.0 MB/s | 139 kB 00:00 2022-11-27T16:31:49.318 INFO:teuthology.orchestra.run.smithi006.stdout:(21/133): python3-rados-18.0.0-594.g697b0d99.el 2.4 MB/s | 371 kB 00:00 2022-11-27T16:31:49.353 INFO:teuthology.orchestra.run.smithi055.stdout:(16/133): libradosstriper1-18.0.0-594.g697b0d99 5.6 MB/s | 474 kB 00:00 2022-11-27T16:31:49.519 INFO:teuthology.orchestra.run.smithi006.stdout:(22/133): python3-rbd-18.0.0-594.g697b0d99.el8. 1.7 MB/s | 357 kB 00:00 2022-11-27T16:31:49.611 INFO:teuthology.orchestra.run.smithi006.stdout:(23/133): python3-rgw-18.0.0-594.g697b0d99.el8. 1.1 MB/s | 107 kB 00:00 2022-11-27T16:31:49.695 INFO:teuthology.orchestra.run.smithi006.stdout:(24/133): rbd-fuse-18.0.0-594.g697b0d99.el8.x86 1.1 MB/s | 94 kB 00:00 2022-11-27T16:31:50.004 INFO:teuthology.orchestra.run.smithi055.stdout:(17/133): librgw2-18.0.0-594.g697b0d99.el8.x86_ 9.9 MB/s | 6.5 MB 00:00 2022-11-27T16:31:50.362 INFO:teuthology.orchestra.run.smithi055.stdout:(18/133): ceph-radosgw-18.0.0-594.g697b0d99.el8 2.3 MB/s | 18 MB 00:08 2022-11-27T16:31:50.379 INFO:teuthology.orchestra.run.smithi055.stdout:(19/133): python3-ceph-argparse-18.0.0-594.g697 119 kB/s | 45 kB 00:00 2022-11-27T16:31:50.403 INFO:teuthology.orchestra.run.smithi006.stdout:(25/133): librgw2-18.0.0-594.g697b0d99.el8.x86_ 4.0 MB/s | 6.5 MB 00:01 2022-11-27T16:31:50.430 INFO:teuthology.orchestra.run.smithi055.stdout:(20/133): python3-cephfs-18.0.0-594.g697b0d99.e 3.7 MB/s | 190 kB 00:00 2022-11-27T16:31:50.455 INFO:teuthology.orchestra.run.smithi055.stdout:(21/133): python3-ceph-common-18.0.0-594.g697b0 1.2 MB/s | 109 kB 00:00 2022-11-27T16:31:50.461 INFO:teuthology.orchestra.run.smithi006.stdout:(26/133): rbd-nbd-18.0.0-594.g697b0d99.el8.x86_ 2.9 MB/s | 175 kB 00:00 2022-11-27T16:31:50.488 INFO:teuthology.orchestra.run.smithi055.stdout:(22/133): python3-rados-18.0.0-594.g697b0d99.el 6.2 MB/s | 371 kB 00:00 2022-11-27T16:31:50.534 INFO:teuthology.orchestra.run.smithi006.stdout:(27/133): ceph-grafana-dashboards-18.0.0-594.g6 342 kB/s | 23 kB 00:00 2022-11-27T16:31:50.547 INFO:teuthology.orchestra.run.smithi055.stdout:(23/133): python3-rbd-18.0.0-594.g697b0d99.el8. 3.8 MB/s | 357 kB 00:00 2022-11-27T16:31:50.572 INFO:teuthology.orchestra.run.smithi055.stdout:(24/133): python3-rgw-18.0.0-594.g697b0d99.el8. 1.2 MB/s | 107 kB 00:00 2022-11-27T16:31:50.595 INFO:teuthology.orchestra.run.smithi006.stdout:(28/133): rbd-mirror-18.0.0-594.g697b0d99.el8.x 3.9 MB/s | 3.5 MB 00:00 2022-11-27T16:31:50.598 INFO:teuthology.orchestra.run.smithi055.stdout:(25/133): rbd-fuse-18.0.0-594.g697b0d99.el8.x86 1.8 MB/s | 94 kB 00:00 2022-11-27T16:31:50.620 INFO:teuthology.orchestra.run.smithi006.stdout:(29/133): ceph-mgr-cephadm-18.0.0-594.g697b0d99 1.3 MB/s | 118 kB 00:00 2022-11-27T16:31:50.681 INFO:teuthology.orchestra.run.smithi055.stdout:(26/133): rbd-nbd-18.0.0-594.g697b0d99.el8.x86_ 2.1 MB/s | 175 kB 00:00 2022-11-27T16:31:50.765 INFO:teuthology.orchestra.run.smithi055.stdout:(27/133): ceph-grafana-dashboards-18.0.0-594.g6 274 kB/s | 23 kB 00:00 2022-11-27T16:31:50.857 INFO:teuthology.orchestra.run.smithi055.stdout:(28/133): ceph-mgr-cephadm-18.0.0-594.g697b0d99 1.3 MB/s | 118 kB 00:00 2022-11-27T16:31:50.916 INFO:teuthology.orchestra.run.smithi055.stdout:(29/133): rbd-mirror-18.0.0-594.g697b0d99.el8.x 10 MB/s | 3.5 MB 00:00 2022-11-27T16:31:51.170 INFO:teuthology.orchestra.run.smithi006.stdout:(30/133): ceph-mgr-dashboard-18.0.0-594.g697b0d 2.9 MB/s | 1.7 MB 00:00 2022-11-27T16:31:51.305 INFO:teuthology.orchestra.run.smithi006.stdout:(31/133): ceph-mgr-modules-core-18.0.0-594.g697 1.7 MB/s | 234 kB 00:00 2022-11-27T16:31:51.307 INFO:teuthology.orchestra.run.smithi055.stdout:(30/133): ceph-mgr-dashboard-18.0.0-594.g697b0d 3.7 MB/s | 1.7 MB 00:00 2022-11-27T16:31:51.372 INFO:teuthology.orchestra.run.smithi006.stdout:(32/133): ceph-mgr-rook-18.0.0-594.g697b0d99.el 706 kB/s | 47 kB 00:00 2022-11-27T16:31:51.417 INFO:teuthology.orchestra.run.smithi055.stdout:(31/133): ceph-mgr-modules-core-18.0.0-594.g697 2.7 MB/s | 234 kB 00:00 2022-11-27T16:31:51.439 INFO:teuthology.orchestra.run.smithi006.stdout:(33/133): ceph-prometheus-alerts-18.0.0-594.g69 216 kB/s | 14 kB 00:00 2022-11-27T16:31:51.466 INFO:teuthology.orchestra.run.smithi055.stdout:(32/133): ceph-mgr-rook-18.0.0-594.g697b0d99.el 628 kB/s | 47 kB 00:00 2022-11-27T16:31:51.522 INFO:teuthology.orchestra.run.smithi006.stdout:(34/133): ceph-volume-18.0.0-594.g697b0d99.el8. 3.1 MB/s | 263 kB 00:00 2022-11-27T16:31:51.565 INFO:teuthology.orchestra.run.smithi006.stdout:(35/133): cephadm-18.0.0-594.g697b0d99.el8.noar 1.9 MB/s | 81 kB 00:00 2022-11-27T16:31:51.566 INFO:teuthology.orchestra.run.smithi055.stdout:(33/133): ceph-mgr-diskprediction-local-18.0.0- 11 MB/s | 7.4 MB 00:00 2022-11-27T16:31:51.607 INFO:teuthology.orchestra.run.smithi006.stdout:(36/133): cephfs-top-18.0.0-594.g697b0d99.el8.n 369 kB/s | 15 kB 00:00 2022-11-27T16:31:51.611 INFO:teuthology.orchestra.run.smithi055.stdout:(34/133): ceph-prometheus-alerts-18.0.0-594.g69 100 kB/s | 14 kB 00:00 2022-11-27T16:31:51.643 INFO:teuthology.orchestra.run.smithi055.stdout:(35/133): ceph-volume-18.0.0-594.g697b0d99.el8. 3.4 MB/s | 263 kB 00:00 2022-11-27T16:31:51.668 INFO:teuthology.orchestra.run.smithi055.stdout:(36/133): cephadm-18.0.0-594.g697b0d99.el8.noar 1.4 MB/s | 81 kB 00:00 2022-11-27T16:31:51.693 INFO:teuthology.orchestra.run.smithi055.stdout:(37/133): cephfs-top-18.0.0-594.g697b0d99.el8.n 307 kB/s | 15 kB 00:00 2022-11-27T16:31:51.799 INFO:teuthology.orchestra.run.smithi006.stdout:(37/133): gperftools-libs-2.7-9.el8.x86_64.rpm 1.6 MB/s | 306 kB 00:00 2022-11-27T16:31:51.827 INFO:teuthology.orchestra.run.smithi055.stdout:(38/133): liboath-2.6.2-3.el8.x86_64.rpm 441 kB/s | 59 kB 00:00 2022-11-27T16:31:51.840 INFO:teuthology.orchestra.run.smithi006.stdout:(38/133): liboath-2.6.2-3.el8.x86_64.rpm 1.4 MB/s | 59 kB 00:00 2022-11-27T16:31:51.885 INFO:teuthology.orchestra.run.smithi055.stdout:(39/133): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2022-11-27T16:31:51.891 INFO:teuthology.orchestra.run.smithi006.stdout:(39/133): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2022-11-27T16:31:51.910 INFO:teuthology.orchestra.run.smithi055.stdout:(40/133): libunwind-1.3.1-3.el8.x86_64.rpm 899 kB/s | 75 kB 00:00 2022-11-27T16:31:51.961 INFO:teuthology.orchestra.run.smithi055.stdout:(41/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 871 kB/s | 44 kB 00:00 2022-11-27T16:31:51.974 INFO:teuthology.orchestra.run.smithi006.stdout:(40/133): python3-asyncssh-2.7.0-2.el8.noarch.r 5.6 MB/s | 476 kB 00:00 2022-11-27T16:31:51.995 INFO:teuthology.orchestra.run.smithi055.stdout:(42/133): python3-asyncssh-2.7.0-2.el8.noarch.r 4.3 MB/s | 476 kB 00:00 2022-11-27T16:31:52.016 INFO:teuthology.orchestra.run.smithi006.stdout:(41/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.0 MB/s | 44 kB 00:00 2022-11-27T16:31:52.037 INFO:teuthology.orchestra.run.smithi055.stdout:(43/133): python3-beautifulsoup4-4.6.3-2.el8.1. 2.4 MB/s | 185 kB 00:00 2022-11-27T16:31:52.062 INFO:teuthology.orchestra.run.smithi055.stdout:(44/133): python3-cachetools-3.1.1-4.el8.noarch 493 kB/s | 33 kB 00:00 2022-11-27T16:31:52.087 INFO:teuthology.orchestra.run.smithi055.stdout:(45/133): python3-certifi-2018.10.15-7.el8.noar 325 kB/s | 16 kB 00:00 2022-11-27T16:31:52.112 INFO:teuthology.orchestra.run.smithi055.stdout:(46/133): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2022-11-27T16:31:52.125 INFO:teuthology.orchestra.run.smithi006.stdout:(42/133): ceph-mgr-diskprediction-local-18.0.0- 5.1 MB/s | 7.4 MB 00:01 2022-11-27T16:31:52.150 INFO:teuthology.orchestra.run.smithi006.stdout:(43/133): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2022-11-27T16:31:52.163 INFO:teuthology.orchestra.run.smithi055.stdout:(47/133): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2022-11-27T16:31:52.188 INFO:teuthology.orchestra.run.smithi055.stdout:(48/133): python3-cherrypy-18.4.0-1.el8.noarch. 3.7 MB/s | 384 kB 00:00 2022-11-27T16:31:52.209 INFO:teuthology.orchestra.run.smithi006.stdout:(44/133): python3-certifi-2018.10.15-7.el8.noar 280 kB/s | 16 kB 00:00 2022-11-27T16:31:52.213 INFO:teuthology.orchestra.run.smithi055.stdout:(49/133): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2022-11-27T16:31:52.226 INFO:teuthology.orchestra.run.smithi006.stdout:(45/133): python3-cachetools-3.1.1-4.el8.noarch 328 kB/s | 33 kB 00:00 2022-11-27T16:31:52.239 INFO:teuthology.orchestra.run.smithi055.stdout:(50/133): python3-jaraco-functools-2.0-4.el8.no 349 kB/s | 18 kB 00:00 2022-11-27T16:31:52.259 INFO:teuthology.orchestra.run.smithi006.stdout:(46/133): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2022-11-27T16:31:52.289 INFO:teuthology.orchestra.run.smithi055.stdout:(51/133): python3-logutils-0.3.5-11.el8.noarch. 977 kB/s | 49 kB 00:00 2022-11-27T16:31:52.310 INFO:teuthology.orchestra.run.smithi006.stdout:(47/133): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2022-11-27T16:31:52.339 INFO:teuthology.orchestra.run.smithi055.stdout:(52/133): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2022-11-27T16:31:52.360 INFO:teuthology.orchestra.run.smithi006.stdout:(48/133): python3-cherrypy-18.4.0-1.el8.noarch. 2.8 MB/s | 384 kB 00:00 2022-11-27T16:31:52.381 INFO:teuthology.orchestra.run.smithi055.stdout:(53/133): python3-kubernetes-11.0.0-6.el8.noarc 7.0 MB/s | 1.2 MB 00:00 2022-11-27T16:31:52.385 INFO:teuthology.orchestra.run.smithi006.stdout:(49/133): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2022-11-27T16:31:52.406 INFO:teuthology.orchestra.run.smithi055.stdout:(54/133): python3-natsort-7.1.1-2.el8.noarch.rp 901 kB/s | 60 kB 00:00 2022-11-27T16:31:52.411 INFO:teuthology.orchestra.run.smithi006.stdout:(50/133): python3-jaraco-functools-2.0-4.el8.no 350 kB/s | 18 kB 00:00 2022-11-27T16:31:52.461 INFO:teuthology.orchestra.run.smithi006.stdout:(51/133): python3-logutils-0.3.5-11.el8.noarch. 974 kB/s | 49 kB 00:00 2022-11-27T16:31:52.511 INFO:teuthology.orchestra.run.smithi006.stdout:(52/133): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2022-11-27T16:31:52.550 INFO:teuthology.orchestra.run.smithi006.stdout:(53/133): python3-kubernetes-11.0.0-6.el8.noarc 7.3 MB/s | 1.2 MB 00:00 2022-11-27T16:31:52.570 INFO:teuthology.orchestra.run.smithi006.stdout:(54/133): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2022-11-27T16:31:52.595 INFO:teuthology.orchestra.run.smithi006.stdout:(55/133): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2022-11-27T16:31:52.621 INFO:teuthology.orchestra.run.smithi006.stdout:(56/133): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2022-11-27T16:31:52.646 INFO:teuthology.orchestra.run.smithi006.stdout:(57/133): python3-repoze-lru-0.7-6.el8.noarch.r 669 kB/s | 34 kB 00:00 2022-11-27T16:31:52.657 INFO:teuthology.orchestra.run.smithi055.stdout:(55/133): ceph-common-18.0.0-594.g697b0d99.el8. 1.7 MB/s | 24 MB 00:14 2022-11-27T16:31:52.671 INFO:teuthology.orchestra.run.smithi006.stdout:(58/133): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2022-11-27T16:31:52.674 INFO:teuthology.orchestra.run.smithi055.stdout:(56/133): python3-portend-2.6-1.el8.noarch.rpm 58 kB/s | 16 kB 00:00 2022-11-27T16:31:52.696 INFO:teuthology.orchestra.run.smithi006.stdout:(59/133): python3-rsa-4.8-1.el8.noarch.rpm 1.2 MB/s | 61 kB 00:00 2022-11-27T16:31:52.699 INFO:teuthology.orchestra.run.smithi055.stdout:(57/133): python3-pecan-1.3.2-9.el8.noarch.rpm 891 kB/s | 283 kB 00:00 2022-11-27T16:31:52.722 INFO:teuthology.orchestra.run.smithi006.stdout:(60/133): python3-simplegeneric-0.8.1-17.el8.no 371 kB/s | 19 kB 00:00 2022-11-27T16:31:52.741 INFO:teuthology.orchestra.run.smithi055.stdout:(58/133): python3-rsa-4.8-1.el8.noarch.rpm 1.4 MB/s | 61 kB 00:00 2022-11-27T16:31:52.747 INFO:teuthology.orchestra.run.smithi006.stdout:(61/133): python3-singledispatch-3.4.0.3-18.el8 475 kB/s | 24 kB 00:00 2022-11-27T16:31:52.766 INFO:teuthology.orchestra.run.smithi055.stdout:(59/133): python3-routes-2.4.1-12.el8.noarch.rp 2.1 MB/s | 196 kB 00:00 2022-11-27T16:31:52.772 INFO:teuthology.orchestra.run.smithi006.stdout:(62/133): python3-tempora-1.14.1-5.el8.noarch.r 583 kB/s | 29 kB 00:00 2022-11-27T16:31:52.783 INFO:teuthology.orchestra.run.smithi055.stdout:(60/133): python3-repoze-lru-0.7-6.el8.noarch.r 267 kB/s | 34 kB 00:00 2022-11-27T16:31:52.798 INFO:teuthology.orchestra.run.smithi006.stdout:(63/133): python3-trustme-0.6.0-4.el8.noarch.rp 544 kB/s | 27 kB 00:00 2022-11-27T16:31:52.800 INFO:teuthology.orchestra.run.smithi055.stdout:(61/133): python3-simplegeneric-0.8.1-17.el8.no 318 kB/s | 19 kB 00:00 2022-11-27T16:31:52.817 INFO:teuthology.orchestra.run.smithi055.stdout:(62/133): python3-singledispatch-3.4.0.3-18.el8 473 kB/s | 24 kB 00:00 2022-11-27T16:31:52.823 INFO:teuthology.orchestra.run.smithi006.stdout:(64/133): python3-waitress-1.2.1-2.el8.1.noarch 4.7 MB/s | 241 kB 00:00 2022-11-27T16:31:52.844 INFO:teuthology.orchestra.run.smithi055.stdout:(63/133): python3-tempora-1.14.1-5.el8.noarch.r 479 kB/s | 29 kB 00:00 2022-11-27T16:31:52.848 INFO:teuthology.orchestra.run.smithi006.stdout:(65/133): python3-webob-1.8.5-1.el8.1.noarch.rp 4.9 MB/s | 251 kB 00:00 2022-11-27T16:31:52.874 INFO:teuthology.orchestra.run.smithi006.stdout:(66/133): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2022-11-27T16:31:52.895 INFO:teuthology.orchestra.run.smithi055.stdout:(64/133): python3-trustme-0.6.0-4.el8.noarch.rp 292 kB/s | 27 kB 00:00 2022-11-27T16:31:52.899 INFO:teuthology.orchestra.run.smithi006.stdout:(67/133): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2022-11-27T16:31:52.920 INFO:teuthology.orchestra.run.smithi055.stdout:(65/133): python3-waitress-1.2.1-2.el8.1.noarch 2.3 MB/s | 241 kB 00:00 2022-11-27T16:31:52.924 INFO:teuthology.orchestra.run.smithi006.stdout:(68/133): python3-zc-lockfile-2.0-2.el8.noarch. 457 kB/s | 23 kB 00:00 2022-11-27T16:31:52.945 INFO:teuthology.orchestra.run.smithi055.stdout:(66/133): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2022-11-27T16:31:52.950 INFO:teuthology.orchestra.run.smithi006.stdout:(69/133): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2022-11-27T16:31:52.971 INFO:teuthology.orchestra.run.smithi055.stdout:(67/133): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2022-11-27T16:31:52.996 INFO:teuthology.orchestra.run.smithi055.stdout:(68/133): python3-webob-1.8.5-1.el8.1.noarch.rp 1.6 MB/s | 251 kB 00:00 2022-11-27T16:31:53.000 INFO:teuthology.orchestra.run.smithi006.stdout:(70/133): postgresql-contrib-10.21-2.module+el8 16 MB/s | 808 kB 00:00 2022-11-27T16:31:53.021 INFO:teuthology.orchestra.run.smithi055.stdout:(69/133): python3-zc-lockfile-2.0-2.el8.noarch. 304 kB/s | 23 kB 00:00 2022-11-27T16:31:53.038 INFO:teuthology.orchestra.run.smithi055.stdout:(70/133): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2022-11-27T16:31:53.042 INFO:teuthology.orchestra.run.smithi006.stdout:(71/133): bison-3.0.4-10.el8.x86_64.rpm 16 MB/s | 688 kB 00:00 2022-11-27T16:31:53.088 INFO:teuthology.orchestra.run.smithi055.stdout:(71/133): postgresql-contrib-10.21-2.module+el8 12 MB/s | 808 kB 00:00 2022-11-27T16:31:53.101 INFO:teuthology.orchestra.run.smithi006.stdout:(72/133): postgresql-10.21-2.module+el8.6.0+153 26 MB/s | 1.5 MB 00:00 2022-11-27T16:31:53.122 INFO:teuthology.orchestra.run.smithi055.stdout:(72/133): bison-3.0.4-10.el8.x86_64.rpm 8.2 MB/s | 688 kB 00:00 2022-11-27T16:31:53.168 INFO:teuthology.orchestra.run.smithi006.stdout:(73/133): thrift-0.13.0-2.el8.x86_64.rpm 6.5 MB/s | 1.7 MB 00:00 2022-11-27T16:31:53.172 INFO:teuthology.orchestra.run.smithi055.stdout:(73/133): postgresql-10.21-2.module+el8.6.0+153 18 MB/s | 1.5 MB 00:00 2022-11-27T16:31:53.252 INFO:teuthology.orchestra.run.smithi006.stdout:(74/133): python3-numpy-1.14.3-10.el8.x86_64.rp 25 MB/s | 3.7 MB 00:00 2022-11-27T16:31:53.256 INFO:teuthology.orchestra.run.smithi055.stdout:(74/133): python3-numpy-1.14.3-10.el8.x86_64.rp 28 MB/s | 3.7 MB 00:00 2022-11-27T16:31:53.293 INFO:teuthology.orchestra.run.smithi006.stdout:(75/133): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2022-11-27T16:31:53.298 INFO:teuthology.orchestra.run.smithi055.stdout:(75/133): thrift-0.13.0-2.el8.x86_64.rpm 5.3 MB/s | 1.7 MB 00:00 2022-11-27T16:31:53.335 INFO:teuthology.orchestra.run.smithi006.stdout:(76/133): python3-markupsafe-0.23-19.el8.x86_64 930 kB/s | 39 kB 00:00 2022-11-27T16:31:53.340 INFO:teuthology.orchestra.run.smithi055.stdout:(76/133): python3-werkzeug-0.12.2-4.el8.noarch. 5.4 MB/s | 457 kB 00:00 2022-11-27T16:31:53.365 INFO:teuthology.orchestra.run.smithi055.stdout:(77/133): python3-markupsafe-0.23-19.el8.x86_64 582 kB/s | 39 kB 00:00 2022-11-27T16:31:53.399 INFO:teuthology.orchestra.run.smithi055.stdout:(78/133): python3-prettytable-0.7.2-14.el8.noar 752 kB/s | 44 kB 00:00 2022-11-27T16:31:53.411 INFO:teuthology.orchestra.run.smithi006.stdout:(77/133): postgresql-server-10.21-2.module+el8. 21 MB/s | 5.1 MB 00:00 2022-11-27T16:31:53.427 INFO:teuthology.orchestra.run.smithi006.stdout:(78/133): python3-prettytable-0.7.2-14.el8.noar 480 kB/s | 44 kB 00:00 2022-11-27T16:31:53.466 INFO:teuthology.orchestra.run.smithi055.stdout:(79/133): postgresql-server-10.21-2.module+el8. 17 MB/s | 5.1 MB 00:00 2022-11-27T16:31:53.469 INFO:teuthology.orchestra.run.smithi006.stdout:(79/133): librdkafka-0.11.4-3.el8.x86_64.rpm 5.9 MB/s | 354 kB 00:00 2022-11-27T16:31:53.491 INFO:teuthology.orchestra.run.smithi055.stdout:(80/133): librdkafka-0.11.4-3.el8.x86_64.rpm 2.8 MB/s | 354 kB 00:00 2022-11-27T16:31:53.503 INFO:teuthology.orchestra.run.smithi006.stdout:(80/133): python3-jinja2-2.10.1-3.el8.noarch.rp 7.0 MB/s | 538 kB 00:00 2022-11-27T16:31:53.545 INFO:teuthology.orchestra.run.smithi006.stdout:(81/133): libtool-2.4.6-25.el8.x86_64.rpm 9.2 MB/s | 709 kB 00:00 2022-11-27T16:31:53.550 INFO:teuthology.orchestra.run.smithi055.stdout:(81/133): python3-jinja2-2.10.1-3.el8.noarch.rp 3.5 MB/s | 538 kB 00:00 2022-11-27T16:31:53.570 INFO:teuthology.orchestra.run.smithi006.stdout:(82/133): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.3 MB/s | 225 kB 00:00 2022-11-27T16:31:53.575 INFO:teuthology.orchestra.run.smithi055.stdout:(82/133): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.7 MB/s | 225 kB 00:00 2022-11-27T16:31:53.609 INFO:teuthology.orchestra.run.smithi055.stdout:(83/133): libtool-2.4.6-25.el8.x86_64.rpm 4.9 MB/s | 709 kB 00:00 2022-11-27T16:31:53.612 INFO:teuthology.orchestra.run.smithi006.stdout:(83/133): python3-mako-1.0.6-13.el8.noarch.rpm 3.8 MB/s | 157 kB 00:00 2022-11-27T16:31:53.642 INFO:teuthology.orchestra.run.smithi055.stdout:(84/133): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2022-11-27T16:31:53.684 INFO:teuthology.orchestra.run.smithi055.stdout:(85/133): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2022-11-27T16:31:53.713 INFO:teuthology.orchestra.run.smithi006.stdout:(84/133): openblas-threads-0.3.15-3.el8.x86_64. 29 MB/s | 4.9 MB 00:00 2022-11-27T16:31:53.726 INFO:teuthology.orchestra.run.smithi055.stdout:(86/133): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2022-11-27T16:31:53.755 INFO:teuthology.orchestra.run.smithi006.stdout:(85/133): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2022-11-27T16:31:53.793 INFO:teuthology.orchestra.run.smithi055.stdout:(87/133): openblas-threads-0.3.15-3.el8.x86_64. 20 MB/s | 4.9 MB 00:00 2022-11-27T16:31:53.822 INFO:teuthology.orchestra.run.smithi006.stdout:(86/133): python3-babel-2.5.1-7.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2022-11-27T16:31:53.855 INFO:teuthology.orchestra.run.smithi006.stdout:(87/133): socat-1.7.4.1-1.el8.x86_64.rpm 3.1 MB/s | 323 kB 00:00 2022-11-27T16:31:53.868 INFO:teuthology.orchestra.run.smithi055.stdout:(88/133): python3-babel-2.5.1-7.el8.noarch.rpm 19 MB/s | 4.8 MB 00:00 2022-11-27T16:31:53.880 INFO:teuthology.orchestra.run.smithi006.stdout:(88/133): flex-2.6.1-9.el8.x86_64.rpm 5.5 MB/s | 320 kB 00:00 2022-11-27T16:31:53.893 INFO:teuthology.orchestra.run.smithi055.stdout:(89/133): flex-2.6.1-9.el8.x86_64.rpm 1.9 MB/s | 320 kB 00:00 2022-11-27T16:31:53.922 INFO:teuthology.orchestra.run.smithi006.stdout:(89/133): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2022-11-27T16:31:53.927 INFO:teuthology.orchestra.run.smithi055.stdout:(90/133): jq-1.6-3.el8.x86_64.rpm 3.4 MB/s | 202 kB 00:00 2022-11-27T16:31:53.986 INFO:teuthology.orchestra.run.smithi055.stdout:(91/133): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2022-11-27T16:31:54.006 INFO:teuthology.orchestra.run.smithi006.stdout:(90/133): openblas-0.3.15-3.el8.x86_64.rpm 31 MB/s | 4.7 MB 00:00 2022-11-27T16:31:54.053 INFO:teuthology.orchestra.run.smithi055.stdout:(92/133): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2022-11-27T16:31:54.057 INFO:teuthology.orchestra.run.smithi006.stdout:(91/133): automake-1.16.1-7.el8.noarch.rpm 14 MB/s | 713 kB 00:00 2022-11-27T16:31:54.087 INFO:teuthology.orchestra.run.smithi055.stdout:(93/133): python3-pytz-2017.2-9.el8.noarch.rpm 540 kB/s | 54 kB 00:00 2022-11-27T16:31:54.099 INFO:teuthology.orchestra.run.smithi006.stdout:(92/133): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2022-11-27T16:31:54.112 INFO:teuthology.orchestra.run.smithi055.stdout:(94/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.1 MB/s | 126 kB 00:00 2022-11-27T16:31:54.132 INFO:teuthology.orchestra.run.smithi006.stdout:(93/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.7 MB/s | 126 kB 00:00 2022-11-27T16:31:54.145 INFO:teuthology.orchestra.run.smithi055.stdout:(95/133): python3-jsonpointer-1.10-11.el8.noarc 342 kB/s | 20 kB 00:00 2022-11-27T16:31:54.166 INFO:teuthology.orchestra.run.smithi006.stdout:(94/133): python3-jsonpointer-1.10-11.el8.noarc 601 kB/s | 20 kB 00:00 2022-11-27T16:31:54.170 INFO:teuthology.orchestra.run.smithi055.stdout:(96/133): libpq-13.5-1.el8.x86_64.rpm 3.4 MB/s | 198 kB 00:00 2022-11-27T16:31:54.213 INFO:teuthology.orchestra.run.smithi055.stdout:(97/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.8 MB/s | 259 kB 00:00 2022-11-27T16:31:54.238 INFO:teuthology.orchestra.run.smithi055.stdout:(98/133): oniguruma-6.8.2-2.el8.x86_64.rpm 2.8 MB/s | 187 kB 00:00 2022-11-27T16:31:54.271 INFO:teuthology.orchestra.run.smithi055.stdout:(99/133): python3-jsonpatch-1.21-2.el8.noarch.r 452 kB/s | 27 kB 00:00 2022-11-27T16:31:54.297 INFO:teuthology.orchestra.run.smithi055.stdout:(100/133): uuid-1.6.2-43.el8.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2022-11-27T16:31:54.325 INFO:teuthology.orchestra.run.smithi006.stdout:(95/133): python3-scipy-1.0.0-21.module+el8.5.0 34 MB/s | 14 MB 00:00 2022-11-27T16:31:54.330 INFO:teuthology.orchestra.run.smithi055.stdout:(101/133): python3-pyasn1-modules-0.3.7-6.el8.n 1.8 MB/s | 110 kB 00:00 2022-11-27T16:31:54.350 INFO:teuthology.orchestra.run.smithi006.stdout:(96/133): libpq-13.5-1.el8.x86_64.rpm 1.1 MB/s | 198 kB 00:00 2022-11-27T16:31:54.372 INFO:teuthology.orchestra.run.smithi055.stdout:(102/133): pcre2-devel-10.32-2.el8.x86_64.rpm 7.9 MB/s | 605 kB 00:00 2022-11-27T16:31:54.392 INFO:teuthology.orchestra.run.smithi006.stdout:(97/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.8 MB/s | 259 kB 00:00 2022-11-27T16:31:54.417 INFO:teuthology.orchestra.run.smithi006.stdout:(98/133): oniguruma-6.8.2-2.el8.x86_64.rpm 2.7 MB/s | 187 kB 00:00 2022-11-27T16:31:54.431 INFO:teuthology.orchestra.run.smithi055.stdout:(103/133): fuse-2.9.7-15.el8.x86_64.rpm 828 kB/s | 83 kB 00:00 2022-11-27T16:31:54.442 INFO:teuthology.orchestra.run.smithi006.stdout:(99/133): python3-jsonpatch-1.21-2.el8.noarch.r 528 kB/s | 27 kB 00:00 2022-11-27T16:31:54.456 INFO:teuthology.orchestra.run.smithi055.stdout:(104/133): libsepol-devel-2.9-3.el8.x86_64.rpm 1.0 MB/s | 87 kB 00:00 2022-11-27T16:31:54.459 INFO:teuthology.orchestra.run.smithi006.stdout:(100/133): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2022-11-27T16:31:54.485 INFO:teuthology.orchestra.run.smithi006.stdout:(101/133): python3-pyasn1-modules-0.3.7-6.el8.n 2.6 MB/s | 110 kB 00:00 2022-11-27T16:31:54.518 INFO:teuthology.orchestra.run.smithi006.stdout:(102/133): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2022-11-27T16:31:54.552 INFO:teuthology.orchestra.run.smithi006.stdout:(103/133): fuse-2.9.7-15.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2022-11-27T16:31:54.577 INFO:teuthology.orchestra.run.smithi006.stdout:(104/133): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2022-11-27T16:31:54.607 INFO:teuthology.orchestra.run.smithi055.stdout:(105/133): python3-scipy-1.0.0-21.module+el8.5. 19 MB/s | 14 MB 00:00 2022-11-27T16:31:54.619 INFO:teuthology.orchestra.run.smithi006.stdout:(105/133): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2022-11-27T16:31:54.632 INFO:teuthology.orchestra.run.smithi055.stdout:(106/133): libselinux-devel-2.9-5.el8.x86_64.rp 1.1 MB/s | 200 kB 00:00 2022-11-27T16:31:54.644 INFO:teuthology.orchestra.run.smithi006.stdout:(106/133): libselinux-devel-2.9-5.el8.x86_64.rp 3.0 MB/s | 200 kB 00:00 2022-11-27T16:31:54.657 INFO:teuthology.orchestra.run.smithi055.stdout:(107/133): pcre2-utf32-10.32-2.el8.x86_64.rpm 975 kB/s | 220 kB 00:00 2022-11-27T16:31:54.678 INFO:teuthology.orchestra.run.smithi006.stdout:(107/133): libverto-devel-0.3.0-5.el8.x86_64.rp 305 kB/s | 18 kB 00:00 2022-11-27T16:31:54.682 INFO:teuthology.orchestra.run.smithi055.stdout:(108/133): libverto-devel-0.3.0-5.el8.x86_64.rp 237 kB/s | 18 kB 00:00 2022-11-27T16:31:54.699 INFO:teuthology.orchestra.run.smithi055.stdout:(109/133): librabbitmq-0.9.0-3.el8.x86_64.rpm 711 kB/s | 47 kB 00:00 2022-11-27T16:31:54.703 INFO:teuthology.orchestra.run.smithi006.stdout:(108/133): librabbitmq-0.9.0-3.el8.x86_64.rpm 813 kB/s | 47 kB 00:00 2022-11-27T16:31:54.733 INFO:teuthology.orchestra.run.smithi055.stdout:(110/133): python3-cryptography-3.2.1-5.el8.x86 7.2 MB/s | 559 kB 00:00 2022-11-27T16:31:54.754 INFO:teuthology.orchestra.run.smithi006.stdout:(109/133): python3-cryptography-3.2.1-5.el8.x86 7.2 MB/s | 559 kB 00:00 2022-11-27T16:31:54.758 INFO:teuthology.orchestra.run.smithi055.stdout:(111/133): python3-pycparser-2.14-14.el8.noarch 1.8 MB/s | 109 kB 00:00 2022-11-27T16:31:54.779 INFO:teuthology.orchestra.run.smithi006.stdout:(110/133): python3-oauthlib-2.1.0-1.el8.noarch. 2.0 MB/s | 155 kB 00:00 2022-11-27T16:31:54.783 INFO:teuthology.orchestra.run.smithi055.stdout:(112/133): python3-oauthlib-2.1.0-1.el8.noarch. 1.5 MB/s | 155 kB 00:00 2022-11-27T16:31:54.813 INFO:teuthology.orchestra.run.smithi006.stdout:(111/133): python3-pycparser-2.14-14.el8.noarch 1.8 MB/s | 109 kB 00:00 2022-11-27T16:31:54.817 INFO:teuthology.orchestra.run.smithi055.stdout:(113/133): python3-jwt-1.6.1-2.el8.noarch.rpm 1.2 MB/s | 43 kB 00:00 2022-11-27T16:31:54.842 INFO:teuthology.orchestra.run.smithi055.stdout:(114/133): krb5-devel-1.18.2-14.el8.x86_64.rpm 5.0 MB/s | 560 kB 00:00 2022-11-27T16:31:54.846 INFO:teuthology.orchestra.run.smithi006.stdout:(112/133): krb5-devel-1.18.2-14.el8.x86_64.rpm 8.3 MB/s | 560 kB 00:00 2022-11-27T16:31:54.868 INFO:teuthology.orchestra.run.smithi055.stdout:(115/133): libquadmath-8.5.0-10.1.el8_6.x86_64. 1.5 MB/s | 171 kB 00:00 2022-11-27T16:31:54.880 INFO:teuthology.orchestra.run.smithi006.stdout:(113/133): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2022-11-27T16:31:54.901 INFO:teuthology.orchestra.run.smithi055.stdout:(116/133): zlib-devel-1.2.11-18.el8_5.x86_64.rp 689 kB/s | 58 kB 00:00 2022-11-27T16:31:54.905 INFO:teuthology.orchestra.run.smithi006.stdout:(114/133): python3-jwt-1.6.1-2.el8.noarch.rpm 745 kB/s | 43 kB 00:00 2022-11-27T16:31:54.918 INFO:teuthology.orchestra.run.smithi055.stdout:(117/133): elfutils-libelf-devel-0.186-1.el8.x8 792 kB/s | 60 kB 00:00 2022-11-27T16:31:54.935 INFO:teuthology.orchestra.run.smithi055.stdout:(118/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2022-11-27T16:31:54.947 INFO:teuthology.orchestra.run.smithi006.stdout:(115/133): zlib-devel-1.2.11-18.el8_5.x86_64.rp 861 kB/s | 58 kB 00:00 2022-11-27T16:31:54.969 INFO:teuthology.orchestra.run.smithi055.stdout:(119/133): libaio-devel-0.3.112-1.el8.x86_64.rp 278 kB/s | 19 kB 00:00 2022-11-27T16:31:54.972 INFO:teuthology.orchestra.run.smithi006.stdout:(116/133): elfutils-libelf-devel-0.186-1.el8.x8 894 kB/s | 60 kB 00:00 2022-11-27T16:31:54.994 INFO:teuthology.orchestra.run.smithi055.stdout:(120/133): libuuid-devel-2.32.1-35.el8.x86_64.r 1.3 MB/s | 98 kB 00:00 2022-11-27T16:31:55.014 INFO:teuthology.orchestra.run.smithi006.stdout:(117/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2022-11-27T16:31:55.020 INFO:teuthology.orchestra.run.smithi055.stdout:(121/133): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2022-11-27T16:31:55.040 INFO:teuthology.orchestra.run.smithi006.stdout:(118/133): libaio-devel-0.3.112-1.el8.x86_64.rp 279 kB/s | 19 kB 00:00 2022-11-27T16:31:55.053 INFO:teuthology.orchestra.run.smithi055.stdout:(122/133): python3-requests-oauthlib-1.0.0-1.el 507 kB/s | 43 kB 00:00 2022-11-27T16:31:55.074 INFO:teuthology.orchestra.run.smithi006.stdout:(119/133): libuuid-devel-2.32.1-35.el8.x86_64.r 1.6 MB/s | 98 kB 00:00 2022-11-27T16:31:55.095 INFO:teuthology.orchestra.run.smithi055.stdout:(123/133): libcom_err-devel-1.45.6-4.el8.x86_64 514 kB/s | 39 kB 00:00 2022-11-27T16:31:55.099 INFO:teuthology.orchestra.run.smithi006.stdout:(120/133): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2022-11-27T16:31:55.112 INFO:teuthology.orchestra.run.smithi055.stdout:(124/133): xfsprogs-devel-5.0.0-10.el8.x86_64.r 622 kB/s | 72 kB 00:00 2022-11-27T16:31:55.133 INFO:teuthology.orchestra.run.smithi006.stdout:(121/133): python3-requests-oauthlib-1.0.0-1.el 729 kB/s | 43 kB 00:00 2022-11-27T16:31:55.149 INFO:teuthology.orchestra.run.smithi006.stdout:(122/133): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2022-11-27T16:31:55.154 INFO:teuthology.orchestra.run.smithi055.stdout:(125/133): keyutils-libs-devel-1.5.10-9.el8.x86 822 kB/s | 48 kB 00:00 2022-11-27T16:31:55.191 INFO:teuthology.orchestra.run.smithi006.stdout:(123/133): libcom_err-devel-1.45.6-4.el8.x86_64 660 kB/s | 39 kB 00:00 2022-11-27T16:31:55.204 INFO:teuthology.orchestra.run.smithi055.stdout:(126/133): openssl-devel-1.1.1k-7.el8_6.x86_64. 15 MB/s | 2.3 MB 00:00 2022-11-27T16:31:55.225 INFO:teuthology.orchestra.run.smithi006.stdout:(124/133): keyutils-libs-devel-1.5.10-9.el8.x86 1.4 MB/s | 48 kB 00:00 2022-11-27T16:31:55.246 INFO:teuthology.orchestra.run.smithi055.stdout:(127/133): libgfortran-8.5.0-10.1.el8_6.x86_64. 4.7 MB/s | 644 kB 00:00 2022-11-27T16:31:55.272 INFO:teuthology.orchestra.run.smithi055.stdout:(128/133): NetworkManager-initscripts-updown-1. 1.1 MB/s | 138 kB 00:00 2022-11-27T16:31:55.301 INFO:teuthology.orchestra.run.smithi006.stdout:(125/133): openssl-devel-1.1.1k-7.el8_6.x86_64. 15 MB/s | 2.3 MB 00:00 2022-11-27T16:31:55.342 INFO:teuthology.orchestra.run.smithi006.stdout:(126/133): libgfortran-8.5.0-10.1.el8_6.x86_64. 5.4 MB/s | 644 kB 00:00 2022-11-27T16:31:55.343 INFO:teuthology.orchestra.run.smithi055.stdout:(129/133): openssl-1.1.1k-7.el8_6.x86_64.rpm 9.7 MB/s | 709 kB 00:00 2022-11-27T16:31:55.367 INFO:teuthology.orchestra.run.smithi006.stdout:(127/133): NetworkManager-initscripts-updown-1. 2.0 MB/s | 138 kB 00:00 2022-11-27T16:31:55.397 INFO:teuthology.orchestra.run.smithi055.stdout:(130/133): openssl-libs-1.1.1k-7.el8_6.x86_64.r 27 MB/s | 1.5 MB 00:00 2022-11-27T16:31:55.439 INFO:teuthology.orchestra.run.smithi055.stdout:(131/133): iproute-5.15.0-4.el8_6.1.x86_64.rpm 19 MB/s | 798 kB 00:00 2022-11-27T16:31:55.689 INFO:teuthology.orchestra.run.smithi055.stdout:(132/133): librados2-18.0.0-594.g697b0d99.el8.x 7.5 MB/s | 3.6 MB 00:00 2022-11-27T16:31:56.173 INFO:teuthology.orchestra.run.smithi055.stdout:(133/133): librbd1-18.0.0-594.g697b0d99.el8.x86 3.9 MB/s | 3.6 MB 00:00 2022-11-27T16:31:56.176 INFO:teuthology.orchestra.run.smithi055.stdout:-------------------------------------------------------------------------------- 2022-11-27T16:31:56.176 INFO:teuthology.orchestra.run.smithi055.stdout:Total 12 MB/s | 219 MB 00:18 2022-11-27T16:31:56.193 INFO:teuthology.orchestra.run.smithi006.stdout:(128/133): librbd1-18.0.0-594.g697b0d99.el8.x86 4.3 MB/s | 3.6 MB 00:00 2022-11-27T16:31:56.273 INFO:teuthology.orchestra.run.smithi006.stdout:(129/133): librados2-18.0.0-594.g697b0d99.el8.x 3.9 MB/s | 3.6 MB 00:00 2022-11-27T16:31:56.319 INFO:teuthology.orchestra.run.smithi006.stdout:(130/133): openssl-1.1.1k-7.el8_6.x86_64.rpm 5.5 MB/s | 709 kB 00:00 2022-11-27T16:31:56.794 INFO:teuthology.orchestra.run.smithi006.stdout:(131/133): ceph-test-18.0.0-594.g697b0d99.el8.x 5.8 MB/s | 55 MB 00:09 2022-11-27T16:31:56.844 INFO:teuthology.orchestra.run.smithi006.stdout:(132/133): openssl-libs-1.1.1k-7.el8_6.x86_64.r 2.6 MB/s | 1.5 MB 00:00 2022-11-27T16:31:56.886 INFO:teuthology.orchestra.run.smithi006.stdout:(133/133): iproute-5.15.0-4.el8_6.1.x86_64.rpm 1.4 MB/s | 798 kB 00:00 2022-11-27T16:31:56.889 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2022-11-27T16:31:56.889 INFO:teuthology.orchestra.run.smithi006.stdout:Total 12 MB/s | 219 MB 00:18 2022-11-27T16:31:57.067 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction check 2022-11-27T16:31:57.243 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction check succeeded. 2022-11-27T16:31:57.243 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction test 2022-11-27T16:31:57.790 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2022-11-27T16:31:57.965 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2022-11-27T16:31:57.966 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2022-11-27T16:31:58.474 INFO:teuthology.orchestra.run.smithi055.stdout:Transaction test succeeded. 2022-11-27T16:31:58.480 INFO:teuthology.orchestra.run.smithi055.stdout:Running transaction 2022-11-27T16:31:59.208 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2022-11-27T16:31:59.212 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2022-11-27T16:32:03.550 INFO:teuthology.orchestra.run.smithi055.stdout: Preparing : 1/1 2022-11-27T16:32:03.782 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/138 2022-11-27T16:32:04.007 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/138 2022-11-27T16:32:04.165 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/138 2022-11-27T16:32:04.358 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/138 2022-11-27T16:32:04.365 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2022-11-27T16:32:04.492 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/138 2022-11-27T16:32:04.550 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/138 2022-11-27T16:32:04.601 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/138 2022-11-27T16:32:04.736 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 5/138 2022-11-27T16:32:04.828 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openssl-libs-1:1.1.1k-7.el8_6.x86_64 1/138 2022-11-27T16:32:04.891 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/138 2022-11-27T16:32:05.113 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/138 2022-11-27T16:32:05.273 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/138 2022-11-27T16:32:05.315 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/138 2022-11-27T16:32:05.424 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/138 2022-11-27T16:32:05.498 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/138 2022-11-27T16:32:05.533 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librados2-2:18.0.0-594.g697b0d99.el8.x86_64 7/138 2022-11-27T16:32:05.686 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 5/138 2022-11-27T16:32:05.832 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 6/138 2022-11-27T16:32:05.955 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-2:18.0.0-594.g697b0d99.el8.x86_64 7/138 2022-11-27T16:32:06.150 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : librbd1-2:18.0.0-594.g697b0d99.el8.x86_64 8/138 2022-11-27T16:32:06.250 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 6/138 2022-11-27T16:32:06.278 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-2:18.0.0-594.g697b0d99.el8.x86_64 8/138 2022-11-27T16:32:06.475 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs2-2:18.0.0-594.g697b0d99.el8.x86_64 9/138 2022-11-27T16:32:06.715 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librados2-2:18.0.0-594.g697b0d99.el8.x86_64 7/138 2022-11-27T16:32:06.750 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephfs2-2:18.0.0-594.g697b0d99.el8.x86_64 9/138 2022-11-27T16:32:06.917 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rados-2:18.0.0-594.g697b0d99.el8.x86_64 10/138 2022-11-27T16:32:07.134 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:18.0.0-594.g697b0d99.el8.x86_64 7/138 2022-11-27T16:32:07.178 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libpq-13.5-1.el8.x86_64 11/138 2022-11-27T16:32:07.299 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librbd1-2:18.0.0-594.g697b0d99.el8.x86_64 8/138 2022-11-27T16:32:07.354 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/138 2022-11-27T16:32:07.433 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:18.0.0-594.g697b0d99.el8.x86_64 8/138 2022-11-27T16:32:07.640 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs2-2:18.0.0-594.g697b0d99.el8.x86_64 9/138 2022-11-27T16:32:07.720 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephfs2-2:18.0.0-594.g697b0d99.el8.x86_64 9/138 2022-11-27T16:32:07.732 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/138 2022-11-27T16:32:07.881 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rados-2:18.0.0-594.g697b0d99.el8.x86_64 10/138 2022-11-27T16:32:07.963 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 14/138 2022-11-27T16:32:08.096 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libpq-13.5-1.el8.x86_64 11/138 2022-11-27T16:32:08.133 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephsqlite-2:18.0.0-594.g697b0d99.el8.x86_64 15/138 2022-11-27T16:32:08.246 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libcephsqlite-2:18.0.0-594.g697b0d99.el8.x86_64 15/138 2022-11-27T16:32:08.260 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/138 2022-11-27T16:32:08.399 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libradosstriper1-2:18.0.0-594.g697b0d99.el8.x86_ 16/138 2022-11-27T16:32:08.466 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libradosstriper1-2:18.0.0-594.g697b0d99.el8.x86_ 16/138 2022-11-27T16:32:08.623 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 17/138 2022-11-27T16:32:08.624 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/138 2022-11-27T16:32:08.732 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 18/138 2022-11-27T16:32:08.836 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 14/138 2022-11-27T16:32:08.874 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 18/138 2022-11-27T16:32:08.982 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephsqlite-2:18.0.0-594.g697b0d99.el8.x86_64 15/138 2022-11-27T16:32:08.983 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 19/138 2022-11-27T16:32:09.092 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephsqlite-2:18.0.0-594.g697b0d99.el8.x86_64 15/138 2022-11-27T16:32:09.248 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libradosstriper1-2:18.0.0-594.g697b0d99.el8.x86_ 16/138 2022-11-27T16:32:09.321 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libradosstriper1-2:18.0.0-594.g697b0d99.el8.x86_ 16/138 2022-11-27T16:32:09.471 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 17/138 2022-11-27T16:32:09.607 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 18/138 2022-11-27T16:32:09.625 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 19/138 2022-11-27T16:32:09.733 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 18/138 2022-11-27T16:32:09.807 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 20/138 2022-11-27T16:32:09.848 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 19/138 2022-11-27T16:32:10.448 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 20/138 2022-11-27T16:32:10.602 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 19/138 2022-11-27T16:32:10.616 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openblas-0.3.15-3.el8.x86_64 21/138 2022-11-27T16:32:10.765 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 20/138 2022-11-27T16:32:11.341 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 21/138 2022-11-27T16:32:11.392 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 20/138 2022-11-27T16:32:11.531 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-0.3.15-3.el8.x86_64 21/138 2022-11-27T16:32:11.622 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 22/138 2022-11-27T16:32:11.794 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 23/138 2022-11-27T16:32:12.065 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/138 2022-11-27T16:32:12.238 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 21/138 2022-11-27T16:32:12.338 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/138 2022-11-27T16:32:12.505 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 22/138 2022-11-27T16:32:12.610 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/138 2022-11-27T16:32:12.686 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 23/138 2022-11-27T16:32:12.772 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-common-2:18.0.0-594.g697b0d99.el8.x 27/138 2022-11-27T16:32:12.919 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-ceph-argparse-2:18.0.0-594.g697b0d99.el8 28/138 2022-11-27T16:32:12.954 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/138 2022-11-27T16:32:13.149 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cephfs-2:18.0.0-594.g697b0d99.el8.x86_64 29/138 2022-11-27T16:32:13.216 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 25/138 2022-11-27T16:32:13.459 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 26/138 2022-11-27T16:32:13.621 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-common-2:18.0.0-594.g697b0d99.el8.x 27/138 2022-11-27T16:32:13.776 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-argparse-2:18.0.0-594.g697b0d99.el8 28/138 2022-11-27T16:32:14.118 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 30/138 2022-11-27T16:32:14.121 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cephfs-2:18.0.0-594.g697b0d99.el8.x86_64 29/138 2022-11-27T16:32:14.520 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/138 2022-11-27T16:32:14.789 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/138 2022-11-27T16:32:14.974 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2022-11-27T16:32:15.071 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 30/138 2022-11-27T16:32:15.419 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/138 2022-11-27T16:32:15.705 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/138 2022-11-27T16:32:15.923 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2022-11-27T16:32:16.824 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2022-11-27T16:32:17.143 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 34/138 2022-11-27T16:32:17.370 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rsa-4.8-1.el8.noarch 35/138 2022-11-27T16:32:17.569 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/138 2022-11-27T16:32:17.763 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 33/138 2022-11-27T16:32:17.813 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rbd-2:18.0.0-594.g697b0d99.el8.x86_64 37/138 2022-11-27T16:32:18.021 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librados-devel-2:18.0.0-594.g697b0d99.el8.x86_64 38/138 2022-11-27T16:32:18.075 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 34/138 2022-11-27T16:32:18.212 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 39/138 2022-11-27T16:32:18.278 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rsa-4.8-1.el8.noarch 35/138 2022-11-27T16:32:18.345 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 40/138 2022-11-27T16:32:18.450 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 36/138 2022-11-27T16:32:18.503 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 41/138 2022-11-27T16:32:18.662 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rbd-2:18.0.0-594.g697b0d99.el8.x86_64 37/138 2022-11-27T16:32:18.740 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/138 2022-11-27T16:32:18.896 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librados-devel-2:18.0.0-594.g697b0d99.el8.x86_64 38/138 2022-11-27T16:32:18.940 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 43/138 2022-11-27T16:32:19.119 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 39/138 2022-11-27T16:32:19.156 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 44/138 2022-11-27T16:32:19.377 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 40/138 2022-11-27T16:32:19.547 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 45/138 2022-11-27T16:32:19.552 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 41/138 2022-11-27T16:32:19.722 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/138 2022-11-27T16:32:19.852 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 46/138 2022-11-27T16:32:19.948 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 43/138 2022-11-27T16:32:20.050 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 47/138 2022-11-27T16:32:20.163 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 44/138 2022-11-27T16:32:20.291 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 48/138 2022-11-27T16:32:20.555 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 49/138 2022-11-27T16:32:20.562 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 45/138 2022-11-27T16:32:20.865 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 50/138 2022-11-27T16:32:20.876 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 46/138 2022-11-27T16:32:21.056 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 51/138 2022-11-27T16:32:21.075 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 47/138 2022-11-27T16:32:21.241 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 52/138 2022-11-27T16:32:21.326 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 48/138 2022-11-27T16:32:21.484 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 53/138 2022-11-27T16:32:21.644 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 54/138 2022-11-27T16:32:21.672 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 49/138 2022-11-27T16:32:21.978 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 50/138 2022-11-27T16:32:21.992 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/138 2022-11-27T16:32:22.155 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 51/138 2022-11-27T16:32:22.170 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/138 2022-11-27T16:32:22.341 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 52/138 2022-11-27T16:32:22.453 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 57/138 2022-11-27T16:32:22.541 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 53/138 2022-11-27T16:32:22.685 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 54/138 2022-11-27T16:32:22.689 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 58/138 2022-11-27T16:32:22.908 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 59/138 2022-11-27T16:32:22.998 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/138 2022-11-27T16:32:23.134 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : fuse-2.9.7-15.el8.x86_64 60/138 2022-11-27T16:32:23.177 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/138 2022-11-27T16:32:23.314 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/138 2022-11-27T16:32:23.405 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/138 2022-11-27T16:32:23.414 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 57/138 2022-11-27T16:32:23.582 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 62/138 2022-11-27T16:32:23.638 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 58/138 2022-11-27T16:32:23.661 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 62/138 2022-11-27T16:32:23.822 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : jq-1.6-3.el8.x86_64 63/138 2022-11-27T16:32:23.856 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 59/138 2022-11-27T16:32:24.031 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 64/138 2022-11-27T16:32:24.081 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : fuse-2.9.7-15.el8.x86_64 60/138 2022-11-27T16:32:24.255 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/138 2022-11-27T16:32:24.295 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 65/138 2022-11-27T16:32:24.344 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/138 2022-11-27T16:32:24.515 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : automake-1.16.1-7.el8.noarch 66/138 2022-11-27T16:32:24.529 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 62/138 2022-11-27T16:32:24.610 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 62/138 2022-11-27T16:32:24.675 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 67/138 2022-11-27T16:32:24.779 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : jq-1.6-3.el8.x86_64 63/138 2022-11-27T16:32:24.849 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 68/138 2022-11-27T16:32:24.980 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 64/138 2022-11-27T16:32:25.062 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 69/138 2022-11-27T16:32:25.252 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 65/138 2022-11-27T16:32:25.353 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 70/138 2022-11-27T16:32:25.472 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : automake-1.16.1-7.el8.noarch 66/138 2022-11-27T16:32:25.564 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 71/138 2022-11-27T16:32:25.616 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 67/138 2022-11-27T16:32:25.736 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 72/138 2022-11-27T16:32:25.789 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 68/138 2022-11-27T16:32:25.926 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 73/138 2022-11-27T16:32:25.995 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 69/138 2022-11-27T16:32:26.134 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 74/138 2022-11-27T16:32:26.278 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 70/138 2022-11-27T16:32:26.336 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 75/138 2022-11-27T16:32:26.487 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 71/138 2022-11-27T16:32:26.535 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 76/138 2022-11-27T16:32:26.651 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 72/138 2022-11-27T16:32:26.734 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 77/138 2022-11-27T16:32:26.800 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 73/138 2022-11-27T16:32:26.895 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 78/138 2022-11-27T16:32:26.991 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 74/138 2022-11-27T16:32:27.121 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 79/138 2022-11-27T16:32:27.193 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 75/138 2022-11-27T16:32:27.319 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/138 2022-11-27T16:32:27.359 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 76/138 2022-11-27T16:32:27.487 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 81/138 2022-11-27T16:32:27.672 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 77/138 2022-11-27T16:32:27.977 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 78/138 2022-11-27T16:32:28.121 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-portend-2.6-1.el8.noarch 82/138 2022-11-27T16:32:28.203 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 79/138 2022-11-27T16:32:28.304 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/138 2022-11-27T16:32:28.384 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 80/138 2022-11-27T16:32:28.488 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 84/138 2022-11-27T16:32:28.536 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 81/138 2022-11-27T16:32:28.723 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 85/138 2022-11-27T16:32:28.762 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-portend-2.6-1.el8.noarch 82/138 2022-11-27T16:32:28.954 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/138 2022-11-27T16:32:29.154 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 84/138 2022-11-27T16:32:29.349 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 85/138 2022-11-27T16:32:29.837 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 86/138 2022-11-27T16:32:30.110 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 87/138 2022-11-27T16:32:30.340 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 88/138 2022-11-27T16:32:30.456 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 86/138 2022-11-27T16:32:30.662 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 89/138 2022-11-27T16:32:30.709 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 87/138 2022-11-27T16:32:30.914 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 90/138 2022-11-27T16:32:30.923 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 88/138 2022-11-27T16:32:31.074 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 91/138 2022-11-27T16:32:31.221 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 89/138 2022-11-27T16:32:31.463 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 90/138 2022-11-27T16:32:31.622 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 91/138 2022-11-27T16:32:31.912 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 92/138 2022-11-27T16:32:32.055 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : librgw2-2:18.0.0-594.g697b0d99.el8.x86_64 93/138 2022-11-27T16:32:32.148 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librgw2-2:18.0.0-594.g697b0d99.el8.x86_64 93/138 2022-11-27T16:32:32.347 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : python3-rgw-2:18.0.0-594.g697b0d99.el8.x86_64 94/138 2022-11-27T16:32:32.397 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 92/138 2022-11-27T16:32:32.537 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librgw2-2:18.0.0-594.g697b0d99.el8.x86_64 93/138 2022-11-27T16:32:32.597 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librgw2-2:18.0.0-594.g697b0d99.el8.x86_64 93/138 2022-11-27T16:32:32.771 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rgw-2:18.0.0-594.g697b0d99.el8.x86_64 94/138 2022-11-27T16:32:36.580 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:18.0.0-594.g697b0d99.el8.x86_64 95/138 2022-11-27T16:32:36.796 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-common-2:18.0.0-594.g697b0d99.el8.x86_64 95/138 2022-11-27T16:32:36.815 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:18.0.0-594.g697b0d99.el8.x86_64 95/138 2022-11-27T16:32:37.054 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-common-2:18.0.0-594.g697b0d99.el8.x86_64 95/138 2022-11-27T16:32:37.395 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-common-2:18.0.0-594.g697b0d99.el8.x86_64 95/138 2022-11-27T16:32:37.645 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:18.0.0-594.g697b0d99.el8.x86_64 95/138 2022-11-27T16:32:37.678 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-base-2:18.0.0-594.g697b0d99.el8.x86_64 96/138 2022-11-27T16:32:37.761 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-base-2:18.0.0-594.g697b0d99.el8.x86_64 96/138 2022-11-27T16:32:37.887 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-selinux-2:18.0.0-594.g697b0d99.el8.x86_64 97/138 2022-11-27T16:32:37.897 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-base-2:18.0.0-594.g697b0d99.el8.x86_64 96/138 2022-11-27T16:32:37.981 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-base-2:18.0.0-594.g697b0d99.el8.x86_64 96/138 2022-11-27T16:32:38.095 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-selinux-2:18.0.0-594.g697b0d99.el8.x86_64 97/138 2022-11-27T16:32:57.410 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-selinux-2:18.0.0-594.g697b0d99.el8.x86_64 97/138 2022-11-27T16:32:57.411 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /sys 2022-11-27T16:32:57.411 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /proc 2022-11-27T16:32:57.411 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /dev 2022-11-27T16:32:57.411 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /run 2022-11-27T16:32:57.412 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /mnt 2022-11-27T16:32:57.412 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /var/tmp 2022-11-27T16:32:57.412 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /home 2022-11-27T16:32:57.412 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /tmp 2022-11-27T16:32:57.412 INFO:teuthology.orchestra.run.smithi055.stdout:skipping the directory /dev 2022-11-27T16:32:57.413 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:32:57.785 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-volume-2:18.0.0-594.g697b0d99.el8.noarch 98/138 2022-11-27T16:32:58.006 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-selinux-2:18.0.0-594.g697b0d99.el8.x86_64 97/138 2022-11-27T16:32:58.007 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /sys 2022-11-27T16:32:58.007 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /proc 2022-11-27T16:32:58.007 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /dev 2022-11-27T16:32:58.007 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /run 2022-11-27T16:32:58.008 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /mnt 2022-11-27T16:32:58.008 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /var/tmp 2022-11-27T16:32:58.008 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /home 2022-11-27T16:32:58.008 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /tmp 2022-11-27T16:32:58.008 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /dev 2022-11-27T16:32:58.009 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:32:58.368 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-volume-2:18.0.0-594.g697b0d99.el8.noarch 98/138 2022-11-27T16:32:59.382 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-volume-2:18.0.0-594.g697b0d99.el8.noarch 98/138 2022-11-27T16:32:59.558 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-osd-2:18.0.0-594.g697b0d99.el8.x86_64 99/138 2022-11-27T16:32:59.790 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-osd-2:18.0.0-594.g697b0d99.el8.x86_64 99/138 2022-11-27T16:32:59.949 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-volume-2:18.0.0-594.g697b0d99.el8.noarch 98/138 2022-11-27T16:32:59.951 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mds-2:18.0.0-594.g697b0d99.el8.x86_64 100/138 2022-11-27T16:33:00.161 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-osd-2:18.0.0-594.g697b0d99.el8.x86_64 99/138 2022-11-27T16:33:00.360 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mds-2:18.0.0-594.g697b0d99.el8.x86_64 100/138 2022-11-27T16:33:00.391 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-osd-2:18.0.0-594.g697b0d99.el8.x86_64 99/138 2022-11-27T16:33:00.518 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mon-2:18.0.0-594.g697b0d99.el8.x86_64 101/138 2022-11-27T16:33:00.536 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mon-2:18.0.0-594.g697b0d99.el8.x86_64 101/138 2022-11-27T16:33:00.542 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mds-2:18.0.0-594.g697b0d99.el8.x86_64 100/138 2022-11-27T16:33:00.948 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mds-2:18.0.0-594.g697b0d99.el8.x86_64 100/138 2022-11-27T16:33:01.134 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mon-2:18.0.0-594.g697b0d99.el8.x86_64 101/138 2022-11-27T16:33:01.152 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mon-2:18.0.0-594.g697b0d99.el8.x86_64 101/138 2022-11-27T16:33:02.287 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephadm-2:18.0.0-594.g697b0d99.el8.noarch 102/138 2022-11-27T16:33:02.419 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephadm-2:18.0.0-594.g697b0d99.el8.noarch 102/138 2022-11-27T16:33:02.541 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-594.g697b0d99.el 103/138 2022-11-27T16:33:02.690 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-594.g697b0d99.e 104/138 2022-11-27T16:33:02.859 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-594.g697b0d99.el8.noar 105/138 2022-11-27T16:33:02.962 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephadm-2:18.0.0-594.g697b0d99.el8.noarch 102/138 2022-11-27T16:33:03.071 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-594.g697b0d99.el8.noar 105/138 2022-11-27T16:33:03.088 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephadm-2:18.0.0-594.g697b0d99.el8.noarch 102/138 2022-11-27T16:33:03.248 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-594.g697b0d99.el 103/138 2022-11-27T16:33:03.366 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-594.g697b0d99.el8.no 106/138 2022-11-27T16:33:03.414 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-594.g697b0d99.e 104/138 2022-11-27T16:33:03.575 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-594.g697b0d99.el8.noar 105/138 2022-11-27T16:33:03.786 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-594.g697b0d99.el8.noar 105/138 2022-11-27T16:33:04.085 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-594.g697b0d99.el8.no 106/138 2022-11-27T16:33:04.396 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-594.g697b0d99.el8.no 106/138 2022-11-27T16:33:04.584 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-594.g697b 107/138 2022-11-27T16:33:04.679 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-594.g697b 107/138 2022-11-27T16:33:05.027 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-594.g697b0d99.el8 108/138 2022-11-27T16:33:05.109 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-594.g697b0d99.el8.no 106/138 2022-11-27T16:33:05.201 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-2:18.0.0-594.g697b0d99.el8.x86_64 109/138 2022-11-27T16:33:05.237 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-2:18.0.0-594.g697b0d99.el8.x86_64 109/138 2022-11-27T16:33:05.275 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-594.g697b 107/138 2022-11-27T16:33:05.370 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-594.g697b 107/138 2022-11-27T16:33:05.417 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-mgr-rook-2:18.0.0-594.g697b0d99.el8.noarch 110/138 2022-11-27T16:33:05.429 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-594.g697b0d99.el8.noarch 110/138 2022-11-27T16:33:05.746 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-594.g697b0d99.el8 108/138 2022-11-27T16:33:05.925 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-2:18.0.0-594.g697b0d99.el8.x86_64 109/138 2022-11-27T16:33:05.962 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-2:18.0.0-594.g697b0d99.el8.x86_64 109/138 2022-11-27T16:33:06.108 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-rook-2:18.0.0-594.g697b0d99.el8.noarch 110/138 2022-11-27T16:33:06.120 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-594.g697b0d99.el8.noarch 110/138 2022-11-27T16:33:07.273 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-2:18.0.0-594.g697b0d99.el8.x86_64 111/138 2022-11-27T16:33:07.450 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-radosgw-2:18.0.0-594.g697b0d99.el8.x86_64 112/138 2022-11-27T16:33:07.484 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-594.g697b0d99.el8.x86_64 112/138 2022-11-27T16:33:07.609 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-594.g697b0d 113/138 2022-11-27T16:33:07.652 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-594.g697b0d 113/138 2022-11-27T16:33:07.784 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-mirror-2:18.0.0-594.g697b0d99.el8.x86_64 114/138 2022-11-27T16:33:07.965 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-2:18.0.0-594.g697b0d99.el8.x86_64 111/138 2022-11-27T16:33:08.131 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-radosgw-2:18.0.0-594.g697b0d99.el8.x86_64 112/138 2022-11-27T16:33:08.155 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-594.g697b0d99.el8.x86_64 114/138 2022-11-27T16:33:08.166 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-594.g697b0d99.el8.x86_64 112/138 2022-11-27T16:33:08.317 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-mirror-2:18.0.0-594.g697b0d99.el8.x86_64 115/138 2022-11-27T16:33:08.333 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-594.g697b0d 113/138 2022-11-27T16:33:08.376 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-594.g697b0d 113/138 2022-11-27T16:33:08.517 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-mirror-2:18.0.0-594.g697b0d99.el8.x86_64 114/138 2022-11-27T16:33:08.885 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-594.g697b0d99.el8.x86_64 114/138 2022-11-27T16:33:09.016 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-mirror-2:18.0.0-594.g697b0d99.el8.x86_64 115/138 2022-11-27T16:33:13.801 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: rbd-mirror-2:18.0.0-594.g697b0d99.el8.x86_64 115/138 2022-11-27T16:33:14.072 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-test-2:18.0.0-594.g697b0d99.el8.x86_64 116/138 2022-11-27T16:33:14.216 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libtool-2.4.6-25.el8.x86_64 117/138 2022-11-27T16:33:14.421 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 117/138 2022-11-27T16:33:14.454 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: rbd-mirror-2:18.0.0-594.g697b0d99.el8.x86_64 115/138 2022-11-27T16:33:14.703 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 118/138 2022-11-27T16:33:14.730 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-test-2:18.0.0-594.g697b0d99.el8.x86_64 116/138 2022-11-27T16:33:14.849 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libtool-2.4.6-25.el8.x86_64 117/138 2022-11-27T16:33:15.051 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 117/138 2022-11-27T16:33:15.326 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 118/138 2022-11-27T16:33:15.536 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : ceph-fuse-2:18.0.0-594.g697b0d99.el8.x86_64 119/138 2022-11-27T16:33:15.778 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 120/138 2022-11-27T16:33:15.962 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 121/138 2022-11-27T16:33:16.137 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libcephfs-devel-2:18.0.0-594.g697b0d99.el8.x86_6 122/138 2022-11-27T16:33:16.204 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-fuse-2:18.0.0-594.g697b0d99.el8.x86_64 119/138 2022-11-27T16:33:16.317 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 123/138 2022-11-27T16:33:16.444 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 120/138 2022-11-27T16:33:16.636 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 121/138 2022-11-27T16:33:16.803 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs-devel-2:18.0.0-594.g697b0d99.el8.x86_6 122/138 2022-11-27T16:33:16.958 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 123/138 2022-11-27T16:33:18.496 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/138 2022-11-27T16:33:18.758 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 124/138 2022-11-27T16:33:18.791 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/138 2022-11-27T16:33:19.033 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : cephfs-top-2:18.0.0-594.g697b0d99.el8.noarch 125/138 2022-11-27T16:33:19.169 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/138 2022-11-27T16:33:19.224 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-fuse-2:18.0.0-594.g697b0d99.el8.x86_64 126/138 2022-11-27T16:33:19.424 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 124/138 2022-11-27T16:33:19.441 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 124/138 2022-11-27T16:33:19.487 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : rbd-nbd-2:18.0.0-594.g697b0d99.el8.x86_64 127/138 2022-11-27T16:33:19.621 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-top-2:18.0.0-594.g697b0d99.el8.noarch 125/138 2022-11-27T16:33:19.808 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : openssl-1:1.1.1k-7.el8_6.x86_64 128/138 2022-11-27T16:33:19.882 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-fuse-2:18.0.0-594.g697b0d99.el8.x86_64 126/138 2022-11-27T16:33:20.068 INFO:teuthology.orchestra.run.smithi055.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 129/138 2022-11-27T16:33:20.120 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-nbd-2:18.0.0-594.g697b0d99.el8.x86_64 127/138 2022-11-27T16:33:20.232 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/138 2022-11-27T16:33:20.241 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/138 2022-11-27T16:33:20.404 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/138 2022-11-27T16:33:20.437 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : openssl-1:1.1.1k-7.el8_6.x86_64 128/138 2022-11-27T16:33:20.673 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/138 2022-11-27T16:33:20.742 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 129/138 2022-11-27T16:33:20.754 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/138 2022-11-27T16:33:20.890 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/138 2022-11-27T16:33:20.899 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/138 2022-11-27T16:33:20.924 INFO:teuthology.orchestra.run.smithi055.stdout: Installing : bison-3.0.4-10.el8.x86_64 133/138 2022-11-27T16:33:20.939 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 133/138 2022-11-27T16:33:21.070 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/138 2022-11-27T16:33:21.101 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 134/138 2022-11-27T16:33:21.101 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 135/138 2022-11-27T16:33:21.290 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/138 2022-11-27T16:33:21.294 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 135/138 2022-11-27T16:33:21.294 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 136/138 2022-11-27T16:33:21.373 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/138 2022-11-27T16:33:21.541 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 136/138 2022-11-27T16:33:21.541 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 137/138 2022-11-27T16:33:21.714 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : bison-3.0.4-10.el8.x86_64 133/138 2022-11-27T16:33:21.733 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 133/138 2022-11-27T16:33:21.780 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 137/138 2022-11-27T16:33:21.917 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 134/138 2022-11-27T16:33:21.917 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 135/138 2022-11-27T16:33:21.957 INFO:teuthology.orchestra.run.smithi055.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 138/138 2022-11-27T16:33:22.110 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 135/138 2022-11-27T16:33:22.111 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 136/138 2022-11-27T16:33:22.351 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 136/138 2022-11-27T16:33:22.352 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 137/138 2022-11-27T16:33:22.556 INFO:teuthology.orchestra.run.smithi055.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 138/138 2022-11-27T16:33:22.556 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-2:18.0.0-594.g697b0d99.el8.x86_64 1/138 2022-11-27T16:33:22.556 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-base-2:18.0.0-594.g697b0d99.el8.x86_64 2/138 2022-11-27T16:33:22.556 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-common-2:18.0.0-594.g697b0d99.el8.x86_64 3/138 2022-11-27T16:33:22.557 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-fuse-2:18.0.0-594.g697b0d99.el8.x86_64 4/138 2022-11-27T16:33:22.557 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-594.g697b0d 5/138 2022-11-27T16:33:22.557 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mds-2:18.0.0-594.g697b0d99.el8.x86_64 6/138 2022-11-27T16:33:22.557 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-2:18.0.0-594.g697b0d99.el8.x86_64 7/138 2022-11-27T16:33:22.557 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mon-2:18.0.0-594.g697b0d99.el8.x86_64 8/138 2022-11-27T16:33:22.558 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-osd-2:18.0.0-594.g697b0d99.el8.x86_64 9/138 2022-11-27T16:33:22.558 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-radosgw-2:18.0.0-594.g697b0d99.el8.x86_64 10/138 2022-11-27T16:33:22.558 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-selinux-2:18.0.0-594.g697b0d99.el8.x86_64 11/138 2022-11-27T16:33:22.559 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-test-2:18.0.0-594.g697b0d99.el8.x86_64 12/138 2022-11-27T16:33:22.559 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-mirror-2:18.0.0-594.g697b0d99.el8.x86_64 13/138 2022-11-27T16:33:22.559 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs-devel-2:18.0.0-594.g697b0d99.el8.x86_6 14/138 2022-11-27T16:33:22.559 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephfs2-2:18.0.0-594.g697b0d99.el8.x86_64 15/138 2022-11-27T16:33:22.560 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcephsqlite-2:18.0.0-594.g697b0d99.el8.x86_64 16/138 2022-11-27T16:33:22.560 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados-devel-2:18.0.0-594.g697b0d99.el8.x86_64 17/138 2022-11-27T16:33:22.561 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libradosstriper1-2:18.0.0-594.g697b0d99.el8.x86_ 18/138 2022-11-27T16:33:22.561 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librgw2-2:18.0.0-594.g697b0d99.el8.x86_64 19/138 2022-11-27T16:33:22.561 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-argparse-2:18.0.0-594.g697b0d99.el8 20/138 2022-11-27T16:33:22.562 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-ceph-common-2:18.0.0-594.g697b0d99.el8.x 21/138 2022-11-27T16:33:22.562 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cephfs-2:18.0.0-594.g697b0d99.el8.x86_64 22/138 2022-11-27T16:33:22.562 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rados-2:18.0.0-594.g697b0d99.el8.x86_64 23/138 2022-11-27T16:33:22.562 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rbd-2:18.0.0-594.g697b0d99.el8.x86_64 24/138 2022-11-27T16:33:22.563 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rgw-2:18.0.0-594.g697b0d99.el8.x86_64 25/138 2022-11-27T16:33:22.563 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-fuse-2:18.0.0-594.g697b0d99.el8.x86_64 26/138 2022-11-27T16:33:22.563 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-mirror-2:18.0.0-594.g697b0d99.el8.x86_64 27/138 2022-11-27T16:33:22.563 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : rbd-nbd-2:18.0.0-594.g697b0d99.el8.x86_64 28/138 2022-11-27T16:33:22.564 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-594.g697b0d99.e 29/138 2022-11-27T16:33:22.564 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-594.g697b0d99.el8.noar 30/138 2022-11-27T16:33:22.564 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-594.g697b0d99.el8.no 31/138 2022-11-27T16:33:22.564 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-594.g697b 32/138 2022-11-27T16:33:22.564 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-594.g697b0d99.el8 33/138 2022-11-27T16:33:22.565 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-mgr-rook-2:18.0.0-594.g697b0d99.el8.noarch 34/138 2022-11-27T16:33:22.565 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-594.g697b0d99.el 35/138 2022-11-27T16:33:22.565 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : ceph-volume-2:18.0.0-594.g697b0d99.el8.noarch 36/138 2022-11-27T16:33:22.565 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephadm-2:18.0.0-594.g697b0d99.el8.noarch 37/138 2022-11-27T16:33:22.566 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : cephfs-top-2:18.0.0-594.g697b0d99.el8.noarch 38/138 2022-11-27T16:33:22.566 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/138 2022-11-27T16:33:22.566 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/138 2022-11-27T16:33:22.566 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/138 2022-11-27T16:33:22.566 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/138 2022-11-27T16:33:22.567 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/138 2022-11-27T16:33:22.567 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/138 2022-11-27T16:33:22.567 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/138 2022-11-27T16:33:22.568 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/138 2022-11-27T16:33:22.568 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/138 2022-11-27T16:33:22.568 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/138 2022-11-27T16:33:22.568 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/138 2022-11-27T16:33:22.568 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/138 2022-11-27T16:33:22.569 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/138 2022-11-27T16:33:22.569 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/138 2022-11-27T16:33:22.569 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/138 2022-11-27T16:33:22.569 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/138 2022-11-27T16:33:22.570 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/138 2022-11-27T16:33:22.570 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/138 2022-11-27T16:33:22.570 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/138 2022-11-27T16:33:22.570 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/138 2022-11-27T16:33:22.570 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/138 2022-11-27T16:33:22.571 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/138 2022-11-27T16:33:22.571 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/138 2022-11-27T16:33:22.572 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/138 2022-11-27T16:33:22.572 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/138 2022-11-27T16:33:22.572 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/138 2022-11-27T16:33:22.572 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/138 2022-11-27T16:33:22.573 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/138 2022-11-27T16:33:22.573 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/138 2022-11-27T16:33:22.573 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/138 2022-11-27T16:33:22.573 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/138 2022-11-27T16:33:22.574 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/138 2022-11-27T16:33:22.574 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/138 2022-11-27T16:33:22.574 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 72/138 2022-11-27T16:33:22.574 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : bison-3.0.4-10.el8.x86_64 73/138 2022-11-27T16:33:22.575 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 74/138 2022-11-27T16:33:22.575 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 75/138 2022-11-27T16:33:22.576 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 76/138 2022-11-27T16:33:22.576 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/138 2022-11-27T16:33:22.576 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 78/138 2022-11-27T16:33:22.577 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 79/138 2022-11-27T16:33:22.577 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 80/138 2022-11-27T16:33:22.578 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 81/138 2022-11-27T16:33:22.578 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 82/138 2022-11-27T16:33:22.579 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 83/138 2022-11-27T16:33:22.579 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 84/138 2022-11-27T16:33:22.579 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 85/138 2022-11-27T16:33:22.580 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 86/138 2022-11-27T16:33:22.580 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 87/138 2022-11-27T16:33:22.581 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 88/138 2022-11-27T16:33:22.581 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : flex-2.6.1-9.el8.x86_64 89/138 2022-11-27T16:33:22.581 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 90/138 2022-11-27T16:33:22.582 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : jq-1.6-3.el8.x86_64 91/138 2022-11-27T16:33:22.582 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 92/138 2022-11-27T16:33:22.582 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : automake-1.16.1-7.el8.noarch 93/138 2022-11-27T16:33:22.583 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 94/138 2022-11-27T16:33:22.583 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 95/138 2022-11-27T16:33:22.583 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 96/138 2022-11-27T16:33:22.584 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libpq-13.5-1.el8.x86_64 97/138 2022-11-27T16:33:22.584 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 98/138 2022-11-27T16:33:22.585 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 99/138 2022-11-27T16:33:22.585 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 100/138 2022-11-27T16:33:22.585 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 101/138 2022-11-27T16:33:22.586 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/138 2022-11-27T16:33:22.586 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 103/138 2022-11-27T16:33:22.586 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 104/138 2022-11-27T16:33:22.586 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 105/138 2022-11-27T16:33:22.587 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/138 2022-11-27T16:33:22.587 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 107/138 2022-11-27T16:33:22.587 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 108/138 2022-11-27T16:33:22.587 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 109/138 2022-11-27T16:33:22.588 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 110/138 2022-11-27T16:33:22.588 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 111/138 2022-11-27T16:33:22.588 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 112/138 2022-11-27T16:33:22.588 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 113/138 2022-11-27T16:33:22.589 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 114/138 2022-11-27T16:33:22.589 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 115/138 2022-11-27T16:33:22.589 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 116/138 2022-11-27T16:33:22.589 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 117/138 2022-11-27T16:33:22.589 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/138 2022-11-27T16:33:22.590 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 119/138 2022-11-27T16:33:22.590 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 120/138 2022-11-27T16:33:22.590 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 121/138 2022-11-27T16:33:22.590 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 122/138 2022-11-27T16:33:22.590 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 123/138 2022-11-27T16:33:22.591 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 124/138 2022-11-27T16:33:22.591 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 125/138 2022-11-27T16:33:22.591 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 126/138 2022-11-27T16:33:22.591 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 127/138 2022-11-27T16:33:22.592 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/138 2022-11-27T16:33:22.592 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-2:18.0.0-594.g697b0d99.el8.x86_64 129/138 2022-11-27T16:33:22.592 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/138 2022-11-27T16:33:22.592 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-2:18.0.0-594.g697b0d99.el8.x86_64 131/138 2022-11-27T16:33:22.592 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/138 2022-11-27T16:33:22.593 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-1:1.1.1k-7.el8_6.x86_64 133/138 2022-11-27T16:33:22.593 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 134/138 2022-11-27T16:33:22.593 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-libs-1:1.1.1k-7.el8_6.x86_64 135/138 2022-11-27T16:33:22.593 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 136/138 2022-11-27T16:33:22.594 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 137/138 2022-11-27T16:33:22.594 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 137/138 2022-11-27T16:33:22.814 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 138/138 2022-11-27T16:33:23.404 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 138/138 2022-11-27T16:33:23.404 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-2:18.0.0-594.g697b0d99.el8.x86_64 1/138 2022-11-27T16:33:23.404 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-base-2:18.0.0-594.g697b0d99.el8.x86_64 2/138 2022-11-27T16:33:23.405 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-common-2:18.0.0-594.g697b0d99.el8.x86_64 3/138 2022-11-27T16:33:23.405 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-fuse-2:18.0.0-594.g697b0d99.el8.x86_64 4/138 2022-11-27T16:33:23.405 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-594.g697b0d 5/138 2022-11-27T16:33:23.405 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mds-2:18.0.0-594.g697b0d99.el8.x86_64 6/138 2022-11-27T16:33:23.406 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-2:18.0.0-594.g697b0d99.el8.x86_64 7/138 2022-11-27T16:33:23.406 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mon-2:18.0.0-594.g697b0d99.el8.x86_64 8/138 2022-11-27T16:33:23.406 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-osd-2:18.0.0-594.g697b0d99.el8.x86_64 9/138 2022-11-27T16:33:23.406 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-radosgw-2:18.0.0-594.g697b0d99.el8.x86_64 10/138 2022-11-27T16:33:23.406 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-selinux-2:18.0.0-594.g697b0d99.el8.x86_64 11/138 2022-11-27T16:33:23.407 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-test-2:18.0.0-594.g697b0d99.el8.x86_64 12/138 2022-11-27T16:33:23.407 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-mirror-2:18.0.0-594.g697b0d99.el8.x86_64 13/138 2022-11-27T16:33:23.407 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs-devel-2:18.0.0-594.g697b0d99.el8.x86_6 14/138 2022-11-27T16:33:23.407 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs2-2:18.0.0-594.g697b0d99.el8.x86_64 15/138 2022-11-27T16:33:23.408 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephsqlite-2:18.0.0-594.g697b0d99.el8.x86_64 16/138 2022-11-27T16:33:23.408 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados-devel-2:18.0.0-594.g697b0d99.el8.x86_64 17/138 2022-11-27T16:33:23.408 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libradosstriper1-2:18.0.0-594.g697b0d99.el8.x86_ 18/138 2022-11-27T16:33:23.408 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librgw2-2:18.0.0-594.g697b0d99.el8.x86_64 19/138 2022-11-27T16:33:23.408 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-argparse-2:18.0.0-594.g697b0d99.el8 20/138 2022-11-27T16:33:23.409 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-common-2:18.0.0-594.g697b0d99.el8.x 21/138 2022-11-27T16:33:23.409 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cephfs-2:18.0.0-594.g697b0d99.el8.x86_64 22/138 2022-11-27T16:33:23.409 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rados-2:18.0.0-594.g697b0d99.el8.x86_64 23/138 2022-11-27T16:33:23.409 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rbd-2:18.0.0-594.g697b0d99.el8.x86_64 24/138 2022-11-27T16:33:23.409 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rgw-2:18.0.0-594.g697b0d99.el8.x86_64 25/138 2022-11-27T16:33:23.410 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-fuse-2:18.0.0-594.g697b0d99.el8.x86_64 26/138 2022-11-27T16:33:23.410 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-mirror-2:18.0.0-594.g697b0d99.el8.x86_64 27/138 2022-11-27T16:33:23.410 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-nbd-2:18.0.0-594.g697b0d99.el8.x86_64 28/138 2022-11-27T16:33:23.410 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-594.g697b0d99.e 29/138 2022-11-27T16:33:23.411 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-594.g697b0d99.el8.noar 30/138 2022-11-27T16:33:23.421 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-594.g697b0d99.el8.no 31/138 2022-11-27T16:33:23.422 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-594.g697b 32/138 2022-11-27T16:33:23.422 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-594.g697b0d99.el8 33/138 2022-11-27T16:33:23.422 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-rook-2:18.0.0-594.g697b0d99.el8.noarch 34/138 2022-11-27T16:33:23.422 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-594.g697b0d99.el 35/138 2022-11-27T16:33:23.423 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-volume-2:18.0.0-594.g697b0d99.el8.noarch 36/138 2022-11-27T16:33:23.423 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephadm-2:18.0.0-594.g697b0d99.el8.noarch 37/138 2022-11-27T16:33:23.423 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-top-2:18.0.0-594.g697b0d99.el8.noarch 38/138 2022-11-27T16:33:23.423 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/138 2022-11-27T16:33:23.424 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/138 2022-11-27T16:33:23.424 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/138 2022-11-27T16:33:23.424 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/138 2022-11-27T16:33:23.424 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/138 2022-11-27T16:33:23.424 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/138 2022-11-27T16:33:23.425 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/138 2022-11-27T16:33:23.425 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/138 2022-11-27T16:33:23.425 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/138 2022-11-27T16:33:23.425 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/138 2022-11-27T16:33:23.425 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/138 2022-11-27T16:33:23.426 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/138 2022-11-27T16:33:23.426 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/138 2022-11-27T16:33:23.426 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/138 2022-11-27T16:33:23.426 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/138 2022-11-27T16:33:23.426 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/138 2022-11-27T16:33:23.427 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/138 2022-11-27T16:33:23.427 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/138 2022-11-27T16:33:23.428 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/138 2022-11-27T16:33:23.428 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/138 2022-11-27T16:33:23.428 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/138 2022-11-27T16:33:23.429 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/138 2022-11-27T16:33:23.430 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/138 2022-11-27T16:33:23.430 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/138 2022-11-27T16:33:23.430 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/138 2022-11-27T16:33:23.430 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/138 2022-11-27T16:33:23.430 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/138 2022-11-27T16:33:23.431 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/138 2022-11-27T16:33:23.431 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/138 2022-11-27T16:33:23.431 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/138 2022-11-27T16:33:23.431 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/138 2022-11-27T16:33:23.432 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/138 2022-11-27T16:33:23.432 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/138 2022-11-27T16:33:23.432 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 72/138 2022-11-27T16:33:23.432 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : bison-3.0.4-10.el8.x86_64 73/138 2022-11-27T16:33:23.432 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 74/138 2022-11-27T16:33:23.433 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 75/138 2022-11-27T16:33:23.433 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 76/138 2022-11-27T16:33:23.433 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/138 2022-11-27T16:33:23.433 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 78/138 2022-11-27T16:33:23.434 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 79/138 2022-11-27T16:33:23.434 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 80/138 2022-11-27T16:33:23.434 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 81/138 2022-11-27T16:33:23.434 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 82/138 2022-11-27T16:33:23.434 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 83/138 2022-11-27T16:33:23.435 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 84/138 2022-11-27T16:33:23.435 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 85/138 2022-11-27T16:33:23.435 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 86/138 2022-11-27T16:33:23.435 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 87/138 2022-11-27T16:33:23.436 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 88/138 2022-11-27T16:33:23.436 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flex-2.6.1-9.el8.x86_64 89/138 2022-11-27T16:33:23.436 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 90/138 2022-11-27T16:33:23.436 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : jq-1.6-3.el8.x86_64 91/138 2022-11-27T16:33:23.436 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 92/138 2022-11-27T16:33:23.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : automake-1.16.1-7.el8.noarch 93/138 2022-11-27T16:33:23.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 94/138 2022-11-27T16:33:23.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 95/138 2022-11-27T16:33:23.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 96/138 2022-11-27T16:33:23.437 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libpq-13.5-1.el8.x86_64 97/138 2022-11-27T16:33:23.438 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 98/138 2022-11-27T16:33:23.438 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 99/138 2022-11-27T16:33:23.438 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 100/138 2022-11-27T16:33:23.438 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 101/138 2022-11-27T16:33:23.439 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/138 2022-11-27T16:33:23.439 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 103/138 2022-11-27T16:33:23.439 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 104/138 2022-11-27T16:33:23.439 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 105/138 2022-11-27T16:33:23.439 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/138 2022-11-27T16:33:23.440 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 107/138 2022-11-27T16:33:23.440 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 108/138 2022-11-27T16:33:23.440 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 109/138 2022-11-27T16:33:23.440 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 110/138 2022-11-27T16:33:23.441 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 111/138 2022-11-27T16:33:23.441 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 112/138 2022-11-27T16:33:23.441 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 113/138 2022-11-27T16:33:23.441 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 114/138 2022-11-27T16:33:23.441 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 115/138 2022-11-27T16:33:23.442 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 116/138 2022-11-27T16:33:23.442 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 117/138 2022-11-27T16:33:23.442 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/138 2022-11-27T16:33:23.442 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 119/138 2022-11-27T16:33:23.442 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 120/138 2022-11-27T16:33:23.443 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 121/138 2022-11-27T16:33:23.443 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 122/138 2022-11-27T16:33:23.443 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 123/138 2022-11-27T16:33:23.443 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 124/138 2022-11-27T16:33:23.443 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 125/138 2022-11-27T16:33:23.444 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 126/138 2022-11-27T16:33:23.444 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 127/138 2022-11-27T16:33:23.444 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/138 2022-11-27T16:33:23.444 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:18.0.0-594.g697b0d99.el8.x86_64 129/138 2022-11-27T16:33:23.445 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/138 2022-11-27T16:33:23.445 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:18.0.0-594.g697b0d99.el8.x86_64 131/138 2022-11-27T16:33:23.445 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/138 2022-11-27T16:33:23.445 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-1:1.1.1k-7.el8_6.x86_64 133/138 2022-11-27T16:33:23.445 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 134/138 2022-11-27T16:33:23.446 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-libs-1:1.1.1k-7.el8_6.x86_64 135/138 2022-11-27T16:33:23.446 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 136/138 2022-11-27T16:33:23.446 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 137/138 2022-11-27T16:33:24.397 INFO:teuthology.orchestra.run.smithi055.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 138/138 2022-11-27T16:33:24.398 INFO:teuthology.orchestra.run.smithi055.stdout:Installed products updated. 2022-11-27T16:33:24.647 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:24.647 INFO:teuthology.orchestra.run.smithi055.stdout:Upgraded: 2022-11-27T16:33:24.648 INFO:teuthology.orchestra.run.smithi055.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2022-11-27T16:33:24.648 INFO:teuthology.orchestra.run.smithi055.stdout: librados2-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.648 INFO:teuthology.orchestra.run.smithi055.stdout: librbd1-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.648 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-1:1.1.1k-7.el8_6.x86_64 2022-11-27T16:33:24.649 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-libs-1:1.1.1k-7.el8_6.x86_64 2022-11-27T16:33:24.649 INFO:teuthology.orchestra.run.smithi055.stdout:Installed: 2022-11-27T16:33:24.649 INFO:teuthology.orchestra.run.smithi055.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2022-11-27T16:33:24.649 INFO:teuthology.orchestra.run.smithi055.stdout: automake-1.16.1-7.el8.noarch 2022-11-27T16:33:24.650 INFO:teuthology.orchestra.run.smithi055.stdout: bison-3.0.4-10.el8.x86_64 2022-11-27T16:33:24.650 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.650 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.650 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-common-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.650 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-fuse-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.651 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-grafana-dashboards-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:24.651 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-immutable-object-cache-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.651 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mds-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.651 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.652 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-cephadm-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:24.652 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:24.652 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-diskprediction-local-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:24.652 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:24.653 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-rook-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:24.653 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mon-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.653 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-osd-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.653 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-prometheus-alerts-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:24.653 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-radosgw-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.654 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-selinux-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.654 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-test-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.654 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-volume-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:24.654 INFO:teuthology.orchestra.run.smithi055.stdout: cephadm-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:24.655 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.655 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-top-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:24.655 INFO:teuthology.orchestra.run.smithi055.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2022-11-27T16:33:24.655 INFO:teuthology.orchestra.run.smithi055.stdout: flex-2.6.1-9.el8.x86_64 2022-11-27T16:33:24.655 INFO:teuthology.orchestra.run.smithi055.stdout: fuse-2.9.7-15.el8.x86_64 2022-11-27T16:33:24.656 INFO:teuthology.orchestra.run.smithi055.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-11-27T16:33:24.656 INFO:teuthology.orchestra.run.smithi055.stdout: jq-1.6-3.el8.x86_64 2022-11-27T16:33:24.656 INFO:teuthology.orchestra.run.smithi055.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-11-27T16:33:24.656 INFO:teuthology.orchestra.run.smithi055.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-11-27T16:33:24.657 INFO:teuthology.orchestra.run.smithi055.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-11-27T16:33:24.657 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs-devel-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.657 INFO:teuthology.orchestra.run.smithi055.stdout: libcephfs2-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.657 INFO:teuthology.orchestra.run.smithi055.stdout: libcephsqlite-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.657 INFO:teuthology.orchestra.run.smithi055.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2022-11-27T16:33:24.658 INFO:teuthology.orchestra.run.smithi055.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2022-11-27T16:33:24.658 INFO:teuthology.orchestra.run.smithi055.stdout: liboath-2.6.2-3.el8.x86_64 2022-11-27T16:33:24.658 INFO:teuthology.orchestra.run.smithi055.stdout: libpq-13.5-1.el8.x86_64 2022-11-27T16:33:24.658 INFO:teuthology.orchestra.run.smithi055.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2022-11-27T16:33:24.659 INFO:teuthology.orchestra.run.smithi055.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-11-27T16:33:24.659 INFO:teuthology.orchestra.run.smithi055.stdout: librados-devel-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.659 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.659 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-11-27T16:33:24.660 INFO:teuthology.orchestra.run.smithi055.stdout: librgw2-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.660 INFO:teuthology.orchestra.run.smithi055.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-11-27T16:33:24.660 INFO:teuthology.orchestra.run.smithi055.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-11-27T16:33:24.660 INFO:teuthology.orchestra.run.smithi055.stdout: libtool-2.4.6-25.el8.x86_64 2022-11-27T16:33:24.661 INFO:teuthology.orchestra.run.smithi055.stdout: libunwind-1.3.1-3.el8.x86_64 2022-11-27T16:33:24.661 INFO:teuthology.orchestra.run.smithi055.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2022-11-27T16:33:24.661 INFO:teuthology.orchestra.run.smithi055.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-11-27T16:33:24.661 INFO:teuthology.orchestra.run.smithi055.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-11-27T16:33:24.662 INFO:teuthology.orchestra.run.smithi055.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-11-27T16:33:24.662 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-0.3.15-3.el8.x86_64 2022-11-27T16:33:24.662 INFO:teuthology.orchestra.run.smithi055.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-11-27T16:33:24.662 INFO:teuthology.orchestra.run.smithi055.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2022-11-27T16:33:24.662 INFO:teuthology.orchestra.run.smithi055.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-11-27T16:33:24.663 INFO:teuthology.orchestra.run.smithi055.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-11-27T16:33:24.663 INFO:teuthology.orchestra.run.smithi055.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-11-27T16:33:24.663 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-11-27T16:33:24.663 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-11-27T16:33:24.664 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-11-27T16:33:24.664 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-11-27T16:33:24.664 INFO:teuthology.orchestra.run.smithi055.stdout: python3-babel-2.5.1-7.el8.noarch 2022-11-27T16:33:24.664 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-11-27T16:33:24.665 INFO:teuthology.orchestra.run.smithi055.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-11-27T16:33:24.665 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-11-27T16:33:24.665 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.665 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.666 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cephfs-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.666 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-11-27T16:33:24.666 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-11-27T16:33:24.666 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-11-27T16:33:24.666 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-11-27T16:33:24.667 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-11-27T16:33:24.667 INFO:teuthology.orchestra.run.smithi055.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-11-27T16:33:24.667 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-6.2-6.el8.noarch 2022-11-27T16:33:24.667 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-11-27T16:33:24.668 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-11-27T16:33:24.668 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-11-27T16:33:24.668 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-11-27T16:33:24.668 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-11-27T16:33:24.668 INFO:teuthology.orchestra.run.smithi055.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-11-27T16:33:24.669 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-11-27T16:33:24.669 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako-1.0.6-13.el8.noarch 2022-11-27T16:33:24.669 INFO:teuthology.orchestra.run.smithi055.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-11-27T16:33:24.669 INFO:teuthology.orchestra.run.smithi055.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-11-27T16:33:24.670 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-11-27T16:33:24.670 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-11-27T16:33:24.670 INFO:teuthology.orchestra.run.smithi055.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-11-27T16:33:24.670 INFO:teuthology.orchestra.run.smithi055.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-11-27T16:33:24.670 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-11-27T16:33:24.671 INFO:teuthology.orchestra.run.smithi055.stdout: python3-portend-2.6-1.el8.noarch 2022-11-27T16:33:24.671 INFO:teuthology.orchestra.run.smithi055.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-11-27T16:33:24.671 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-11-27T16:33:24.671 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-11-27T16:33:24.672 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-11-27T16:33:24.672 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pycparser-2.14-14.el8.noarch 2022-11-27T16:33:24.672 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pytz-2017.2-9.el8.noarch 2022-11-27T16:33:24.672 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.673 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rbd-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.673 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-11-27T16:33:24.673 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-11-27T16:33:24.673 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rgw-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.673 INFO:teuthology.orchestra.run.smithi055.stdout: python3-routes-2.4.1-12.el8.noarch 2022-11-27T16:33:24.674 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa-4.8-1.el8.noarch 2022-11-27T16:33:24.674 INFO:teuthology.orchestra.run.smithi055.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2022-11-27T16:33:24.674 INFO:teuthology.orchestra.run.smithi055.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-11-27T16:33:24.674 INFO:teuthology.orchestra.run.smithi055.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-11-27T16:33:24.675 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-11-27T16:33:24.675 INFO:teuthology.orchestra.run.smithi055.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-11-27T16:33:24.675 INFO:teuthology.orchestra.run.smithi055.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-11-27T16:33:24.675 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-11-27T16:33:24.676 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-11-27T16:33:24.676 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-11-27T16:33:24.676 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-11-27T16:33:24.676 INFO:teuthology.orchestra.run.smithi055.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-11-27T16:33:24.677 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-fuse-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.677 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-mirror-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.677 INFO:teuthology.orchestra.run.smithi055.stdout: rbd-nbd-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:24.677 INFO:teuthology.orchestra.run.smithi055.stdout: socat-1.7.4.1-1.el8.x86_64 2022-11-27T16:33:24.678 INFO:teuthology.orchestra.run.smithi055.stdout: thrift-0.13.0-2.el8.x86_64 2022-11-27T16:33:24.678 INFO:teuthology.orchestra.run.smithi055.stdout: uuid-1.6.2-43.el8.x86_64 2022-11-27T16:33:24.678 INFO:teuthology.orchestra.run.smithi055.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-11-27T16:33:24.678 INFO:teuthology.orchestra.run.smithi055.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2022-11-27T16:33:24.679 INFO:teuthology.orchestra.run.smithi055.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2022-11-27T16:33:24.679 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:24.679 INFO:teuthology.orchestra.run.smithi055.stdout:Complete! 2022-11-27T16:33:24.825 DEBUG:teuthology.parallel:result is None 2022-11-27T16:33:25.358 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 138/138 2022-11-27T16:33:25.358 INFO:teuthology.orchestra.run.smithi006.stdout:Installed products updated. 2022-11-27T16:33:25.623 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:25.624 INFO:teuthology.orchestra.run.smithi006.stdout:Upgraded: 2022-11-27T16:33:25.624 INFO:teuthology.orchestra.run.smithi006.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2022-11-27T16:33:25.624 INFO:teuthology.orchestra.run.smithi006.stdout: librados2-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.625 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.625 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-1:1.1.1k-7.el8_6.x86_64 2022-11-27T16:33:25.625 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-libs-1:1.1.1k-7.el8_6.x86_64 2022-11-27T16:33:25.625 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2022-11-27T16:33:25.625 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2022-11-27T16:33:25.626 INFO:teuthology.orchestra.run.smithi006.stdout: automake-1.16.1-7.el8.noarch 2022-11-27T16:33:25.626 INFO:teuthology.orchestra.run.smithi006.stdout: bison-3.0.4-10.el8.x86_64 2022-11-27T16:33:25.626 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.627 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.627 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.627 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.627 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:25.628 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.628 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.628 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.628 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:25.629 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:25.629 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:25.629 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:25.629 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:25.629 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.630 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.630 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:25.630 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.630 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.631 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.631 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:25.631 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:25.632 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.632 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top-2:18.0.0-594.g697b0d99.el8.noarch 2022-11-27T16:33:25.632 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2022-11-27T16:33:25.632 INFO:teuthology.orchestra.run.smithi006.stdout: flex-2.6.1-9.el8.x86_64 2022-11-27T16:33:25.632 INFO:teuthology.orchestra.run.smithi006.stdout: fuse-2.9.7-15.el8.x86_64 2022-11-27T16:33:25.633 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-11-27T16:33:25.633 INFO:teuthology.orchestra.run.smithi006.stdout: jq-1.6-3.el8.x86_64 2022-11-27T16:33:25.633 INFO:teuthology.orchestra.run.smithi006.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-11-27T16:33:25.633 INFO:teuthology.orchestra.run.smithi006.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-11-27T16:33:25.634 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-11-27T16:33:25.634 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.634 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.634 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.635 INFO:teuthology.orchestra.run.smithi006.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2022-11-27T16:33:25.635 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2022-11-27T16:33:25.635 INFO:teuthology.orchestra.run.smithi006.stdout: liboath-2.6.2-3.el8.x86_64 2022-11-27T16:33:25.635 INFO:teuthology.orchestra.run.smithi006.stdout: libpq-13.5-1.el8.x86_64 2022-11-27T16:33:25.635 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2022-11-27T16:33:25.636 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-11-27T16:33:25.636 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.636 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.636 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-11-27T16:33:25.637 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.637 INFO:teuthology.orchestra.run.smithi006.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-11-27T16:33:25.637 INFO:teuthology.orchestra.run.smithi006.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-11-27T16:33:25.637 INFO:teuthology.orchestra.run.smithi006.stdout: libtool-2.4.6-25.el8.x86_64 2022-11-27T16:33:25.637 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind-1.3.1-3.el8.x86_64 2022-11-27T16:33:25.638 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2022-11-27T16:33:25.638 INFO:teuthology.orchestra.run.smithi006.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-11-27T16:33:25.638 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-11-27T16:33:25.638 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-11-27T16:33:25.639 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-0.3.15-3.el8.x86_64 2022-11-27T16:33:25.639 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-11-27T16:33:25.639 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2022-11-27T16:33:25.639 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-11-27T16:33:25.640 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-11-27T16:33:25.640 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-11-27T16:33:25.640 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-11-27T16:33:25.640 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-11-27T16:33:25.640 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2022-11-27T16:33:25.641 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-11-27T16:33:25.641 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel-2.5.1-7.el8.noarch 2022-11-27T16:33:25.641 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-11-27T16:33:25.641 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-11-27T16:33:25.641 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-11-27T16:33:25.642 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.642 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.642 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.642 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-11-27T16:33:25.643 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-11-27T16:33:25.643 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-11-27T16:33:25.643 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-11-27T16:33:25.643 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-11-27T16:33:25.643 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-11-27T16:33:25.644 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-6.2-6.el8.noarch 2022-11-27T16:33:25.644 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-11-27T16:33:25.644 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-11-27T16:33:25.644 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-11-27T16:33:25.645 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-11-27T16:33:25.645 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-11-27T16:33:25.645 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-11-27T16:33:25.645 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-11-27T16:33:25.645 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako-1.0.6-13.el8.noarch 2022-11-27T16:33:25.646 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-11-27T16:33:25.646 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-11-27T16:33:25.646 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-11-27T16:33:25.646 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-11-27T16:33:25.647 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-11-27T16:33:25.647 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-11-27T16:33:25.647 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-11-27T16:33:25.647 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend-2.6-1.el8.noarch 2022-11-27T16:33:25.648 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-11-27T16:33:25.648 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-11-27T16:33:25.648 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-11-27T16:33:25.648 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-11-27T16:33:25.649 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser-2.14-14.el8.noarch 2022-11-27T16:33:25.649 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz-2017.2-9.el8.noarch 2022-11-27T16:33:25.649 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.649 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.649 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-11-27T16:33:25.650 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-11-27T16:33:25.650 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.650 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes-2.4.1-12.el8.noarch 2022-11-27T16:33:25.650 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa-4.8-1.el8.noarch 2022-11-27T16:33:25.651 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2022-11-27T16:33:25.651 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-11-27T16:33:25.651 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-11-27T16:33:25.651 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-11-27T16:33:25.651 INFO:teuthology.orchestra.run.smithi006.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-11-27T16:33:25.652 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-11-27T16:33:25.652 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-11-27T16:33:25.652 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-11-27T16:33:25.652 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-11-27T16:33:25.653 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-11-27T16:33:25.653 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-11-27T16:33:25.653 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.653 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.653 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd-2:18.0.0-594.g697b0d99.el8.x86_64 2022-11-27T16:33:25.654 INFO:teuthology.orchestra.run.smithi006.stdout: socat-1.7.4.1-1.el8.x86_64 2022-11-27T16:33:25.654 INFO:teuthology.orchestra.run.smithi006.stdout: thrift-0.13.0-2.el8.x86_64 2022-11-27T16:33:25.654 INFO:teuthology.orchestra.run.smithi006.stdout: uuid-1.6.2-43.el8.x86_64 2022-11-27T16:33:25.654 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-11-27T16:33:25.655 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2022-11-27T16:33:25.655 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2022-11-27T16:33:25.656 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:25.656 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2022-11-27T16:33:25.814 DEBUG:teuthology.parallel:result is None 2022-11-27T16:33:25.815 DEBUG:teuthology.orchestra.run.smithi006:> sudo lsb_release -is 2022-11-27T16:33:25.875 INFO:teuthology.orchestra.run.smithi006.stdout:RedHatEnterprise 2022-11-27T16:33:25.877 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-11-27T16:33:25.878 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=697b0d99d9a52df92b20c8e053dcd46c75f364a9 2022-11-27T16:33:26.040 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-11-27T16:33:26.063 INFO:teuthology.orchestra.run.smithi006.stdout:18.0.0-594.g697b0d99.el8 2022-11-27T16:33:26.064 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-594.g697b0d99.el8 2022-11-27T16:33:26.064 INFO:teuthology.task.install:The correct ceph version 18.0.0-594.g697b0d99 is installed. 2022-11-27T16:33:26.065 DEBUG:teuthology.orchestra.run.smithi055:> sudo lsb_release -is 2022-11-27T16:33:26.126 INFO:teuthology.orchestra.run.smithi055.stdout:RedHatEnterprise 2022-11-27T16:33:26.127 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2022-11-27T16:33:26.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=697b0d99d9a52df92b20c8e053dcd46c75f364a9 2022-11-27T16:33:26.276 DEBUG:teuthology.orchestra.run.smithi055:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-11-27T16:33:26.301 INFO:teuthology.orchestra.run.smithi055.stdout:18.0.0-594.g697b0d99.el8 2022-11-27T16:33:26.301 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-594.g697b0d99.el8 2022-11-27T16:33:26.302 INFO:teuthology.task.install:The correct ceph version 18.0.0-594.g697b0d99 is installed. 2022-11-27T16:33:26.302 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-11-27T16:33:26.303 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:33:26.303 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-11-27T16:33:26.333 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:33:26.334 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-11-27T16:33:26.371 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-11-27T16:33:26.372 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:33:26.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2022-11-27T16:33:26.402 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-11-27T16:33:26.470 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:33:26.470 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/daemon-helper 2022-11-27T16:33:26.499 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-11-27T16:33:26.568 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-11-27T16:33:26.568 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:33:26.569 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2022-11-27T16:33:26.596 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-11-27T16:33:26.663 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:33:26.663 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/adjust-ulimits 2022-11-27T16:33:26.692 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-11-27T16:33:26.761 INFO:teuthology.run_tasks:Running task ceph... 2022-11-27T16:33:26.840 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2022-11-27T16:33:26.841 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /var/log/ceph 2022-11-27T16:33:26.844 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 777 /var/log/ceph 2022-11-27T16:33:26.875 INFO:tasks.ceph:Disabling ceph logrotate... 2022-11-27T16:33:26.876 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/logrotate.d/ceph 2022-11-27T16:33:26.912 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/logrotate.d/ceph 2022-11-27T16:33:26.943 INFO:tasks.ceph:Creating extra log directories... 2022-11-27T16:33:26.944 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-11-27T16:33:26.979 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-11-27T16:33:27.018 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2022-11-27T16:33:27.018 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2022-11-27T16:33:27.019 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2022-11-27T16:33:27.019 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:33:27.019 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-11-27T16:33:27.061 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-11-27T16:33:27.177 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-11-27T16:33:27.206 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:33:27.206 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-11-27T16:33:27.224 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-11-27T16:33:27.342 DEBUG:teuthology.orchestra.run.smithi055:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-11-27T16:33:27.379 INFO:tasks.ceph:Creating ceph cluster ceph... 2022-11-27T16:33:27.380 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2022-11-27T16:33:27.380 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2022-11-23_17:24:26-fs-main-distro-default-smithi/7088660', 'branch': 'main', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/snapshot}}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '7088660', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2022-11-23_17:24:26-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '697b0d99d9a52df92b20c8e053dcd46c75f364a9'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '697b0d99d9a52df92b20c8e053dcd46c75f364a9'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '697b0d99d9a52df92b20c8e053dcd46c75f364a9'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '697b0d99d9a52df92b20c8e053dcd46c75f364a9', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_697b0d99d9a52df92b20c8e053dcd46c75f364a9/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '697b0d99d9a52df92b20c8e053dcd46c75f364a9', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi006.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCJN1ugGeXPsGEuGH5ewNMMxJOH/KiLFk4VTJf7ANy6YwBvXnIKkLUjegXxrADB8J/pGXHJ2QGKuoAuqzXibHG/n1O7SfeEQTRYz6KW6Ywe3Zfhu6vLBgh45LlWjtGO52FBGKavdWwc7MgJYJPiLe6oLuDFOaHMDD9xRHHyk8/wOBDlq1HvMnY6C3mKGx7GleDfibQ9NumH4+/dm42NjKY7x66M65i1XlVGDBBpQ8nMwUEo7FwO+uU9zihntWJpn+sXs9v0w1FIBTMJlqDmxbZVzuclnVe+5kAt1ndeXSjZ3Gnb3NAJtGV31Mp9ppEtLATiCY5c4UdXNXwQNEQmGlfZmKygi2/+ChcrPHovAx0rVQI4sYD25ck1YahSHp8BkIz12Vy11VLF07Paz+f2YPtT27zHcDt+Do1wy4KUmLCudoMpsujUe6kTH9LBzwlGpcOG9iVAufqAczv0KvhJq6LXFqc4UcbU2btOkKFyF1ohmMiKozctbdZyRBO+Q+VU+M=', 'smithi055.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0fUECT3SW9Ppvd76JZDOyQE7f29pwtpCCiFeMbsfWJSp1LzSjH7tr0oG6gJ2MoJIZuF4fLtrKdFjeDYdrKV38rpZ64BrzePuaaPqgstLpCT9H1G77Xe776Qhj7s5FN+7rSpQt/zzB/tAW5ZZ8m3PwIKH5+3A2idxs+pJvAo28Q86tDrBKEIFF/jmdWn0MC5SXueiSG8WrkrYKwVZ9Me6+NqUu4bUU6X16cMVRQ1NHTb96gpA43HZuggK1peAp3XgLlj9OY4KvgtCrjevU7CC9ua5UFonMBFm1j4CCeXjXnAVK0TpW/0VfkZsVcaZuS3dzyY3YRigVy4UaEEYst3W/9xX3kERLn9XcLel4ULo1RNXddu35J5WIlYbkjnlNdxQqUpEpLfAgg0nyf5gkrOSH15wlgWdzd/dk8XDEK9brASrVBSR0O7hpiJ5PcVt5rRv49jr/LIp/9KCl9BRP0vUk/JawyDwwy9w+M2nvwrWZC0JPDYb+A86p3epSPw0jAB0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '697b0d99d9a52df92b20c8e053dcd46c75f364a9'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestSubvolumeGroupSnapshots', 'tasks.cephfs.test_volumes.TestSubvolumeSnapshots']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '4da97cf64e542f347ec47b7bdbe5eca99759f9b7', 'timestamp': '2022-11-23_17:24:26', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.20399'} 2022-11-27T16:33:27.381 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-11-27T16:33:27.384 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-11-27T16:33:27.430 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m0777 -- /var/run/ceph 2022-11-27T16:33:27.441 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/run/ceph 2022-11-27T16:33:27.498 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:33:27.499 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2022-11-27T16:33:27.525 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-11-27T16:33:27.526 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2022-11-27T16:33:27.583 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-11-27T16:33:27.583 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-11-27T16:33:27.583 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 362304 Links: 1 2022-11-27T16:33:27.584 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-11-27T16:33:27.584 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2022-11-27T16:33:27.584 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2022-11-27 16:33:23.066532900 +0000 2022-11-27T16:33:27.584 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2022-11-27 16:30:26.103645854 +0000 2022-11-27T16:33:27.585 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2022-11-27 16:30:26.103645854 +0000 2022-11-27T16:33:27.585 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2022-11-27T16:33:27.585 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2022-11-27T16:33:27.649 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2022-11-27T16:33:27.649 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2022-11-27T16:33:27.650 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.00019896 s, 2.6 MB/s 2022-11-27T16:33:27.651 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2022-11-27T16:33:27.710 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2022-11-27T16:33:27.767 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-11-27T16:33:27.768 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-11-27T16:33:27.768 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 367043 Links: 1 2022-11-27T16:33:27.768 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-11-27T16:33:27.768 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2022-11-27T16:33:27.769 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2022-11-27 16:33:23.066532900 +0000 2022-11-27T16:33:27.769 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2022-11-27 16:30:26.651640011 +0000 2022-11-27T16:33:27.769 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2022-11-27 16:30:26.651640011 +0000 2022-11-27T16:33:27.769 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2022-11-27T16:33:27.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2022-11-27T16:33:27.834 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2022-11-27T16:33:27.834 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2022-11-27T16:33:27.835 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000190584 s, 2.7 MB/s 2022-11-27T16:33:27.836 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2022-11-27T16:33:27.894 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2022-11-27T16:33:27.951 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-11-27T16:33:27.952 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-11-27T16:33:27.952 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 367085 Links: 1 2022-11-27T16:33:27.952 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-11-27T16:33:27.953 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2022-11-27T16:33:27.953 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2022-11-27 16:33:23.066532900 +0000 2022-11-27T16:33:27.953 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2022-11-27 16:30:27.178634391 +0000 2022-11-27T16:33:27.953 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2022-11-27 16:30:27.178634391 +0000 2022-11-27T16:33:27.953 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2022-11-27T16:33:27.954 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2022-11-27T16:33:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2022-11-27T16:33:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2022-11-27T16:33:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.00019325 s, 2.6 MB/s 2022-11-27T16:33:28.020 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2022-11-27T16:33:28.078 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2022-11-27T16:33:28.137 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-11-27T16:33:28.137 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-11-27T16:33:28.137 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 368727 Links: 1 2022-11-27T16:33:28.138 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-11-27T16:33:28.138 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2022-11-27T16:33:28.138 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2022-11-27 16:33:23.066532900 +0000 2022-11-27T16:33:28.139 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2022-11-27 16:30:27.731628494 +0000 2022-11-27T16:33:28.139 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2022-11-27 16:30:27.731628494 +0000 2022-11-27T16:33:28.139 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2022-11-27T16:33:28.140 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2022-11-27T16:33:28.203 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2022-11-27T16:33:28.203 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2022-11-27T16:33:28.203 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000213973 s, 2.4 MB/s 2022-11-27T16:33:28.205 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2022-11-27T16:33:28.263 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-11-27T16:33:28.264 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:33:28.265 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/scratch_devs of=/dev/stdout 2022-11-27T16:33:28.289 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-11-27T16:33:28.289 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_1 2022-11-27T16:33:28.350 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-11-27T16:33:28.351 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-11-27T16:33:28.351 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 359857 Links: 1 2022-11-27T16:33:28.352 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-11-27T16:33:28.352 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2022-11-27T16:33:28.352 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2022-11-27 16:33:22.206832665 +0000 2022-11-27T16:33:28.352 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2022-11-27 16:30:26.101850743 +0000 2022-11-27T16:33:28.353 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2022-11-27 16:30:26.101850743 +0000 2022-11-27T16:33:28.353 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: - 2022-11-27T16:33:28.353 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2022-11-27T16:33:28.422 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2022-11-27T16:33:28.423 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2022-11-27T16:33:28.423 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000468157 s, 1.1 MB/s 2022-11-27T16:33:28.424 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2022-11-27T16:33:28.486 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_2 2022-11-27T16:33:28.547 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-11-27T16:33:28.548 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-11-27T16:33:28.548 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 357119 Links: 1 2022-11-27T16:33:28.548 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-11-27T16:33:28.549 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2022-11-27T16:33:28.549 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2022-11-27 16:33:22.206832665 +0000 2022-11-27T16:33:28.549 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2022-11-27 16:30:26.647840146 +0000 2022-11-27T16:33:28.550 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2022-11-27 16:30:26.647840146 +0000 2022-11-27T16:33:28.550 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: - 2022-11-27T16:33:28.550 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2022-11-27T16:33:28.618 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2022-11-27T16:33:28.618 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2022-11-27T16:33:28.618 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000290783 s, 1.8 MB/s 2022-11-27T16:33:28.620 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2022-11-27T16:33:28.680 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_3 2022-11-27T16:33:28.740 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-11-27T16:33:28.740 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-11-27T16:33:28.740 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 357171 Links: 1 2022-11-27T16:33:28.741 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-11-27T16:33:28.741 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2022-11-27T16:33:28.741 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2022-11-27 16:33:22.206832665 +0000 2022-11-27T16:33:28.741 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2022-11-27 16:30:27.190829607 +0000 2022-11-27T16:33:28.742 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2022-11-27 16:30:27.190829607 +0000 2022-11-27T16:33:28.742 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: - 2022-11-27T16:33:28.742 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2022-11-27T16:33:28.809 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2022-11-27T16:33:28.809 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2022-11-27T16:33:28.810 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000344974 s, 1.5 MB/s 2022-11-27T16:33:28.811 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2022-11-27T16:33:28.870 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_4 2022-11-27T16:33:28.930 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-11-27T16:33:28.930 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-11-27T16:33:28.931 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 367138 Links: 1 2022-11-27T16:33:28.931 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-11-27T16:33:28.931 INFO:teuthology.orchestra.run.smithi055.stdout:Context: system_u:object_r:device_t:s0 2022-11-27T16:33:28.931 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2022-11-27 16:33:22.206832665 +0000 2022-11-27T16:33:28.932 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2022-11-27 16:30:27.737818991 +0000 2022-11-27T16:33:28.932 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2022-11-27 16:30:27.737818991 +0000 2022-11-27T16:33:28.932 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: - 2022-11-27T16:33:28.933 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2022-11-27T16:33:28.998 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2022-11-27T16:33:28.999 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2022-11-27T16:33:28.999 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000324573 s, 1.6 MB/s 2022-11-27T16:33:29.000 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2022-11-27T16:33:29.060 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-11-27T16:33:29.060 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-11-27T16:33:29.061 INFO:tasks.ceph:Generating config... 2022-11-27T16:33:29.062 INFO:tasks.ceph:[client] client mount timeout = 600 2022-11-27T16:33:29.063 INFO:tasks.ceph:[client] debug client = 20 2022-11-27T16:33:29.063 INFO:tasks.ceph:[client] debug ms = 1 2022-11-27T16:33:29.063 INFO:tasks.ceph:[client] pid file = 2022-11-27T16:33:29.064 INFO:tasks.ceph:[client] rados mon op timeout = 900 2022-11-27T16:33:29.064 INFO:tasks.ceph:[client] rados osd op timeout = 900 2022-11-27T16:33:29.064 INFO:tasks.ceph:[global] ms die on skipped message = False 2022-11-27T16:33:29.065 INFO:tasks.ceph:[mds] debug mds = 20 2022-11-27T16:33:29.065 INFO:tasks.ceph:[mds] debug mds balancer = 20 2022-11-27T16:33:29.065 INFO:tasks.ceph:[mds] debug ms = 1 2022-11-27T16:33:29.066 INFO:tasks.ceph:[mds] mds debug frag = True 2022-11-27T16:33:29.066 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2022-11-27T16:33:29.066 INFO:tasks.ceph:[mds] mds op complaint time = 180 2022-11-27T16:33:29.066 INFO:tasks.ceph:[mds] mds verify scatter = True 2022-11-27T16:33:29.067 INFO:tasks.ceph:[mds] osd op complaint time = 180 2022-11-27T16:33:29.067 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2022-11-27T16:33:29.067 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2022-11-27T16:33:29.068 INFO:tasks.ceph:[mgr] debug client = 20 2022-11-27T16:33:29.068 INFO:tasks.ceph:[mgr] debug finisher = 20 2022-11-27T16:33:29.068 INFO:tasks.ceph:[mgr] debug mgr = 20 2022-11-27T16:33:29.069 INFO:tasks.ceph:[mgr] debug ms = 1 2022-11-27T16:33:29.069 INFO:tasks.ceph:[mon] debug mon = 20 2022-11-27T16:33:29.069 INFO:tasks.ceph:[mon] debug ms = 1 2022-11-27T16:33:29.069 INFO:tasks.ceph:[mon] debug paxos = 20 2022-11-27T16:33:29.070 INFO:tasks.ceph:[mon] mon op complaint time = 120 2022-11-27T16:33:29.070 INFO:tasks.ceph:[osd] bdev async discard = True 2022-11-27T16:33:29.070 INFO:tasks.ceph:[osd] bdev enable discard = True 2022-11-27T16:33:29.071 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2022-11-27T16:33:29.071 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2022-11-27T16:33:29.072 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2022-11-27T16:33:29.073 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2022-11-27T16:33:29.073 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2022-11-27T16:33:29.074 INFO:tasks.ceph:[osd] debug ms = 1 2022-11-27T16:33:29.074 INFO:tasks.ceph:[osd] debug osd = 20 2022-11-27T16:33:29.075 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2022-11-27T16:33:29.075 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2022-11-27T16:33:29.076 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2022-11-27T16:33:29.076 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2022-11-27T16:33:29.077 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2022-11-27T16:33:29.077 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2022-11-27T16:33:29.078 INFO:tasks.ceph:[osd] osd op complaint time = 180 2022-11-27T16:33:29.079 INFO:tasks.ceph:Setting up mon.a... 2022-11-27T16:33:29.079 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2022-11-27T16:33:29.140 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.keyring 2022-11-27T16:33:29.144 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2022-11-27T16:33:29.194 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-11-27T16:33:29.223 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.6'), ('mon.b', '172.21.15.55'), ('mon.c', '[v2:172.21.15.55:3301,v1:172.21.15.55:6790]')] 2022-11-27T16:33:29.225 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.6,172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2022-11-27T16:33:29.227 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:33:29.228 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2022-11-27T16:33:29.282 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.6 --add b 172.21.15.55 --addv c '[v2:172.21.15.55:3301,v1:172.21.15.55:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2022-11-27T16:33:29.372 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2022-11-27T16:33:29.372 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: generated fsid 993fccdc-c4ec-45c7-83f5-38e6210b61dd 2022-11-27T16:33:29.373 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = pacific 2022-11-27T16:33:29.373 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 0 2022-11-27T16:33:29.373 INFO:teuthology.orchestra.run.smithi006.stdout:fsid 993fccdc-c4ec-45c7-83f5-38e6210b61dd 2022-11-27T16:33:29.373 INFO:teuthology.orchestra.run.smithi006.stdout:last_changed 2022-11-27T16:33:29.371560+0000 2022-11-27T16:33:29.374 INFO:teuthology.orchestra.run.smithi006.stdout:created 2022-11-27T16:33:29.371560+0000 2022-11-27T16:33:29.374 INFO:teuthology.orchestra.run.smithi006.stdout:min_mon_release 16 (pacific) 2022-11-27T16:33:29.374 INFO:teuthology.orchestra.run.smithi006.stdout:election_strategy: 1 2022-11-27T16:33:29.374 INFO:teuthology.orchestra.run.smithi006.stdout:0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.a 2022-11-27T16:33:29.375 INFO:teuthology.orchestra.run.smithi006.stdout:1: [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] mon.b 2022-11-27T16:33:29.375 INFO:teuthology.orchestra.run.smithi006.stdout:2: [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] mon.c 2022-11-27T16:33:29.376 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2022-11-27T16:33:29.377 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2022-11-27T16:33:29.394 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 993fccdc-c4ec-45c7-83f5-38e6210b61dd... 2022-11-27T16:33:29.396 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-11-27T16:33:29.436 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-11-27T16:33:29.481 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2022-11-27T16:33:29.481 INFO:teuthology.orchestra.run.smithi006.stdout: chdir = "" 2022-11-27T16:33:29.482 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-11-27T16:33:29.482 INFO:teuthology.orchestra.run.smithi006.stdout: auth supported = cephx 2022-11-27T16:33:29.482 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.483 INFO:teuthology.orchestra.run.smithi006.stdout: filestore xattr use omap = true 2022-11-27T16:33:29.483 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.484 INFO:teuthology.orchestra.run.smithi006.stdout: mon clock drift allowed = 1.000 2022-11-27T16:33:29.484 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.484 INFO:teuthology.orchestra.run.smithi006.stdout: osd crush chooseleaf type = 0 2022-11-27T16:33:29.485 INFO:teuthology.orchestra.run.smithi006.stdout: auth debug = true 2022-11-27T16:33:29.485 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.486 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on old message = true 2022-11-27T16:33:29.486 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on bug = true 2022-11-27T16:33:29.486 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.486 INFO:teuthology.orchestra.run.smithi006.stdout: mon max pg per osd = 10000 # >= luminous 2022-11-27T16:33:29.486 INFO:teuthology.orchestra.run.smithi006.stdout: mon pg warn max object skew = 0 2022-11-27T16:33:29.487 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.487 INFO:teuthology.orchestra.run.smithi006.stdout: # disable pg_autoscaler by default for new pools 2022-11-27T16:33:29.487 INFO:teuthology.orchestra.run.smithi006.stdout: osd_pool_default_pg_autoscale_mode = off 2022-11-27T16:33:29.487 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.488 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default size = 2 2022-11-27T16:33:29.488 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.488 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow primary affinity = true 2022-11-27T16:33:29.488 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd allow pg remap = true 2022-11-27T16:33:29.489 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on legacy crush tunables = false 2022-11-27T16:33:29.489 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on crush straw calc version zero = false 2022-11-27T16:33:29.489 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on no sortbitwise = false 2022-11-27T16:33:29.489 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on osd down out interval zero = false 2022-11-27T16:33:29.489 INFO:teuthology.orchestra.run.smithi006.stdout: mon warn on too few osds = false 2022-11-27T16:33:29.490 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-11-27T16:33:29.490 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_pool_no_redundancy = false 2022-11-27T16:33:29.490 INFO:teuthology.orchestra.run.smithi006.stdout: mon_allow_pool_size_one = true 2022-11-27T16:33:29.490 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.491 INFO:teuthology.orchestra.run.smithi006.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-11-27T16:33:29.491 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.491 INFO:teuthology.orchestra.run.smithi006.stdout: osd default data pool replay window = 5 2022-11-27T16:33:29.491 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.492 INFO:teuthology.orchestra.run.smithi006.stdout: mon allow pool delete = true 2022-11-27T16:33:29.492 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.492 INFO:teuthology.orchestra.run.smithi006.stdout: mon cluster log file level = debug 2022-11-27T16:33:29.492 INFO:teuthology.orchestra.run.smithi006.stdout: debug asserts on shutdown = true 2022-11-27T16:33:29.492 INFO:teuthology.orchestra.run.smithi006.stdout: mon health detail to clog = false 2022-11-27T16:33:29.493 INFO:teuthology.orchestra.run.smithi006.stdout: mon host = "172.21.15.6,172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790]" 2022-11-27T16:33:29.493 INFO:teuthology.orchestra.run.smithi006.stdout: ms die on skipped message = False 2022-11-27T16:33:29.493 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = 993fccdc-c4ec-45c7-83f5-38e6210b61dd 2022-11-27T16:33:29.493 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.494 INFO:teuthology.orchestra.run.smithi006.stdout:[osd] 2022-11-27T16:33:29.494 INFO:teuthology.orchestra.run.smithi006.stdout: osd journal size = 100 2022-11-27T16:33:29.494 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.494 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub load threshold = 5.0 2022-11-27T16:33:29.494 INFO:teuthology.orchestra.run.smithi006.stdout: osd scrub max interval = 600 2022-11-27T16:33:29.495 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.495 INFO:teuthology.orchestra.run.smithi006.stdout: osd recover clone overlap = true 2022-11-27T16:33:29.495 INFO:teuthology.orchestra.run.smithi006.stdout: osd recovery max chunk = 1048576 2022-11-27T16:33:29.496 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.496 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug shutdown = true 2022-11-27T16:33:29.496 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug op order = true 2022-11-27T16:33:29.496 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug verify stray on activate = true 2022-11-27T16:33:29.497 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.497 INFO:teuthology.orchestra.run.smithi006.stdout: osd open classes on start = true 2022-11-27T16:33:29.497 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug pg log writeout = true 2022-11-27T16:33:29.497 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.497 INFO:teuthology.orchestra.run.smithi006.stdout: osd deep scrub update digest min age = 30 2022-11-27T16:33:29.498 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.498 INFO:teuthology.orchestra.run.smithi006.stdout: osd map max advance = 10 2022-11-27T16:33:29.498 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.498 INFO:teuthology.orchestra.run.smithi006.stdout: journal zero on create = true 2022-11-27T16:33:29.499 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.499 INFO:teuthology.orchestra.run.smithi006.stdout: filestore ondisk finisher threads = 3 2022-11-27T16:33:29.499 INFO:teuthology.orchestra.run.smithi006.stdout: filestore apply finisher threads = 3 2022-11-27T16:33:29.499 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.500 INFO:teuthology.orchestra.run.smithi006.stdout: bdev debug aio = true 2022-11-27T16:33:29.500 INFO:teuthology.orchestra.run.smithi006.stdout: osd debug misdirected ops = true 2022-11-27T16:33:29.500 INFO:teuthology.orchestra.run.smithi006.stdout: bdev async discard = True 2022-11-27T16:33:29.500 INFO:teuthology.orchestra.run.smithi006.stdout: bdev enable discard = True 2022-11-27T16:33:29.500 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore allocator = bitmap 2022-11-27T16:33:29.501 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore block size = 96636764160 2022-11-27T16:33:29.501 INFO:teuthology.orchestra.run.smithi006.stdout: bluestore fsck on mount = True 2022-11-27T16:33:29.501 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluefs = 1/20 2022-11-27T16:33:29.501 INFO:teuthology.orchestra.run.smithi006.stdout: debug bluestore = 1/20 2022-11-27T16:33:29.501 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2022-11-27T16:33:29.502 INFO:teuthology.orchestra.run.smithi006.stdout: debug osd = 20 2022-11-27T16:33:29.502 INFO:teuthology.orchestra.run.smithi006.stdout: debug rocksdb = 4/10 2022-11-27T16:33:29.502 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd backfillfull_ratio = 0.85 2022-11-27T16:33:29.502 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd full ratio = 0.9 2022-11-27T16:33:29.503 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd nearfull ratio = 0.8 2022-11-27T16:33:29.503 INFO:teuthology.orchestra.run.smithi006.stdout: osd failsafe full ratio = 0.95 2022-11-27T16:33:29.503 INFO:teuthology.orchestra.run.smithi006.stdout: osd objectstore = bluestore 2022-11-27T16:33:29.503 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2022-11-27T16:33:29.504 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.504 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr] 2022-11-27T16:33:29.504 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2022-11-27T16:33:29.504 INFO:teuthology.orchestra.run.smithi006.stdout: debug mgr = 20 2022-11-27T16:33:29.504 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2022-11-27T16:33:29.505 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2022-11-27T16:33:29.505 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2022-11-27T16:33:29.505 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2022-11-27T16:33:29.505 INFO:teuthology.orchestra.run.smithi006.stdout: mgr/telemetry/nag = false 2022-11-27T16:33:29.505 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2022-11-27T16:33:29.506 INFO:teuthology.orchestra.run.smithi006.stdout: debug finisher = 20 2022-11-27T16:33:29.506 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.506 INFO:teuthology.orchestra.run.smithi006.stdout:[mon] 2022-11-27T16:33:29.506 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2022-11-27T16:33:29.507 INFO:teuthology.orchestra.run.smithi006.stdout: debug mon = 20 2022-11-27T16:33:29.507 INFO:teuthology.orchestra.run.smithi006.stdout: debug paxos = 20 2022-11-27T16:33:29.507 INFO:teuthology.orchestra.run.smithi006.stdout: debug auth = 20 2022-11-27T16:33:29.507 INFO:teuthology.orchestra.run.smithi006.stdout: mon data avail warn = 5 2022-11-27T16:33:29.508 INFO:teuthology.orchestra.run.smithi006.stdout: mon mgr mkfs grace = 240 2022-11-27T16:33:29.508 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min pgs per osd = 4 2022-11-27T16:33:29.508 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd reporter subtree level = osd 2022-11-27T16:33:29.508 INFO:teuthology.orchestra.run.smithi006.stdout: mon osd prime pg temp = true 2022-11-27T16:33:29.508 INFO:teuthology.orchestra.run.smithi006.stdout: mon reweight min bytes per osd = 10 2022-11-27T16:33:29.509 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.509 INFO:teuthology.orchestra.run.smithi006.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-11-27T16:33:29.509 INFO:teuthology.orchestra.run.smithi006.stdout: auth mon ticket ttl = 660 # 11m 2022-11-27T16:33:29.509 INFO:teuthology.orchestra.run.smithi006.stdout: auth service ticket ttl = 240 # 4m 2022-11-27T16:33:29.510 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.510 INFO:teuthology.orchestra.run.smithi006.stdout: # don't complain about insecure global_id in the test suite 2022-11-27T16:33:29.510 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-11-27T16:33:29.510 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-11-27T16:33:29.511 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.511 INFO:teuthology.orchestra.run.smithi006.stdout: # 1m isn't quite enough 2022-11-27T16:33:29.511 INFO:teuthology.orchestra.run.smithi006.stdout: mon_down_mkfs_grace = 2m 2022-11-27T16:33:29.511 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.512 INFO:teuthology.orchestra.run.smithi006.stdout: mon_warn_on_filestore_osds = false 2022-11-27T16:33:29.512 INFO:teuthology.orchestra.run.smithi006.stdout: mon op complaint time = 120 2022-11-27T16:33:29.512 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:33:29.512 INFO:teuthology.orchestra.run.smithi006.stdout:[client] 2022-11-27T16:33:29.513 INFO:teuthology.orchestra.run.smithi006.stdout: rgw cache enabled = true 2022-11-27T16:33:29.513 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable ops log = true 2022-11-27T16:33:29.513 INFO:teuthology.orchestra.run.smithi006.stdout: rgw enable usage log = true 2022-11-27T16:33:29.513 INFO:teuthology.orchestra.run.smithi006.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-11-27T16:33:29.513 INFO:teuthology.orchestra.run.smithi006.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-11-27T16:33:29.514 INFO:teuthology.orchestra.run.smithi006.stdout: client mount timeout = 600 2022-11-27T16:33:29.514 INFO:teuthology.orchestra.run.smithi006.stdout: debug client = 20 2022-11-27T16:33:29.514 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2022-11-27T16:33:29.514 INFO:teuthology.orchestra.run.smithi006.stdout: pid file = "" 2022-11-27T16:33:29.515 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2022-11-27T16:33:29.515 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2022-11-27T16:33:29.515 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.a] 2022-11-27T16:33:29.515 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.b] 2022-11-27T16:33:29.516 INFO:teuthology.orchestra.run.smithi006.stdout:[mon.c] 2022-11-27T16:33:29.516 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2022-11-27T16:33:29.516 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2022-11-27T16:33:29.516 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2022-11-27T16:33:29.516 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2022-11-27T16:33:29.517 INFO:teuthology.orchestra.run.smithi006.stdout:[mds] 2022-11-27T16:33:29.517 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds = 20 2022-11-27T16:33:29.517 INFO:teuthology.orchestra.run.smithi006.stdout: debug mds balancer = 20 2022-11-27T16:33:29.517 INFO:teuthology.orchestra.run.smithi006.stdout: debug ms = 1 2022-11-27T16:33:29.518 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug frag = True 2022-11-27T16:33:29.518 INFO:teuthology.orchestra.run.smithi006.stdout: mds debug scatterstat = True 2022-11-27T16:33:29.518 INFO:teuthology.orchestra.run.smithi006.stdout: mds op complaint time = 180 2022-11-27T16:33:29.518 INFO:teuthology.orchestra.run.smithi006.stdout: mds verify scatter = True 2022-11-27T16:33:29.519 INFO:teuthology.orchestra.run.smithi006.stdout: osd op complaint time = 180 2022-11-27T16:33:29.519 INFO:teuthology.orchestra.run.smithi006.stdout: rados mon op timeout = 900 2022-11-27T16:33:29.519 INFO:teuthology.orchestra.run.smithi006.stdout: rados osd op timeout = 900 2022-11-27T16:33:29.521 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2022-11-27T16:33:29.521 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2022-11-27T16:33:29.522 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-11-27T16:33:29.522 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2022-11-27T16:33:29.522 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.522 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2022-11-27T16:33:29.523 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.523 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2022-11-27T16:33:29.523 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.523 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2022-11-27T16:33:29.524 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2022-11-27T16:33:29.524 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.524 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2022-11-27T16:33:29.524 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2022-11-27T16:33:29.524 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.525 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2022-11-27T16:33:29.525 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2022-11-27T16:33:29.525 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.525 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2022-11-27T16:33:29.526 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2022-11-27T16:33:29.526 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.526 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2022-11-27T16:33:29.526 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.526 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2022-11-27T16:33:29.527 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2022-11-27T16:33:29.527 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2022-11-27T16:33:29.527 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2022-11-27T16:33:29.528 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2022-11-27T16:33:29.528 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2022-11-27T16:33:29.528 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2022-11-27T16:33:29.528 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-11-27T16:33:29.529 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2022-11-27T16:33:29.529 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2022-11-27T16:33:29.529 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.529 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-11-27T16:33:29.529 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.530 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2022-11-27T16:33:29.530 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.530 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2022-11-27T16:33:29.530 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.530 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2022-11-27T16:33:29.531 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2022-11-27T16:33:29.531 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2022-11-27T16:33:29.531 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.6,172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790]" 2022-11-27T16:33:29.532 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on skipped message = False 2022-11-27T16:33:29.532 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = 993fccdc-c4ec-45c7-83f5-38e6210b61dd 2022-11-27T16:33:29.532 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.532 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2022-11-27T16:33:29.533 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2022-11-27T16:33:29.533 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.533 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2022-11-27T16:33:29.533 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2022-11-27T16:33:29.533 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.534 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2022-11-27T16:33:29.534 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2022-11-27T16:33:29.534 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.534 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2022-11-27T16:33:29.535 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2022-11-27T16:33:29.535 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2022-11-27T16:33:29.535 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.535 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2022-11-27T16:33:29.536 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2022-11-27T16:33:29.536 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.536 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2022-11-27T16:33:29.536 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.536 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2022-11-27T16:33:29.537 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.537 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2022-11-27T16:33:29.537 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.537 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2022-11-27T16:33:29.537 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2022-11-27T16:33:29.538 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.538 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2022-11-27T16:33:29.538 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2022-11-27T16:33:29.538 INFO:teuthology.orchestra.run.smithi055.stdout: bdev async discard = True 2022-11-27T16:33:29.539 INFO:teuthology.orchestra.run.smithi055.stdout: bdev enable discard = True 2022-11-27T16:33:29.539 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore allocator = bitmap 2022-11-27T16:33:29.539 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2022-11-27T16:33:29.539 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2022-11-27T16:33:29.540 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 1/20 2022-11-27T16:33:29.540 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 1/20 2022-11-27T16:33:29.540 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2022-11-27T16:33:29.540 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2022-11-27T16:33:29.540 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 4/10 2022-11-27T16:33:29.541 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2022-11-27T16:33:29.541 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2022-11-27T16:33:29.541 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2022-11-27T16:33:29.541 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2022-11-27T16:33:29.541 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2022-11-27T16:33:29.542 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2022-11-27T16:33:29.542 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.542 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2022-11-27T16:33:29.542 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2022-11-27T16:33:29.543 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2022-11-27T16:33:29.543 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2022-11-27T16:33:29.543 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2022-11-27T16:33:29.543 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2022-11-27T16:33:29.543 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2022-11-27T16:33:29.544 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2022-11-27T16:33:29.544 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2022-11-27T16:33:29.544 INFO:teuthology.orchestra.run.smithi055.stdout: debug finisher = 20 2022-11-27T16:33:29.545 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.545 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2022-11-27T16:33:29.546 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2022-11-27T16:33:29.546 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2022-11-27T16:33:29.546 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2022-11-27T16:33:29.547 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2022-11-27T16:33:29.547 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2022-11-27T16:33:29.548 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2022-11-27T16:33:29.548 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2022-11-27T16:33:29.549 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2022-11-27T16:33:29.549 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2022-11-27T16:33:29.549 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2022-11-27T16:33:29.550 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.550 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-11-27T16:33:29.550 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2022-11-27T16:33:29.551 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2022-11-27T16:33:29.551 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.551 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2022-11-27T16:33:29.552 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-11-27T16:33:29.552 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-11-27T16:33:29.552 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.552 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2022-11-27T16:33:29.553 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2022-11-27T16:33:29.553 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.553 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2022-11-27T16:33:29.553 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2022-11-27T16:33:29.553 INFO:teuthology.orchestra.run.smithi055.stdout: 2022-11-27T16:33:29.554 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2022-11-27T16:33:29.554 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2022-11-27T16:33:29.554 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2022-11-27T16:33:29.554 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2022-11-27T16:33:29.555 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-11-27T16:33:29.555 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-11-27T16:33:29.555 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2022-11-27T16:33:29.555 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2022-11-27T16:33:29.556 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2022-11-27T16:33:29.556 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2022-11-27T16:33:29.556 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2022-11-27T16:33:29.556 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2022-11-27T16:33:29.556 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2022-11-27T16:33:29.557 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2022-11-27T16:33:29.557 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2022-11-27T16:33:29.557 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2022-11-27T16:33:29.557 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2022-11-27T16:33:29.557 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2022-11-27T16:33:29.558 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2022-11-27T16:33:29.558 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2022-11-27T16:33:29.558 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2022-11-27T16:33:29.558 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2022-11-27T16:33:29.559 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2022-11-27T16:33:29.559 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2022-11-27T16:33:29.559 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = True 2022-11-27T16:33:29.559 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2022-11-27T16:33:29.559 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = True 2022-11-27T16:33:29.560 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2022-11-27T16:33:29.560 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2022-11-27T16:33:29.560 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2022-11-27T16:33:29.560 INFO:tasks.ceph:Creating admin key on mon.a... 2022-11-27T16:33:29.561 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2022-11-27T16:33:29.618 INFO:tasks.ceph:Copying monmap to all nodes... 2022-11-27T16:33:29.619 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:33:29.619 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2022-11-27T16:33:29.637 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:33:29.637 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2022-11-27T16:33:29.694 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi006.front.sepia.ceph.com 2022-11-27T16:33:29.695 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:33:29.695 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.keyring 2022-11-27T16:33:29.696 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-11-27T16:33:29.774 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:33:29.774 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-11-27T16:33:29.831 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi055.front.sepia.ceph.com 2022-11-27T16:33:29.831 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:33:29.832 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.keyring 2022-11-27T16:33:29.832 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-11-27T16:33:29.879 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:33:29.879 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-11-27T16:33:29.939 INFO:tasks.ceph:Setting up mon nodes... 2022-11-27T16:33:29.940 INFO:tasks.ceph:Setting up mgr nodes... 2022-11-27T16:33:29.940 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2022-11-27T16:33:29.996 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2022-11-27T16:33:29.998 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2022-11-27T16:33:30.078 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2022-11-27T16:33:30.081 INFO:tasks.ceph:Setting up mds nodes... 2022-11-27T16:33:30.082 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2022-11-27T16:33:30.137 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2022-11-27T16:33:30.139 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2022-11-27T16:33:30.167 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2022-11-27T16:33:30.262 INFO:teuthology.orchestra.run.smithi006.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2022-11-27T16:33:30.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2022-11-27T16:33:30.292 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2022-11-27T16:33:30.353 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2022-11-27T16:33:30.355 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2022-11-27T16:33:30.385 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2022-11-27T16:33:30.481 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2022-11-27T16:33:30.483 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2022-11-27T16:33:30.511 INFO:tasks.ceph_client:Setting up client nodes... 2022-11-27T16:33:30.511 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-11-27T16:33:30.557 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.0.keyring 2022-11-27T16:33:30.570 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2022-11-27T16:33:30.615 INFO:teuthology.orchestra.run.smithi006.stdout:creating /etc/ceph/ceph.client.2.keyring 2022-11-27T16:33:30.628 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2022-11-27T16:33:30.673 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.1.keyring 2022-11-27T16:33:30.687 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2022-11-27T16:33:30.731 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.3.keyring 2022-11-27T16:33:30.745 INFO:tasks.ceph:Running mkfs on osd nodes... 2022-11-27T16:33:30.745 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi006.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-11-27T16:33:30.746 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2022-11-27T16:33:30.774 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-11-27T16:33:30.775 INFO:tasks.ceph:role: osd.0 2022-11-27T16:33:30.775 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com 2022-11-27T16:33:30.775 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-11-27T16:33:30.850 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-11-27T16:33:30.850 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2022-11-27T16:33:30.851 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-11-27T16:33:30.851 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-11-27T16:33:30.851 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-11-27T16:33:30.852 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2022-11-27T16:33:30.852 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-11-27T16:33:30.852 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-11-27T16:33:30.852 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-11-27T16:33:30.852 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-11-27T16:33:31.279 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2022-11-27T16:33:31.281 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2022-11-27T16:33:31.282 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2022-11-27T16:33:31.457 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2022-11-27T16:33:31.495 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2022-11-27T16:33:31.564 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-11-27T16:33:31.565 INFO:tasks.ceph:role: osd.1 2022-11-27T16:33:31.565 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com 2022-11-27T16:33:31.566 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-11-27T16:33:31.639 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-11-27T16:33:31.640 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2022-11-27T16:33:31.640 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-11-27T16:33:31.640 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-11-27T16:33:31.640 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-11-27T16:33:31.641 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2022-11-27T16:33:31.641 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-11-27T16:33:31.641 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-11-27T16:33:31.641 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-11-27T16:33:31.642 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-11-27T16:33:32.051 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2022-11-27T16:33:32.053 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2022-11-27T16:33:32.053 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2022-11-27T16:33:32.162 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2022-11-27T16:33:32.195 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2022-11-27T16:33:32.263 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-11-27T16:33:32.264 INFO:tasks.ceph:role: osd.2 2022-11-27T16:33:32.264 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com 2022-11-27T16:33:32.265 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-11-27T16:33:32.340 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-11-27T16:33:32.341 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2022-11-27T16:33:32.341 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-11-27T16:33:32.342 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-11-27T16:33:32.342 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-11-27T16:33:32.343 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2022-11-27T16:33:32.343 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-11-27T16:33:32.344 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-11-27T16:33:32.344 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-11-27T16:33:32.345 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-11-27T16:33:32.790 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2022-11-27T16:33:32.792 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2022-11-27T16:33:32.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2022-11-27T16:33:32.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2022-11-27T16:33:32.992 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2022-11-27T16:33:33.061 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-11-27T16:33:33.061 INFO:tasks.ceph:role: osd.3 2022-11-27T16:33:33.062 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com 2022-11-27T16:33:33.062 DEBUG:teuthology.orchestra.run.smithi006:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-11-27T16:33:33.137 INFO:teuthology.orchestra.run.smithi006.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-11-27T16:33:33.137 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 attr=2, projid32bit=1 2022-11-27T16:33:33.138 INFO:teuthology.orchestra.run.smithi006.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-11-27T16:33:33.138 INFO:teuthology.orchestra.run.smithi006.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-11-27T16:33:33.139 INFO:teuthology.orchestra.run.smithi006.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-11-27T16:33:33.139 INFO:teuthology.orchestra.run.smithi006.stdout: = sunit=0 swidth=0 blks 2022-11-27T16:33:33.139 INFO:teuthology.orchestra.run.smithi006.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-11-27T16:33:33.139 INFO:teuthology.orchestra.run.smithi006.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-11-27T16:33:33.140 INFO:teuthology.orchestra.run.smithi006.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-11-27T16:33:33.140 INFO:teuthology.orchestra.run.smithi006.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-11-27T16:33:33.566 INFO:teuthology.orchestra.run.smithi006.stdout:Discarding blocks...Done. 2022-11-27T16:33:33.568 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi006.front.sepia.ceph.com -o noatime 2022-11-27T16:33:33.569 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2022-11-27T16:33:33.733 DEBUG:teuthology.orchestra.run.smithi006:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2022-11-27T16:33:33.770 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-11-27T16:33:33.863 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:33.861+0000 7f90cbaaa5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2022-11-27T16:33:33.863 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:33.861+0000 7f90cbaaa5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2022-11-27T16:33:33.864 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:33.861+0000 7f90cbaaa5c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-11-27T16:33:33.864 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:33.861+0000 7f90cbaaa5c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-11-27T16:33:33.864 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:33.861+0000 7f90cbaaa5c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-11-27T16:33:33.864 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:33.862+0000 7f90cbaaa5c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2022-11-27T16:33:36.729 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-11-27T16:33:36.765 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-11-27T16:33:36.859 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:36.857+0000 7f448f7b95c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2022-11-27T16:33:36.860 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:36.858+0000 7f448f7b95c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2022-11-27T16:33:36.860 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:36.858+0000 7f448f7b95c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-11-27T16:33:36.860 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:36.858+0000 7f448f7b95c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-11-27T16:33:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:36.858+0000 7f448f7b95c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-11-27T16:33:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:36.858+0000 7f448f7b95c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2022-11-27T16:33:39.723 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-11-27T16:33:39.756 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-11-27T16:33:39.849 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:39.847+0000 7f4b763285c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2022-11-27T16:33:39.850 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:39.847+0000 7f4b763285c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2022-11-27T16:33:39.850 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:39.848+0000 7f4b763285c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-11-27T16:33:39.850 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:39.848+0000 7f4b763285c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-11-27T16:33:39.851 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:39.848+0000 7f4b763285c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-11-27T16:33:39.851 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:39.848+0000 7f4b763285c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2022-11-27T16:33:42.723 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-11-27T16:33:42.757 DEBUG:teuthology.orchestra.run.smithi006:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-11-27T16:33:42.854 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:42.851+0000 7f2104bea5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2022-11-27T16:33:42.854 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:42.852+0000 7f2104bea5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2022-11-27T16:33:42.854 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:42.852+0000 7f2104bea5c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-11-27T16:33:42.855 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:42.852+0000 7f2104bea5c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-11-27T16:33:42.855 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:42.852+0000 7f2104bea5c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-11-27T16:33:42.855 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:33:42.852+0000 7f2104bea5c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2022-11-27T16:33:45.736 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-11-27T16:33:45.770 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2022-11-27T16:33:45.806 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-11-27T16:33:45.807 INFO:tasks.ceph:role: osd.4 2022-11-27T16:33:45.808 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com 2022-11-27T16:33:45.809 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-11-27T16:33:45.908 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-11-27T16:33:45.908 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2022-11-27T16:33:45.908 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-11-27T16:33:45.909 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-11-27T16:33:45.909 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-11-27T16:33:45.909 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2022-11-27T16:33:45.910 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-11-27T16:33:45.910 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-11-27T16:33:45.910 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-11-27T16:33:45.910 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-11-27T16:33:47.199 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2022-11-27T16:33:47.201 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2022-11-27T16:33:47.202 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2022-11-27T16:33:47.251 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2022-11-27T16:33:47.287 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2022-11-27T16:33:47.356 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-11-27T16:33:47.357 INFO:tasks.ceph:role: osd.5 2022-11-27T16:33:47.357 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com 2022-11-27T16:33:47.358 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-11-27T16:33:47.453 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-11-27T16:33:47.454 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2022-11-27T16:33:47.454 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-11-27T16:33:47.454 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-11-27T16:33:47.455 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-11-27T16:33:47.455 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2022-11-27T16:33:47.455 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-11-27T16:33:47.456 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-11-27T16:33:47.456 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-11-27T16:33:47.456 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-11-27T16:33:48.730 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2022-11-27T16:33:48.733 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2022-11-27T16:33:48.733 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2022-11-27T16:33:48.782 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2022-11-27T16:33:48.818 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2022-11-27T16:33:48.887 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-11-27T16:33:48.888 INFO:tasks.ceph:role: osd.6 2022-11-27T16:33:48.888 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com 2022-11-27T16:33:48.889 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-11-27T16:33:48.984 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-11-27T16:33:48.985 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2022-11-27T16:33:48.985 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-11-27T16:33:48.985 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-11-27T16:33:48.986 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-11-27T16:33:48.986 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2022-11-27T16:33:48.986 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-11-27T16:33:48.986 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-11-27T16:33:48.986 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-11-27T16:33:48.987 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-11-27T16:33:50.267 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2022-11-27T16:33:50.270 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2022-11-27T16:33:50.270 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2022-11-27T16:33:50.323 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2022-11-27T16:33:50.358 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2022-11-27T16:33:50.429 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-11-27T16:33:50.429 INFO:tasks.ceph:role: osd.7 2022-11-27T16:33:50.429 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com 2022-11-27T16:33:50.430 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-11-27T16:33:50.525 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-11-27T16:33:50.526 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2022-11-27T16:33:50.526 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-11-27T16:33:50.527 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-11-27T16:33:50.527 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-11-27T16:33:50.527 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2022-11-27T16:33:50.527 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-11-27T16:33:50.528 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-11-27T16:33:50.528 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-11-27T16:33:50.528 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-11-27T16:33:51.803 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2022-11-27T16:33:51.805 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2022-11-27T16:33:51.806 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2022-11-27T16:33:51.856 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2022-11-27T16:33:51.891 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-11-27T16:33:51.982 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:33:51.980+0000 7f94619ed5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2022-11-27T16:33:51.983 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:33:51.980+0000 7f94619ed5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2022-11-27T16:33:51.983 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:33:51.980+0000 7f94619ed5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-11-27T16:33:51.983 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:33:51.980+0000 7f94619ed5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-11-27T16:33:51.983 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:33:51.980+0000 7f94619ed5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-11-27T16:33:51.984 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:33:51.981+0000 7f94619ed5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2022-11-27T16:33:54.877 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-11-27T16:33:54.910 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-11-27T16:33:55.004 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:33:55.001+0000 7f917ceee5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2022-11-27T16:33:55.004 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:33:55.001+0000 7f917ceee5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2022-11-27T16:33:55.004 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:33:55.002+0000 7f917ceee5c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-11-27T16:33:55.005 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:33:55.002+0000 7f917ceee5c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-11-27T16:33:55.005 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:33:55.002+0000 7f917ceee5c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-11-27T16:33:55.005 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:33:55.002+0000 7f917ceee5c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2022-11-27T16:33:57.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-11-27T16:33:57.387 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-11-27T16:33:57.891 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-11-27T16:33:57.924 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-11-27T16:33:58.020 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:33:58.017+0000 7f9c98e365c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2022-11-27T16:33:58.020 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:33:58.018+0000 7f9c98e365c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2022-11-27T16:33:58.020 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:33:58.018+0000 7f9c98e365c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-11-27T16:33:58.021 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:33:58.018+0000 7f9c98e365c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-11-27T16:33:58.021 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:33:58.018+0000 7f9c98e365c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-11-27T16:33:58.021 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:33:58.019+0000 7f9c98e365c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2022-11-27T16:34:00.901 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2022-11-27T16:34:00.934 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-11-27T16:34:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:01.027+0000 7f16163615c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2022-11-27T16:34:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:01.027+0000 7f16163615c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2022-11-27T16:34:01.029 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:01.027+0000 7f16163615c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-11-27T16:34:01.030 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:01.028+0000 7f16163615c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-11-27T16:34:01.030 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:01.028+0000 7f16163615c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-11-27T16:34:01.030 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:01.028+0000 7f16163615c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2022-11-27T16:34:03.910 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2022-11-27T16:34:03.944 INFO:tasks.ceph:Reading keys from all nodes... 2022-11-27T16:34:03.944 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:34:03.945 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2022-11-27T16:34:03.979 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:34:03.979 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2022-11-27T16:34:04.050 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:34:04.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2022-11-27T16:34:04.120 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:34:04.120 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2022-11-27T16:34:04.189 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:34:04.190 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2022-11-27T16:34:04.259 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:34:04.259 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2022-11-27T16:34:04.328 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:34:04.328 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2022-11-27T16:34:04.396 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:34:04.397 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2022-11-27T16:34:04.430 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:34:04.430 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2022-11-27T16:34:04.503 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:34:04.503 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2022-11-27T16:34:04.574 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:34:04.575 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2022-11-27T16:34:04.646 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:34:04.647 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2022-11-27T16:34:04.717 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:34:04.718 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2022-11-27T16:34:04.788 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:34:04.788 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2022-11-27T16:34:04.858 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:34:04.858 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2022-11-27T16:34:04.880 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:34:04.880 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2022-11-27T16:34:04.939 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:34:04.940 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2022-11-27T16:34:04.959 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:34:04.959 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2022-11-27T16:34:05.017 INFO:tasks.ceph:Adding keys to all mons... 2022-11-27T16:34:05.018 DEBUG:teuthology.orchestra.run.smithi006:> sudo tee -a /etc/ceph/ceph.keyring 2022-11-27T16:34:05.020 DEBUG:teuthology.orchestra.run.smithi055:> sudo tee -a /etc/ceph/ceph.keyring 2022-11-27T16:34:05.061 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.y] 2022-11-27T16:34:05.061 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBZkYNj77VXOxAAsRp//9pOW/JezMgnMhno4w== 2022-11-27T16:34:05.062 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a] 2022-11-27T16:34:05.062 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBakYNjeAAkCBAAKj5QScZGWs+UghwYhga1tQ== 2022-11-27T16:34:05.062 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c] 2022-11-27T16:34:05.062 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBakYNjLKCgDxAAyaqW+LL/SPpq5o33MtYiAA== 2022-11-27T16:34:05.062 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.0] 2022-11-27T16:34:05.063 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBdkYNjfI9gMxAABFPFKznCPosL2jhPfSgeXA== 2022-11-27T16:34:05.063 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.1] 2022-11-27T16:34:05.063 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBgkYNjmDsrMxAAVsKne+zZ8TSmt+4FYFq8Dg== 2022-11-27T16:34:05.063 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.2] 2022-11-27T16:34:05.064 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBjkYNjNFuQMhAAxVnDCNjxw/wWM9TaNvTPYQ== 2022-11-27T16:34:05.064 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.3] 2022-11-27T16:34:05.064 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBmkYNjKh/RMhAAw4e6xzFQX+4tKZizrDcdWg== 2022-11-27T16:34:05.064 INFO:teuthology.orchestra.run.smithi006.stdout:[mgr.x] 2022-11-27T16:34:05.065 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBakYNjLz+kBBAAndKuUVLcrFu4g4ulqoLQLA== 2022-11-27T16:34:05.065 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b] 2022-11-27T16:34:05.065 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBakYNjy94CFRAASgDhC5/my6m2yXc8zDYAOg== 2022-11-27T16:34:05.065 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d] 2022-11-27T16:34:05.066 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBakYNj00ilHBAAU6QncELCduRGsy5Si3oy0Q== 2022-11-27T16:34:05.066 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.4] 2022-11-27T16:34:05.066 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBvkYNjovKCOhAAhwwFq8JNr85WOOzSc9UCHg== 2022-11-27T16:34:05.066 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.5] 2022-11-27T16:34:05.066 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBzkYNj6DQqABAAXsamKqUrF2vsmbAfU98Z/g== 2022-11-27T16:34:05.067 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.6] 2022-11-27T16:34:05.067 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB2kYNj2XghARAAAeDcuo3qbHzAzoZ2uiI/3A== 2022-11-27T16:34:05.067 INFO:teuthology.orchestra.run.smithi006.stdout:[osd.7] 2022-11-27T16:34:05.067 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQB5kYNjb7OnARAA2F+R7HQYqdj1SrJ40QCUTw== 2022-11-27T16:34:05.068 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2022-11-27T16:34:05.068 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBakYNjOMEsIRAA65PPfT7PHVXqOZsZedAxUQ== 2022-11-27T16:34:05.068 INFO:teuthology.orchestra.run.smithi006.stdout:[client.2] 2022-11-27T16:34:05.068 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBakYNjRAyjJBAAKeo/Xf9qnraLQmIHyyF+Cw== 2022-11-27T16:34:05.068 INFO:teuthology.orchestra.run.smithi006.stdout:[client.1] 2022-11-27T16:34:05.069 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBakYNjWt4ZKBAAMh1OPXZsQs38zSnVYPe7/Q== 2022-11-27T16:34:05.069 INFO:teuthology.orchestra.run.smithi006.stdout:[client.3] 2022-11-27T16:34:05.069 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQBakYNjnSeUKxAAP7iCZKpsrB4rfpuzIWan6w== 2022-11-27T16:34:05.085 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.y] 2022-11-27T16:34:05.085 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBZkYNj77VXOxAAsRp//9pOW/JezMgnMhno4w== 2022-11-27T16:34:05.086 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2022-11-27T16:34:05.086 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBakYNjeAAkCBAAKj5QScZGWs+UghwYhga1tQ== 2022-11-27T16:34:05.086 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2022-11-27T16:34:05.086 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBakYNjLKCgDxAAyaqW+LL/SPpq5o33MtYiAA== 2022-11-27T16:34:05.087 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.0] 2022-11-27T16:34:05.087 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBdkYNjfI9gMxAABFPFKznCPosL2jhPfSgeXA== 2022-11-27T16:34:05.087 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.1] 2022-11-27T16:34:05.088 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBgkYNjmDsrMxAAVsKne+zZ8TSmt+4FYFq8Dg== 2022-11-27T16:34:05.088 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.2] 2022-11-27T16:34:05.088 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBjkYNjNFuQMhAAxVnDCNjxw/wWM9TaNvTPYQ== 2022-11-27T16:34:05.088 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.3] 2022-11-27T16:34:05.089 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBmkYNjKh/RMhAAw4e6xzFQX+4tKZizrDcdWg== 2022-11-27T16:34:05.089 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.x] 2022-11-27T16:34:05.089 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBakYNjLz+kBBAAndKuUVLcrFu4g4ulqoLQLA== 2022-11-27T16:34:05.089 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2022-11-27T16:34:05.090 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBakYNjy94CFRAASgDhC5/my6m2yXc8zDYAOg== 2022-11-27T16:34:05.090 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2022-11-27T16:34:05.090 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBakYNj00ilHBAAU6QncELCduRGsy5Si3oy0Q== 2022-11-27T16:34:05.090 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.4] 2022-11-27T16:34:05.091 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBvkYNjovKCOhAAhwwFq8JNr85WOOzSc9UCHg== 2022-11-27T16:34:05.091 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.5] 2022-11-27T16:34:05.091 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBzkYNj6DQqABAAXsamKqUrF2vsmbAfU98Z/g== 2022-11-27T16:34:05.091 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.6] 2022-11-27T16:34:05.092 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQB2kYNj2XghARAAAeDcuo3qbHzAzoZ2uiI/3A== 2022-11-27T16:34:05.092 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.7] 2022-11-27T16:34:05.092 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQB5kYNjb7OnARAA2F+R7HQYqdj1SrJ40QCUTw== 2022-11-27T16:34:05.092 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2022-11-27T16:34:05.092 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBakYNjOMEsIRAA65PPfT7PHVXqOZsZedAxUQ== 2022-11-27T16:34:05.093 INFO:teuthology.orchestra.run.smithi055.stdout:[client.2] 2022-11-27T16:34:05.093 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBakYNjRAyjJBAAKeo/Xf9qnraLQmIHyyF+Cw== 2022-11-27T16:34:05.093 INFO:teuthology.orchestra.run.smithi055.stdout:[client.1] 2022-11-27T16:34:05.093 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBakYNjWt4ZKBAAMh1OPXZsQs38zSnVYPe7/Q== 2022-11-27T16:34:05.094 INFO:teuthology.orchestra.run.smithi055.stdout:[client.3] 2022-11-27T16:34:05.094 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQBakYNjnSeUKxAAP7iCZKpsrB4rfpuzIWan6w== 2022-11-27T16:34:05.095 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-11-27T16:34:05.114 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-11-27T16:34:05.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-11-27T16:34:05.198 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-11-27T16:34:05.258 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-11-27T16:34:05.260 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-11-27T16:34:05.317 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-11-27T16:34:05.320 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-11-27T16:34:05.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-11-27T16:34:05.378 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-11-27T16:34:05.432 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-11-27T16:34:05.434 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-11-27T16:34:05.490 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-11-27T16:34:05.494 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-11-27T16:34:05.549 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-11-27T16:34:05.552 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-11-27T16:34:05.610 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-11-27T16:34:05.612 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-11-27T16:34:05.670 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-11-27T16:34:05.673 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-11-27T16:34:05.730 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-11-27T16:34:05.733 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-11-27T16:34:05.788 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-11-27T16:34:05.791 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-11-27T16:34:05.845 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-11-27T16:34:05.848 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-11-27T16:34:05.902 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-11-27T16:34:05.905 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-11-27T16:34:05.960 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-11-27T16:34:05.963 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-11-27T16:34:06.020 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-11-27T16:34:06.023 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-11-27T16:34:06.081 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-11-27T16:34:06.085 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-11-27T16:34:06.143 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-11-27T16:34:06.146 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-11-27T16:34:06.203 INFO:tasks.ceph:Running mkfs on mon nodes... 2022-11-27T16:34:06.204 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2022-11-27T16:34:06.232 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-11-27T16:34:06.332 DEBUG:teuthology.orchestra.run.smithi006:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2022-11-27T16:34:06.360 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2022-11-27T16:34:06.389 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-11-27T16:34:06.491 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2022-11-27T16:34:06.519 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2022-11-27T16:34:06.587 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-11-27T16:34:06.692 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2022-11-27T16:34:06.721 DEBUG:teuthology.orchestra.run.smithi006:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-11-27T16:34:06.724 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-11-27T16:34:06.778 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2022-11-27T16:34:06.779 INFO:tasks.ceph.mon.a:Restarting daemon 2022-11-27T16:34:06.780 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-11-27T16:34:06.782 INFO:tasks.ceph.mon.a:Started 2022-11-27T16:34:06.782 INFO:tasks.ceph.mon.b:Restarting daemon 2022-11-27T16:34:06.783 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-11-27T16:34:06.821 INFO:tasks.ceph.mon.b:Started 2022-11-27T16:34:06.821 INFO:tasks.ceph.mon.c:Restarting daemon 2022-11-27T16:34:06.822 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-11-27T16:34:06.824 INFO:tasks.ceph.mon.c:Started 2022-11-27T16:34:06.824 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2022-11-27T16:34:06.825 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-11-27T16:34:06.825 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-11-27T16:34:06.827 INFO:tasks.ceph.mgr.y:Started 2022-11-27T16:34:06.828 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-11-27T16:34:06.828 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-11-27T16:34:06.830 INFO:tasks.ceph.mgr.x:Started 2022-11-27T16:34:06.831 INFO:tasks.ceph:Setting crush tunables to default 2022-11-27T16:34:06.831 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd crush tunables default 2022-11-27T16:34:06.958 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.957+0000 7f15cb50e700 1 Processor -- start 2022-11-27T16:34:06.959 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.957+0000 7f15cb50e700 1 -- start start 2022-11-27T16:34:06.962 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.958+0000 7f15cb50e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 0x7f15c40cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.958+0000 7f15cb50e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 0x7f15c40cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.958+0000 7f15cb50e700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c40cf530 con 0x7f15c415bac0 2022-11-27T16:34:06.964 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.958+0000 7f15cb50e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c40cd1f0 con 0x7f15c415be90 2022-11-27T16:34:06.964 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.958+0000 7f15cb50e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c406b910 con 0x7f15c40ccde0 2022-11-27T16:34:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.958+0000 7f15c8aa9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 0x7f15c40cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.958+0000 7f15c8aa9700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 0x7f15c40cc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58424/0 (socket says 172.21.15.6:58424) 2022-11-27T16:34:06.966 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.958+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 learned_addr learned my addr 172.21.15.6:0/4013475028 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:06.966 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.958+0000 7f15c9aab700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 0x7f15c40cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:06.967 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.958+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 msgr2=0x7f15c40cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-11-27T16:34:06.967 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.958+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 msgr2=0x7f15c40cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-11-27T16:34:06.968 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.958+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 0x7f15c40cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-11-27T16:34:06.968 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.958+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 0x7f15c40cc8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-11-27T16:34:06.969 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.958+0000 7f15c9aab700 1 -- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 msgr2=0x7f15c40cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-11-27T16:34:06.969 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.958+0000 7f15c9aab700 1 -- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 msgr2=0x7f15c40cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-11-27T16:34:06.970 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.958+0000 7f15c9aab700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 0x7f15c40cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-11-27T16:34:06.970 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:06.958+0000 7f15c9aab700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 0x7f15c40cfcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-11-27T16:34:07.161 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.159+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 0x7f15c40cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:07.161 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.159+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 msgr2=0x7f15c40cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-11-27T16:34:07.161 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.159+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 msgr2=0x7f15c40cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-11-27T16:34:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.159+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 0x7f15c40cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-11-27T16:34:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.159+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 0x7f15c40cc8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-11-27T16:34:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.159+0000 7f15c9aab700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 0x7f15c40cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.159+0000 7f15c9aab700 1 -- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 msgr2=0x7f15c40cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-11-27T16:34:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.159+0000 7f15c9aab700 1 -- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 msgr2=0x7f15c40cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-11-27T16:34:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.159+0000 7f15c9aab700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 0x7f15c40cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-11-27T16:34:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.159+0000 7f15c9aab700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 0x7f15c40cfcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-11-27T16:34:07.563 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.560+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 0x7f15c40cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:07.563 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.560+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 msgr2=0x7f15c40cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-11-27T16:34:07.564 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.560+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 msgr2=0x7f15c40cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-11-27T16:34:07.564 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.560+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 0x7f15c40cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-11-27T16:34:07.565 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.560+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 0x7f15c40cc8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-11-27T16:34:07.565 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.560+0000 7f15c9aab700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 0x7f15c40cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:07.565 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.560+0000 7f15c9aab700 1 -- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 msgr2=0x7f15c40cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-11-27T16:34:07.566 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.560+0000 7f15c9aab700 1 -- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 msgr2=0x7f15c40cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-11-27T16:34:07.566 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.560+0000 7f15c9aab700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 0x7f15c40cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-11-27T16:34:07.567 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:07.560+0000 7f15c9aab700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 0x7f15c40cfcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-11-27T16:34:08.363 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:08.361+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 0x7f15c40cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:08.364 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:08.361+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 msgr2=0x7f15c40cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-11-27T16:34:08.364 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:08.361+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 msgr2=0x7f15c40cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-11-27T16:34:08.364 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:08.361+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 0x7f15c40cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-11-27T16:34:08.365 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:08.361+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 0x7f15c40cc8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-11-27T16:34:08.365 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:08.361+0000 7f15c9aab700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 0x7f15c40cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:08.365 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:08.361+0000 7f15c9aab700 1 -- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 msgr2=0x7f15c40cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-11-27T16:34:08.365 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:08.361+0000 7f15c9aab700 1 -- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 msgr2=0x7f15c40cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-11-27T16:34:08.365 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:08.361+0000 7f15c9aab700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 0x7f15c40cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-11-27T16:34:08.366 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:08.361+0000 7f15c9aab700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 0x7f15c40cfcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-11-27T16:34:09.961 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:09.958+0000 7f15b2ffd700 1 -- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 msgr2=0x7f15c40cfcc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-11-27T16:34:09.961 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:09.958+0000 7f15b2ffd700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.55:3300/0 conn(0x7f15c40ccde0 0x7f15c40cfcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:09.961 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:09.958+0000 7f15b2ffd700 1 -- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 msgr2=0x7f15c40cc8a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-11-27T16:34:09.961 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:09.958+0000 7f15b2ffd700 1 --2- 172.21.15.6:0/4013475028 >> v2:172.21.15.6:3300/0 conn(0x7f15c415be90 0x7f15c40cc8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:09.962 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:09.958+0000 7f15b2ffd700 1 -- 172.21.15.6:0/4013475028 >> v1:172.21.15.6:6789/0 conn(0x7f15c415bac0 legacy=0x7f15c406a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:09.962 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:09.958+0000 7f15b2ffd700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 0x7f15a40097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:09.962 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:09.958+0000 7f15b2ffd700 1 -- 172.21.15.6:0/4013475028 --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c406bbf0 con 0x7f15a4003720 2022-11-27T16:34:09.962 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:09.958+0000 7f15b2ffd700 1 -- 172.21.15.6:0/4013475028 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c40cd1f0 con 0x7f15a4007340 2022-11-27T16:34:09.963 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:09.958+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 0x7f15a40097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:09.963 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:09.958+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 msgr2=0x7f15a40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-11-27T16:34:09.963 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:09.958+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 msgr2=0x7f15a40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-11-27T16:34:09.963 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:09.958+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 0x7f15a40097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-11-27T16:34:09.964 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:09.958+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 0x7f15a40097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-11-27T16:34:10.161 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:10.159+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 0x7f15a40097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:10.161 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:10.159+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 msgr2=0x7f15a40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-11-27T16:34:10.162 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:10.159+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 msgr2=0x7f15a40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-11-27T16:34:10.162 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:10.159+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 0x7f15a40097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-11-27T16:34:10.162 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:10.159+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 0x7f15a40097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-11-27T16:34:10.562 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:10.560+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 0x7f15a40097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:10.563 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:10.560+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 msgr2=0x7f15a40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-11-27T16:34:10.563 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:10.560+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 msgr2=0x7f15a40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-11-27T16:34:10.563 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:10.560+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 0x7f15a40097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-11-27T16:34:10.563 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:10.560+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 0x7f15a40097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-11-27T16:34:11.362 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:11.361+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 0x7f15a40097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:11.363 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:11.361+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 msgr2=0x7f15a40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-11-27T16:34:11.364 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:11.361+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 msgr2=0x7f15a40097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-11-27T16:34:11.364 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:11.361+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 0x7f15a40097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-11-27T16:34:11.364 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:11.361+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 0x7f15a40097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-11-27T16:34:12.166 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.162+0000 7f15b3fff700 1 -- 172.21.15.6:0/4013475028 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2293464720 0 0) 0x7f15c406bbf0 con 0x7f15a4003720 2022-11-27T16:34:12.167 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.162+0000 7f15b3fff700 1 -- 172.21.15.6:0/4013475028 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15ac0035b0 con 0x7f15a4003720 2022-11-27T16:34:12.167 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.162+0000 7f15b3fff700 1 -- 172.21.15.6:0/4013475028 <== mon.1 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3547116074 0 0) 0x7f15ac0035b0 con 0x7f15a4003720 2022-11-27T16:34:12.167 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.162+0000 7f15b3fff700 1 -- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 msgr2=0x7f15a40097f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-11-27T16:34:12.168 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.162+0000 7f15b3fff700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15a4007340 0x7f15a40097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:12.168 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.162+0000 7f15b3fff700 1 -- 172.21.15.6:0/4013475028 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15a400afb0 con 0x7f15a4003720 2022-11-27T16:34:12.168 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.162+0000 7f15b3fff700 1 -- 172.21.15.6:0/4013475028 <== mon.1 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3877911693 0 0) 0x7f15c00016f0 con 0x7f15a4003720 2022-11-27T16:34:12.168 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.162+0000 7f15b3fff700 1 -- 172.21.15.6:0/4013475028 >> v1:172.21.15.55:6789/0 conn(0x7f15a4003720 legacy=0x7f15a4005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:12.168 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.162+0000 7f15c9aab700 1 -- 172.21.15.6:0/4013475028 reap_dead start 2022-11-27T16:34:12.169 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.163+0000 7f15b3fff700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac003a00 0x7f15ac003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:12.169 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.163+0000 7f15b3fff700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ac004850 0x7f15ac004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:12.170 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.163+0000 7f15b3fff700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15ac005320 0x7f15ac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:12.170 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.163+0000 7f15b3fff700 1 -- 172.21.15.6:0/4013475028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c40cd1f0 con 0x7f15ac004850 2022-11-27T16:34:12.170 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.163+0000 7f15b3fff700 1 -- 172.21.15.6:0/4013475028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac00c250 con 0x7f15ac003a00 2022-11-27T16:34:12.170 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.163+0000 7f15b3fff700 1 -- 172.21.15.6:0/4013475028 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac00c410 con 0x7f15ac005320 2022-11-27T16:34:12.170 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.163+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ac004850 0x7f15ac004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:12.171 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.163+0000 7f15c92aa700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac003a00 0x7f15ac003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:12.171 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.163+0000 7f15c9aab700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15ac005320 0x7f15ac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:12.171 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.163+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15ac005320 msgr2=0x7f15ac00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:12.171 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.163+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15ac005320 0x7f15ac00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:12.172 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.163+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac003a00 msgr2=0x7f15ac003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:12.172 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.163+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac003a00 0x7f15ac003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:12.172 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.163+0000 7f15c8aa9700 1 -- 172.21.15.6:0/4013475028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac0035b0 con 0x7f15ac004850 2022-11-27T16:34:12.172 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.163+0000 7f15c92aa700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac003a00 0x7f15ac003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-11-27T16:34:12.172 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.163+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ac004850 0x7f15ac004cc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f15b4019ae0 tx=0x7f15ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc1b9026fad7d1a server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:12.173 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.164+0000 7f15b3fff700 1 -- 172.21.15.6:0/4013475028 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b401e070 con 0x7f15ac004850 2022-11-27T16:34:12.173 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.164+0000 7f15b3fff700 1 -- 172.21.15.6:0/4013475028 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b400c040 con 0x7f15ac004850 2022-11-27T16:34:12.173 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.164+0000 7f15b3fff700 1 -- 172.21.15.6:0/4013475028 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4016ae0 con 0x7f15ac004850 2022-11-27T16:34:12.173 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.164+0000 7f15cb50e700 1 -- 172.21.15.6:0/4013475028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ac004850 msgr2=0x7f15ac004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:12.174 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.164+0000 7f15cb50e700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ac004850 0x7f15ac004cc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f15b4019ae0 tx=0x7f15ac005880 comp rx=0 tx=0).stop 2022-11-27T16:34:12.174 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.164+0000 7f15cb50e700 1 -- 172.21.15.6:0/4013475028 shutdown_connections 2022-11-27T16:34:12.174 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.164+0000 7f15cb50e700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15ac005320 0x7f15ac00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:12.174 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.164+0000 7f15cb50e700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ac004850 0x7f15ac004cc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:12.175 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.164+0000 7f15cb50e700 1 --2- 172.21.15.6:0/4013475028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac003a00 0x7f15ac003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:12.175 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.164+0000 7f15cb50e700 1 -- 172.21.15.6:0/4013475028 >> 172.21.15.6:0/4013475028 conn(0x7f15c4064ec0 msgr2=0x7f15c4065290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:12.175 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.165+0000 7f15cb50e700 1 -- 172.21.15.6:0/4013475028 shutdown_connections 2022-11-27T16:34:12.175 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.165+0000 7f15cb50e700 1 -- 172.21.15.6:0/4013475028 wait complete. 2022-11-27T16:34:12.179 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.166+0000 7f15cb50e700 1 Processor -- start 2022-11-27T16:34:12.179 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.166+0000 7f15cb50e700 1 -- start start 2022-11-27T16:34:12.179 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.167+0000 7f15cb50e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15ac003a00 0x7f15c4155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:12.179 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.167+0000 7f15cb50e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac004850 0x7f15c40b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:12.180 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.167+0000 7f15cb50e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ac005320 0x7f15c40ab8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:12.180 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.167+0000 7f15cb50e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4144250 con 0x7f15ac005320 2022-11-27T16:34:12.180 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.167+0000 7f15cb50e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c41562d0 con 0x7f15ac004850 2022-11-27T16:34:12.180 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.167+0000 7f15cb50e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c40b54a0 con 0x7f15ac003a00 2022-11-27T16:34:12.181 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.167+0000 7f15c9aab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ac005320 0x7f15c40ab8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:12.181 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.167+0000 7f15c8aa9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac004850 0x7f15c40b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:12.181 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.167+0000 7f15c92aa700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15ac003a00 0x7f15c4155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:12.181 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.167+0000 7f15c8aa9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac004850 0x7f15c40b4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.6:50714/0 (socket says 172.21.15.6:50714) 2022-11-27T16:34:12.181 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.167+0000 7f15c92aa700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15ac003a00 0x7f15c4155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.6:47586/0 (socket says 172.21.15.6:47586) 2022-11-27T16:34:12.182 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.167+0000 7f15c9aab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ac005320 0x7f15c40ab8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58488/0 (socket says 172.21.15.6:58488) 2022-11-27T16:34:12.182 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.167+0000 7f15c8aa9700 1 -- 172.21.15.6:0/830741247 learned_addr learned my addr 172.21.15.6:0/830741247 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:12.182 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.168+0000 7f15c8aa9700 1 -- 172.21.15.6:0/830741247 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15ac003a00 msgr2=0x7f15c4155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:12.182 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.168+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/830741247 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15ac003a00 0x7f15c4155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:12.183 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.168+0000 7f15c8aa9700 1 -- 172.21.15.6:0/830741247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ac005320 msgr2=0x7f15c40ab8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:12.183 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.168+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/830741247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ac005320 0x7f15c40ab8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:12.183 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.168+0000 7f15c8aa9700 1 -- 172.21.15.6:0/830741247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c40b5780 con 0x7f15ac004850 2022-11-27T16:34:12.183 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.168+0000 7f15c9aab700 1 --2- 172.21.15.6:0/830741247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ac005320 0x7f15c40ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-11-27T16:34:12.184 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.168+0000 7f15c8aa9700 1 --2- 172.21.15.6:0/830741247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac004850 0x7f15c40b4ba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f15b4019450 tx=0x7f15b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:12.184 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.168+0000 7f15b1ffb700 1 -- 172.21.15.6:0/830741247 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b402c820 con 0x7f15ac004850 2022-11-27T16:34:12.184 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.168+0000 7f15b1ffb700 1 -- 172.21.15.6:0/830741247 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b402c9a0 con 0x7f15ac004850 2022-11-27T16:34:12.184 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.168+0000 7f15cb50e700 1 -- 172.21.15.6:0/830741247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c40b5a60 con 0x7f15ac004850 2022-11-27T16:34:12.184 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.168+0000 7f15b1ffb700 1 -- 172.21.15.6:0/830741247 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b402cd90 con 0x7f15ac004850 2022-11-27T16:34:12.185 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.169+0000 7f15cb50e700 1 -- 172.21.15.6:0/830741247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c40b50e0 con 0x7f15ac004850 2022-11-27T16:34:12.185 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.169+0000 7f15b1ffb700 1 -- 172.21.15.6:0/830741247 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f15b403e070 con 0x7f15ac004850 2022-11-27T16:34:12.185 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.169+0000 7f15b1ffb700 1 -- 172.21.15.6:0/830741247 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f15b4037cc0 con 0x7f15ac004850 2022-11-27T16:34:12.185 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.170+0000 7f15cb50e700 1 -- 172.21.15.6:0/830741247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c40b5270 con 0x7f15ac004850 2022-11-27T16:34:12.186 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.172+0000 7f15b1ffb700 1 -- 172.21.15.6:0/830741247 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71351 (secure 0 0 0) 0x7f15b40566d0 con 0x7f15ac004850 2022-11-27T16:34:12.253 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.251+0000 7f15cb50e700 1 -- 172.21.15.6:0/830741247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f15c4068b70 con 0x7f15ac004850 2022-11-27T16:34:12.260 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.259+0000 7f15b1ffb700 1 -- 172.21.15.6:0/830741247 <== mon.1 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f15b4045070 con 0x7f15ac004850 2022-11-27T16:34:12.262 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.260+0000 7f15cb50e700 1 -- 172.21.15.6:0/830741247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac004850 msgr2=0x7f15c40b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.260+0000 7f15cb50e700 1 --2- 172.21.15.6:0/830741247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac004850 0x7f15c40b4ba0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f15b4019450 tx=0x7f15b4004750 comp rx=0 tx=0).stop 2022-11-27T16:34:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.260+0000 7f15cb50e700 1 -- 172.21.15.6:0/830741247 shutdown_connections 2022-11-27T16:34:12.263 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.260+0000 7f15cb50e700 1 --2- 172.21.15.6:0/830741247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15ac005320 0x7f15c40ab8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:12.264 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.260+0000 7f15cb50e700 1 --2- 172.21.15.6:0/830741247 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f15ac003a00 0x7f15c4155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:12.264 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.260+0000 7f15cb50e700 1 --2- 172.21.15.6:0/830741247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15ac004850 0x7f15c40b4ba0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:12.264 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.260+0000 7f15cb50e700 1 -- 172.21.15.6:0/830741247 >> 172.21.15.6:0/830741247 conn(0x7f15c4064ec0 msgr2=0x7f15c406a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:12.264 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.260+0000 7f15cb50e700 1 -- 172.21.15.6:0/830741247 shutdown_connections 2022-11-27T16:34:12.265 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:12.260+0000 7f15cb50e700 1 -- 172.21.15.6:0/830741247 wait complete. 2022-11-27T16:34:12.265 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2022-11-27T16:34:12.274 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2022-11-27T16:34:12.274 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:34:12.275 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2022-11-27T16:34:12.292 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:12.290+0000 7f714aa7a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-11-27T16:34:12.303 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:34:12.304 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2022-11-27T16:34:12.358 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:12.357+0000 7f714aa7a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-11-27T16:34:12.372 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:34:12.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2022-11-27T16:34:12.436 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:12.434+0000 7f714aa7a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-11-27T16:34:12.440 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2022-11-27T16:34:12.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2022-11-27T16:34:12.508 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:34:12.508 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2022-11-27T16:34:12.516 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:12.515+0000 7f714aa7a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-11-27T16:34:12.536 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:34:12.536 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2022-11-27T16:34:12.604 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:34:12.604 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2022-11-27T16:34:12.665 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:12.663+0000 7f714aa7a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-11-27T16:34:12.672 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2022-11-27T16:34:12.673 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2022-11-27T16:34:12.741 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new a1c510ff-24f3-497e-823f-73d31df5e534 0 2022-11-27T16:34:12.904 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.902+0000 7f966d777700 1 Processor -- start 2022-11-27T16:34:12.905 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.902+0000 7f966d777700 1 -- start start 2022-11-27T16:34:12.914 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.903+0000 7f966d777700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96680ca0c0 0x7f96680cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:12.914 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.903+0000 7f966d777700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f966806d3f0 0x7f96680c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:12.915 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.903+0000 7f966d777700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96680ce740 con 0x7f966806fae0 2022-11-27T16:34:12.915 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.903+0000 7f966d777700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966806bf80 con 0x7f966806d3f0 2022-11-27T16:34:12.916 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.903+0000 7f966d777700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96680ce180 con 0x7f96680ca0c0 2022-11-27T16:34:12.916 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.903+0000 7f9666ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96680ca0c0 0x7f96680cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:12.916 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.903+0000 7f96677fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f966806fae0 0x7f966806c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54476/0 (socket says 172.21.15.55:54476) 2022-11-27T16:34:12.916 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.903+0000 7f9666ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96680ca0c0 0x7f96680cdaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:41812/0 (socket says 172.21.15.55:41812) 2022-11-27T16:34:12.917 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.903+0000 7f96677fe700 1 -- 172.21.15.55:0/1627277426 learned_addr learned my addr 172.21.15.55:0/1627277426 (peer_addr_for_me v1:172.21.15.55:0/0) 2022-11-27T16:34:12.917 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.903+0000 7f96667fc700 1 --2- 172.21.15.55:0/1627277426 >> v2:172.21.15.6:3300/0 conn(0x7f966806d3f0 0x7f96680c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:12.917 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.904+0000 7f9665ffb700 1 -- 172.21.15.55:0/1627277426 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706088846 0 0) 0x7f96680ce740 con 0x7f966806fae0 2022-11-27T16:34:12.917 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.904+0000 7f9666ffd700 1 -- 172.21.15.55:0/1627277426 >> v2:172.21.15.6:3300/0 conn(0x7f966806d3f0 msgr2=0x7f96680c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:12.918 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.904+0000 7f9666ffd700 1 --2- 172.21.15.55:0/1627277426 >> v2:172.21.15.6:3300/0 conn(0x7f966806d3f0 0x7f96680c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:12.918 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.904+0000 7f9666ffd700 1 -- 172.21.15.55:0/1627277426 >> v1:172.21.15.55:6789/0 conn(0x7f966806fae0 legacy=0x7f966806c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:12.918 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.904+0000 7f9666ffd700 1 -- 172.21.15.55:0/1627277426 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96680ce460 con 0x7f96680ca0c0 2022-11-27T16:34:12.918 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.904+0000 7f96667fc700 1 --2- 172.21.15.55:0/1627277426 >> v2:172.21.15.6:3300/0 conn(0x7f966806d3f0 0x7f96680c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-11-27T16:34:12.918 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.904+0000 7f9666ffd700 1 --2- 172.21.15.55:0/1627277426 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96680ca0c0 0x7f96680cdaa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9658009840 tx=0x7f9658009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26163486df4cacbe server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:12.919 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.904+0000 7f9665ffb700 1 -- 172.21.15.55:0/1627277426 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9658011830 con 0x7f96680ca0c0 2022-11-27T16:34:12.919 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.904+0000 7f9665ffb700 1 -- 172.21.15.55:0/1627277426 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9658011990 con 0x7f96680ca0c0 2022-11-27T16:34:12.919 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.904+0000 7f9665ffb700 1 -- 172.21.15.55:0/1627277426 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9658011d20 con 0x7f96680ca0c0 2022-11-27T16:34:12.919 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.905+0000 7f966d777700 1 -- 172.21.15.55:0/1627277426 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96680ca0c0 msgr2=0x7f96680cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:12.920 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.905+0000 7f966d777700 1 --2- 172.21.15.55:0/1627277426 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96680ca0c0 0x7f96680cdaa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9658009840 tx=0x7f9658009b50 comp rx=0 tx=0).stop 2022-11-27T16:34:12.920 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.905+0000 7f966d777700 1 -- 172.21.15.55:0/1627277426 shutdown_connections 2022-11-27T16:34:12.920 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.905+0000 7f966d777700 1 --2- 172.21.15.55:0/1627277426 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96680ca0c0 0x7f96680cdaa0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:12.920 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.905+0000 7f966d777700 1 --2- 172.21.15.55:0/1627277426 >> v2:172.21.15.6:3300/0 conn(0x7f966806d3f0 0x7f96680c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:12.920 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.905+0000 7f966d777700 1 -- 172.21.15.55:0/1627277426 >> 172.21.15.55:0/1627277426 conn(0x7f96680ce8f0 msgr2=0x7f96680cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:12.921 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.905+0000 7f966d777700 1 -- 172.21.15.55:0/1627277426 shutdown_connections 2022-11-27T16:34:12.921 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.905+0000 7f966d777700 1 -- 172.21.15.55:0/1627277426 wait complete. 2022-11-27T16:34:12.921 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.906+0000 7f966d777700 1 Processor -- start 2022-11-27T16:34:12.921 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.906+0000 7f966d777700 1 -- start start 2022-11-27T16:34:12.921 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.907+0000 7f966d777700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f966806d3f0 0x7f96680c41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:12.922 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.907+0000 7f966d777700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f966806fae0 0x7f96681f5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:12.922 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.907+0000 7f966d777700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96680ca0c0 0x7f9668145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:12.922 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.907+0000 7f966d777700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96680ae370 con 0x7f966806fae0 2022-11-27T16:34:12.922 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.907+0000 7f966d777700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96681f5a50 con 0x7f966806d3f0 2022-11-27T16:34:12.922 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.907+0000 7f966d777700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96680c4820 con 0x7f96680ca0c0 2022-11-27T16:34:12.923 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.907+0000 7f9666ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f966806d3f0 0x7f96680c41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:12.923 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.907+0000 7f96677fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96680ca0c0 0x7f9668145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:12.923 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.907+0000 7f9666ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f966806d3f0 0x7f96680c41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58038/0 (socket says 172.21.15.55:58038) 2022-11-27T16:34:12.924 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.907+0000 7f9666ffd700 1 -- 172.21.15.55:0/943506634 learned_addr learned my addr 172.21.15.55:0/943506634 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-11-27T16:34:12.924 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.907+0000 7f96667fc700 1 --2- 172.21.15.55:0/943506634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f966806fae0 0x7f96681f5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:12.924 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.907+0000 7f96677fe700 1 -- 172.21.15.55:0/943506634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f966806d3f0 msgr2=0x7f96680c41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:12.924 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.907+0000 7f96677fe700 1 --2- 172.21.15.55:0/943506634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f966806d3f0 0x7f96680c41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:12.925 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.907+0000 7f96677fe700 1 -- 172.21.15.55:0/943506634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f966806fae0 msgr2=0x7f96681f5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:12.925 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.907+0000 7f96677fe700 1 --2- 172.21.15.55:0/943506634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f966806fae0 0x7f96681f5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:12.925 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.907+0000 7f96677fe700 1 -- 172.21.15.55:0/943506634 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96580094a0 con 0x7f96680ca0c0 2022-11-27T16:34:12.925 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.907+0000 7f96667fc700 1 --2- 172.21.15.55:0/943506634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f966806fae0 0x7f96681f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-11-27T16:34:12.925 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.907+0000 7f9666ffd700 1 --2- 172.21.15.55:0/943506634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f966806d3f0 0x7f96680c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-11-27T16:34:12.926 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.908+0000 7f96677fe700 1 --2- 172.21.15.55:0/943506634 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96680ca0c0 0x7f9668145410 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f966000caf0 tx=0x7f966000ce00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:12.926 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.908+0000 7f964f7fe700 1 -- 172.21.15.55:0/943506634 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966000aaa0 con 0x7f96680ca0c0 2022-11-27T16:34:12.926 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.908+0000 7f964f7fe700 1 -- 172.21.15.55:0/943506634 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966000ac20 con 0x7f96680ca0c0 2022-11-27T16:34:12.926 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.908+0000 7f966d777700 1 -- 172.21.15.55:0/943506634 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96680c4b00 con 0x7f96680ca0c0 2022-11-27T16:34:12.927 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.908+0000 7f964f7fe700 1 -- 172.21.15.55:0/943506634 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96600070d0 con 0x7f96680ca0c0 2022-11-27T16:34:12.927 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.908+0000 7f966d777700 1 -- 172.21.15.55:0/943506634 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96680c50c0 con 0x7f96680ca0c0 2022-11-27T16:34:12.927 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.908+0000 7f964f7fe700 1 -- 172.21.15.55:0/943506634 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f966001a030 con 0x7f96680ca0c0 2022-11-27T16:34:12.927 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.908+0000 7f964f7fe700 1 -- 172.21.15.55:0/943506634 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f966001d7c0 con 0x7f96680ca0c0 2022-11-27T16:34:12.927 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.909+0000 7f966d777700 1 -- 172.21.15.55:0/943506634 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966814c290 con 0x7f96680ca0c0 2022-11-27T16:34:12.928 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:12.911+0000 7f964f7fe700 1 -- 172.21.15.55:0/943506634 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71351 (secure 0 0 0) 0x7f9660018070 con 0x7f96680ca0c0 2022-11-27T16:34:13.008 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.006+0000 7f966d777700 1 -- 172.21.15.55:0/943506634 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a1c510ff-24f3-497e-823f-73d31df5e534", "id": 0} v 0) v1 -- 0x7f96680ae4e0 con 0x7f96680ca0c0 2022-11-27T16:34:13.017 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.015+0000 7f964f7fe700 1 -- 172.21.15.55:0/943506634 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a1c510ff-24f3-497e-823f-73d31df5e534", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f96680ae4e0 con 0x7f96680ca0c0 2022-11-27T16:34:13.017 INFO:teuthology.orchestra.run.smithi055.stdout:0 2022-11-27T16:34:13.018 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.016+0000 7f966d777700 1 -- 172.21.15.55:0/943506634 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96680ca0c0 msgr2=0x7f9668145410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.019 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.016+0000 7f966d777700 1 --2- 172.21.15.55:0/943506634 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96680ca0c0 0x7f9668145410 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f966000caf0 tx=0x7f966000ce00 comp rx=0 tx=0).stop 2022-11-27T16:34:13.019 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.016+0000 7f966d777700 1 -- 172.21.15.55:0/943506634 shutdown_connections 2022-11-27T16:34:13.019 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.016+0000 7f966d777700 1 --2- 172.21.15.55:0/943506634 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f96680ca0c0 0x7f9668145410 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.019 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.016+0000 7f966d777700 1 --2- 172.21.15.55:0/943506634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f966806d3f0 0x7f96680c41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.020 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.016+0000 7f966d777700 1 --2- 172.21.15.55:0/943506634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f966806fae0 0x7f96681f5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.020 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.016+0000 7f966d777700 1 -- 172.21.15.55:0/943506634 >> 172.21.15.55:0/943506634 conn(0x7f96680ce8f0 msgr2=0x7f966815e960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:13.020 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.016+0000 7f966d777700 1 -- 172.21.15.55:0/943506634 shutdown_connections 2022-11-27T16:34:13.020 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.016+0000 7f966d777700 1 -- 172.21.15.55:0/943506634 wait complete. 2022-11-27T16:34:13.023 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:13.021+0000 7f714aa7a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-11-27T16:34:13.030 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:13.028+0000 7f3ffc10a200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-11-27T16:34:13.034 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new 01055301-2278-4c5b-9963-8787137b7db9 1 2022-11-27T16:34:13.097 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:13.095+0000 7f3ffc10a200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-11-27T16:34:13.106 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:13.104+0000 7f714aa7a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-11-27T16:34:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.158+0000 7f86313e4700 1 Processor -- start 2022-11-27T16:34:13.162 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.158+0000 7f86313e4700 1 -- start start 2022-11-27T16:34:13.164 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.159+0000 7f86313e4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f862c0b12c0 0x7f862c0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.165 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.159+0000 7f86313e4700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f862c0cb760 0x7f862c0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.165 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.159+0000 7f86313e4700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f862c0c9880 con 0x7f862c0cb210 2022-11-27T16:34:13.165 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.159+0000 7f86313e4700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f862c15d690 con 0x7f862c0b12c0 2022-11-27T16:34:13.165 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.159+0000 7f86313e4700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862c15cb10 con 0x7f862c0cb760 2022-11-27T16:34:13.166 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.160+0000 7f862a7fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f862c0cb760 0x7f862c0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:13.166 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.160+0000 7f862b7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f862c0cb210 0x7f862c0702f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54488/0 (socket says 172.21.15.55:54488) 2022-11-27T16:34:13.166 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.160+0000 7f862b7fe700 1 -- 172.21.15.55:0/3105622000 learned_addr learned my addr 172.21.15.55:0/3105622000 (peer_addr_for_me v1:172.21.15.55:0/0) 2022-11-27T16:34:13.166 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.160+0000 7f862a7fc700 1 --2- 172.21.15.55:0/3105622000 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f862c0cb760 0x7f862c0cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:41826/0 (socket says 172.21.15.55:41826) 2022-11-27T16:34:13.167 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.160+0000 7f862a7fc700 1 -- 172.21.15.55:0/3105622000 >> v2:172.21.15.6:3300/0 conn(0x7f862c0b12c0 msgr2=0x7f862c0cd180 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-11-27T16:34:13.167 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.160+0000 7f862a7fc700 1 --2- 172.21.15.55:0/3105622000 >> v2:172.21.15.6:3300/0 conn(0x7f862c0b12c0 0x7f862c0cd180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.167 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.160+0000 7f862a7fc700 1 -- 172.21.15.55:0/3105622000 >> v1:172.21.15.55:6789/0 conn(0x7f862c0cb210 legacy=0x7f862c0702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.167 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.160+0000 7f862a7fc700 1 -- 172.21.15.55:0/3105622000 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f862c15cdf0 con 0x7f862c0cb760 2022-11-27T16:34:13.168 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.160+0000 7f862a7fc700 1 --2- 172.21.15.55:0/3105622000 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f862c0cb760 0x7f862c0cd6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8620009840 tx=0x7f8620009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae38d8d5f366efc2 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:13.174 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.163+0000 7f8629ffb700 1 -- 172.21.15.55:0/3105622000 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620011830 con 0x7f862c0cb760 2022-11-27T16:34:13.174 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.163+0000 7f8629ffb700 1 -- 172.21.15.55:0/3105622000 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8620011990 con 0x7f862c0cb760 2022-11-27T16:34:13.174 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.163+0000 7f8629ffb700 1 -- 172.21.15.55:0/3105622000 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8620011d20 con 0x7f862c0cb760 2022-11-27T16:34:13.175 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.164+0000 7f86313e4700 1 -- 172.21.15.55:0/3105622000 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f862c0cb760 msgr2=0x7f862c0cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.175 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.164+0000 7f86313e4700 1 --2- 172.21.15.55:0/3105622000 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f862c0cb760 0x7f862c0cd6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8620009840 tx=0x7f8620009b50 comp rx=0 tx=0).stop 2022-11-27T16:34:13.175 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.164+0000 7f86313e4700 1 -- 172.21.15.55:0/3105622000 shutdown_connections 2022-11-27T16:34:13.176 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.164+0000 7f86313e4700 1 --2- 172.21.15.55:0/3105622000 >> v2:172.21.15.6:3300/0 conn(0x7f862c0b12c0 0x7f862c0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.176 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.164+0000 7f86313e4700 1 --2- 172.21.15.55:0/3105622000 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f862c0cb760 0x7f862c0cd6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.176 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.164+0000 7f86313e4700 1 -- 172.21.15.55:0/3105622000 >> 172.21.15.55:0/3105622000 conn(0x7f862c0cbc00 msgr2=0x7f862c0cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:13.176 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.164+0000 7f86313e4700 1 -- 172.21.15.55:0/3105622000 shutdown_connections 2022-11-27T16:34:13.177 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.164+0000 7f86313e4700 1 -- 172.21.15.55:0/3105622000 wait complete. 2022-11-27T16:34:13.177 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.166+0000 7f86313e4700 1 Processor -- start 2022-11-27T16:34:13.177 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.166+0000 7f86313e4700 1 -- start start 2022-11-27T16:34:13.178 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.167+0000 7f86313e4700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f862c0b12c0 0x7f862c1505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.178 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.167+0000 7f86313e4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f862c0cb210 0x7f862c0c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.178 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.167+0000 7f86313e4700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862c0cb760 0x7f862c0af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.178 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.167+0000 7f86313e4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c15ae80 con 0x7f862c0cb210 2022-11-27T16:34:13.178 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.167+0000 7f86313e4700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862c0c90a0 con 0x7f862c0cb760 2022-11-27T16:34:13.179 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.167+0000 7f86313e4700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862c15a270 con 0x7f862c0b12c0 2022-11-27T16:34:13.179 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.167+0000 7f862b7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862c0cb760 0x7f862c0af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:13.180 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.167+0000 7f862affd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f862c0b12c0 0x7f862c1505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:13.180 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.167+0000 7f862affd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f862c0b12c0 0x7f862c1505c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:41830/0 (socket says 172.21.15.55:41830) 2022-11-27T16:34:13.180 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.167+0000 7f862b7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862c0cb760 0x7f862c0af380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58054/0 (socket says 172.21.15.55:58054) 2022-11-27T16:34:13.180 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.167+0000 7f862affd700 1 -- 172.21.15.55:0/3418587068 learned_addr learned my addr 172.21.15.55:0/3418587068 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-11-27T16:34:13.180 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.167+0000 7f862a7fc700 1 --2- 172.21.15.55:0/3418587068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f862c0cb210 0x7f862c0c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:13.181 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.167+0000 7f862b7fe700 1 -- 172.21.15.55:0/3418587068 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f862c0b12c0 msgr2=0x7f862c1505c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.181 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.167+0000 7f862b7fe700 1 --2- 172.21.15.55:0/3418587068 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f862c0b12c0 0x7f862c1505c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.181 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.167+0000 7f862b7fe700 1 -- 172.21.15.55:0/3418587068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f862c0cb210 msgr2=0x7f862c0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.181 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.167+0000 7f862b7fe700 1 --2- 172.21.15.55:0/3418587068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f862c0cb210 0x7f862c0c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.181 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.167+0000 7f862b7fe700 1 -- 172.21.15.55:0/3418587068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86200094a0 con 0x7f862c0cb760 2022-11-27T16:34:13.182 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.167+0000 7f862b7fe700 1 --2- 172.21.15.55:0/3418587068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862c0cb760 0x7f862c0af380 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f862400caa0 tx=0x7f862400cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:13.182 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.168+0000 7f86137fe700 1 -- 172.21.15.55:0/3418587068 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862400a9a0 con 0x7f862c0cb760 2022-11-27T16:34:13.182 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.168+0000 7f86137fe700 1 -- 172.21.15.55:0/3418587068 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f862400ab00 con 0x7f862c0cb760 2022-11-27T16:34:13.182 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.168+0000 7f86313e4700 1 -- 172.21.15.55:0/3418587068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862c15a550 con 0x7f862c0cb760 2022-11-27T16:34:13.183 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.168+0000 7f86137fe700 1 -- 172.21.15.55:0/3418587068 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f862400ae70 con 0x7f862c0cb760 2022-11-27T16:34:13.183 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.168+0000 7f86313e4700 1 -- 172.21.15.55:0/3418587068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f862c15ab10 con 0x7f862c0cb760 2022-11-27T16:34:13.183 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.169+0000 7f86137fe700 1 -- 172.21.15.55:0/3418587068 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f8624019030 con 0x7f862c0cb760 2022-11-27T16:34:13.183 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.169+0000 7f86313e4700 1 -- 172.21.15.55:0/3418587068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f862c15b010 con 0x7f862c0cb760 2022-11-27T16:34:13.184 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.169+0000 7f86137fe700 1 -- 172.21.15.55:0/3418587068 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f86240127b0 con 0x7f862c0cb760 2022-11-27T16:34:13.184 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.171+0000 7f86137fe700 1 -- 172.21.15.55:0/3418587068 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71351 (secure 0 0 0) 0x7f8624021060 con 0x7f862c0cb760 2022-11-27T16:34:13.185 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:13.174+0000 7f3ffc10a200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-11-27T16:34:13.243 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:13.241+0000 7f714aa7a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-11-27T16:34:13.257 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:13.255+0000 7f3ffc10a200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-11-27T16:34:13.259 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.256+0000 7f86313e4700 1 -- 172.21.15.55:0/3418587068 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd new", "uuid": "01055301-2278-4c5b-9963-8787137b7db9", "id": 1} v 0) v1 -- 0x7f862c068b70 con 0x7f862c0cb760 2022-11-27T16:34:13.267 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.266+0000 7f86137fe700 1 -- 172.21.15.55:0/3418587068 <== mon.1 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "01055301-2278-4c5b-9963-8787137b7db9", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8624017070 con 0x7f862c0cb760 2022-11-27T16:34:13.268 INFO:teuthology.orchestra.run.smithi055.stdout:1 2022-11-27T16:34:13.269 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.267+0000 7f86313e4700 1 -- 172.21.15.55:0/3418587068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862c0cb760 msgr2=0x7f862c0af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.269 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.267+0000 7f86313e4700 1 --2- 172.21.15.55:0/3418587068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862c0cb760 0x7f862c0af380 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f862400caa0 tx=0x7f862400cdb0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.270 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.267+0000 7f86313e4700 1 -- 172.21.15.55:0/3418587068 shutdown_connections 2022-11-27T16:34:13.270 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.267+0000 7f86313e4700 1 --2- 172.21.15.55:0/3418587068 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f862c0cb760 0x7f862c0af380 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.270 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.267+0000 7f86313e4700 1 --2- 172.21.15.55:0/3418587068 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f862c0b12c0 0x7f862c1505c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.270 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.267+0000 7f86313e4700 1 --2- 172.21.15.55:0/3418587068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f862c0cb210 0x7f862c0c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.271 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.267+0000 7f86313e4700 1 -- 172.21.15.55:0/3418587068 >> 172.21.15.55:0/3418587068 conn(0x7f862c0cbc00 msgr2=0x7f862c0caa10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:13.271 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.267+0000 7f86313e4700 1 -- 172.21.15.55:0/3418587068 shutdown_connections 2022-11-27T16:34:13.271 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.267+0000 7f86313e4700 1 -- 172.21.15.55:0/3418587068 wait complete. 2022-11-27T16:34:13.280 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new d523a914-8041-42f7-a369-33e54681eb9d 2 2022-11-27T16:34:13.343 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:13.341+0000 7f714aa7a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-11-27T16:34:13.404 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.402+0000 7fe6fe11d700 1 Processor -- start 2022-11-27T16:34:13.404 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.402+0000 7fe6fe11d700 1 -- start start 2022-11-27T16:34:13.406 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:13.401+0000 7f3ffc10a200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-11-27T16:34:13.411 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.402+0000 7fe6fe11d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6f80cdaa0 0x7fe6f80c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.412 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.402+0000 7fe6fe11d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fe6f806fae0 0x7fe6f806ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.412 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.403+0000 7fe6fe11d700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f80ce740 con 0x7fe6f80ca0c0 2022-11-27T16:34:13.412 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.403+0000 7fe6fe11d700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f806bf80 con 0x7fe6f806fae0 2022-11-27T16:34:13.412 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.403+0000 7fe6fe11d700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f8070460 con 0x7fe6f80cdaa0 2022-11-27T16:34:13.413 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.403+0000 7fe6f6ffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6f80cdaa0 0x7fe6f80c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:13.413 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.403+0000 7fe6f6ffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6f80cdaa0 0x7fe6f80c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58058/0 (socket says 172.21.15.55:58058) 2022-11-27T16:34:13.413 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.403+0000 7fe6f6ffd700 1 -- 172.21.15.55:0/718350189 learned_addr learned my addr 172.21.15.55:0/718350189 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-11-27T16:34:13.413 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.403+0000 7fe6f7fff700 1 --2- 172.21.15.55:0/718350189 >> v2:172.21.15.6:3300/0 conn(0x7fe6f806fae0 0x7fe6f806ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:13.414 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.403+0000 7fe6f6ffd700 1 -- 172.21.15.55:0/718350189 >> v2:172.21.15.6:3300/0 conn(0x7fe6f806fae0 msgr2=0x7fe6f806ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:13.414 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.403+0000 7fe6f6ffd700 1 --2- 172.21.15.55:0/718350189 >> v2:172.21.15.6:3300/0 conn(0x7fe6f806fae0 0x7fe6f806ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.414 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.403+0000 7fe6f6ffd700 1 -- 172.21.15.55:0/718350189 >> v1:172.21.15.6:6789/0 conn(0x7fe6f80ca0c0 legacy=0x7fe6f806d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.403+0000 7fe6f6ffd700 1 -- 172.21.15.55:0/718350189 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f80cdf10 con 0x7fe6f80cdaa0 2022-11-27T16:34:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.403+0000 7fe6f6ffd700 1 --2- 172.21.15.55:0/718350189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f80cdaa0 0x7fe6f80c8f40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80cb340 tx=0x7fe6ec009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90657ad8ab34abbd server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:13.415 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.403+0000 7fe6f67fc700 1 -- 172.21.15.55:0/718350189 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec011830 con 0x7fe6f80cdaa0 2022-11-27T16:34:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.403+0000 7fe6f67fc700 1 -- 172.21.15.55:0/718350189 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6ec011990 con 0x7fe6f80cdaa0 2022-11-27T16:34:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.403+0000 7fe6f67fc700 1 -- 172.21.15.55:0/718350189 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec011d20 con 0x7fe6f80cdaa0 2022-11-27T16:34:13.416 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.404+0000 7fe6fe11d700 1 -- 172.21.15.55:0/718350189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f80cdaa0 msgr2=0x7fe6f80c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.417 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.404+0000 7fe6fe11d700 1 --2- 172.21.15.55:0/718350189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f80cdaa0 0x7fe6f80c8f40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80cb340 tx=0x7fe6ec009bd0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.417 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.404+0000 7fe6fe11d700 1 -- 172.21.15.55:0/718350189 shutdown_connections 2022-11-27T16:34:13.417 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.404+0000 7fe6fe11d700 1 --2- 172.21.15.55:0/718350189 >> v2:172.21.15.6:3300/0 conn(0x7fe6f806fae0 0x7fe6f806ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.418 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.404+0000 7fe6fe11d700 1 --2- 172.21.15.55:0/718350189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f80cdaa0 0x7fe6f80c8f40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.418 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.404+0000 7fe6fe11d700 1 -- 172.21.15.55:0/718350189 >> 172.21.15.55:0/718350189 conn(0x7fe6f80ce8f0 msgr2=0x7fe6f80cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:13.418 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.404+0000 7fe6fe11d700 1 -- 172.21.15.55:0/718350189 shutdown_connections 2022-11-27T16:34:13.418 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.404+0000 7fe6fe11d700 1 -- 172.21.15.55:0/718350189 wait complete. 2022-11-27T16:34:13.419 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.406+0000 7fe6fe11d700 1 Processor -- start 2022-11-27T16:34:13.419 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.406+0000 7fe6fe11d700 1 -- start start 2022-11-27T16:34:13.419 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6fe11d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6f806fae0 0x7fe6f80af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6fe11d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6f80ca0c0 0x7fe6f8156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6fe11d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f80cdaa0 0x7fe6f81572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6fe11d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f8157800 con 0x7fe6f806fae0 2022-11-27T16:34:13.420 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6fe11d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f8157ad0 con 0x7fe6f80cdaa0 2022-11-27T16:34:13.421 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6fe11d700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f8157db0 con 0x7fe6f80ca0c0 2022-11-27T16:34:13.421 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6f7fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f80cdaa0 0x7fe6f81572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:13.421 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6f6ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6f80ca0c0 0x7fe6f8156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:13.421 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6f7fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f80cdaa0 0x7fe6f81572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58064/0 (socket says 172.21.15.55:58064) 2022-11-27T16:34:13.422 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6f7fff700 1 -- 172.21.15.55:0/3784006944 learned_addr learned my addr 172.21.15.55:0/3784006944 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-11-27T16:34:13.422 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6f77fe700 1 --2- 172.21.15.55:0/3784006944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6f806fae0 0x7fe6f80af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:13.422 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6f7fff700 1 -- 172.21.15.55:0/3784006944 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6f80ca0c0 msgr2=0x7fe6f8156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.422 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6f7fff700 1 --2- 172.21.15.55:0/3784006944 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6f80ca0c0 0x7fe6f8156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.423 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6f7fff700 1 -- 172.21.15.55:0/3784006944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6f806fae0 msgr2=0x7fe6f80af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.423 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6f7fff700 1 --2- 172.21.15.55:0/3784006944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6f806fae0 0x7fe6f80af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.423 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6f7fff700 1 -- 172.21.15.55:0/3784006944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6ec009550 con 0x7fe6f80cdaa0 2022-11-27T16:34:13.423 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6f6ffd700 1 --2- 172.21.15.55:0/3784006944 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6f80ca0c0 0x7fe6f8156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-11-27T16:34:13.424 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6f77fe700 1 --2- 172.21.15.55:0/3784006944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6f806fae0 0x7fe6f80af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-11-27T16:34:13.424 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.407+0000 7fe6f7fff700 1 --2- 172.21.15.55:0/3784006944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f80cdaa0 0x7fe6f81572c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe6f000efc0 tx=0x7fe6f000c0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:13.425 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.408+0000 7fe6dffff700 1 -- 172.21.15.55:0/3784006944 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f000cad0 con 0x7fe6f80cdaa0 2022-11-27T16:34:13.425 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.408+0000 7fe6dffff700 1 -- 172.21.15.55:0/3784006944 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f000f040 con 0x7fe6f80cdaa0 2022-11-27T16:34:13.426 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.408+0000 7fe6fe11d700 1 -- 172.21.15.55:0/3784006944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f8158090 con 0x7fe6f80cdaa0 2022-11-27T16:34:13.426 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.408+0000 7fe6dffff700 1 -- 172.21.15.55:0/3784006944 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f000ce70 con 0x7fe6f80cdaa0 2022-11-27T16:34:13.426 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.408+0000 7fe6fe11d700 1 -- 172.21.15.55:0/3784006944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f8158650 con 0x7fe6f80cdaa0 2022-11-27T16:34:13.427 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.408+0000 7fe6dffff700 1 -- 172.21.15.55:0/3784006944 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fe6f0014480 con 0x7fe6f80cdaa0 2022-11-27T16:34:13.427 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.408+0000 7fe6dffff700 1 -- 172.21.15.55:0/3784006944 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fe6f0013800 con 0x7fe6f80cdaa0 2022-11-27T16:34:13.428 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.409+0000 7fe6fe11d700 1 -- 172.21.15.55:0/3784006944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f8068b70 con 0x7fe6f80cdaa0 2022-11-27T16:34:13.428 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.411+0000 7fe6dffff700 1 -- 172.21.15.55:0/3784006944 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71351 (secure 0 0 0) 0x7fe6f0018020 con 0x7fe6f80cdaa0 2022-11-27T16:34:13.500 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.497+0000 7fe6fe11d700 1 -- 172.21.15.55:0/3784006944 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d523a914-8041-42f7-a369-33e54681eb9d", "id": 2} v 0) v1 -- 0x7fe6f80ce180 con 0x7fe6f80cdaa0 2022-11-27T16:34:13.508 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.507+0000 7fe6dffff700 1 -- 172.21.15.55:0/3784006944 <== mon.1 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d523a914-8041-42f7-a369-33e54681eb9d", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe6f00135e0 con 0x7fe6f80cdaa0 2022-11-27T16:34:13.509 INFO:teuthology.orchestra.run.smithi055.stdout:2 2022-11-27T16:34:13.510 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.508+0000 7fe6fe11d700 1 -- 172.21.15.55:0/3784006944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f80cdaa0 msgr2=0x7fe6f81572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.510 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.508+0000 7fe6fe11d700 1 --2- 172.21.15.55:0/3784006944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f80cdaa0 0x7fe6f81572c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe6f000efc0 tx=0x7fe6f000c0c0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.511 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.508+0000 7fe6fe11d700 1 -- 172.21.15.55:0/3784006944 shutdown_connections 2022-11-27T16:34:13.511 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.508+0000 7fe6fe11d700 1 --2- 172.21.15.55:0/3784006944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f80cdaa0 0x7fe6f81572c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.511 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.508+0000 7fe6fe11d700 1 --2- 172.21.15.55:0/3784006944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6f806fae0 0x7fe6f80af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.511 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.508+0000 7fe6fe11d700 1 --2- 172.21.15.55:0/3784006944 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe6f80ca0c0 0x7fe6f8156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.512 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.508+0000 7fe6fe11d700 1 -- 172.21.15.55:0/3784006944 >> 172.21.15.55:0/3784006944 conn(0x7fe6f80ce8f0 msgr2=0x7fe6f80cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:13.512 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.508+0000 7fe6fe11d700 1 -- 172.21.15.55:0/3784006944 shutdown_connections 2022-11-27T16:34:13.512 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.508+0000 7fe6fe11d700 1 -- 172.21.15.55:0/3784006944 wait complete. 2022-11-27T16:34:13.523 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new d981890c-4dc6-4292-89f8-a11a3b529962 3 2022-11-27T16:34:13.647 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.644+0000 7f280efca700 1 Processor -- start 2022-11-27T16:34:13.647 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.645+0000 7f280efca700 1 -- start start 2022-11-27T16:34:13.650 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.645+0000 7f280efca700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28080ca2f0 0x7f28080b4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.650 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.645+0000 7f280efca700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28080ca790 con 0x7f280806fae0 2022-11-27T16:34:13.651 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.645+0000 7f280efca700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28080ca9d0 con 0x7f2808159c80 2022-11-27T16:34:13.651 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.645+0000 7f280efca700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28080cacb0 con 0x7f28080ca2f0 2022-11-27T16:34:13.651 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.645+0000 7f2807fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28080ca2f0 0x7f28080b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:13.651 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.645+0000 7f280cd66700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2808159c80 0x7f28080b1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54508/0 (socket says 172.21.15.55:54508) 2022-11-27T16:34:13.652 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.645+0000 7f280cd66700 1 -- 172.21.15.55:0/1147905191 learned_addr learned my addr 172.21.15.55:0/1147905191 (peer_addr_for_me v1:172.21.15.55:0/0) 2022-11-27T16:34:13.652 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.646+0000 7f28077fe700 1 -- 172.21.15.55:0/1147905191 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325068758 0 0) 0x7f28080ca9d0 con 0x7f2808159c80 2022-11-27T16:34:13.652 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.646+0000 7f2807fff700 1 -- 172.21.15.55:0/1147905191 >> v1:172.21.15.55:6789/0 conn(0x7f2808159c80 legacy=0x7f28080b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.652 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.646+0000 7f2807fff700 1 -- 172.21.15.55:0/1147905191 >> v1:172.21.15.6:6789/0 conn(0x7f280806fae0 legacy=0x7f2808069660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.653 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.646+0000 7f2807fff700 1 -- 172.21.15.55:0/1147905191 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28080caf90 con 0x7f28080ca2f0 2022-11-27T16:34:13.653 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.646+0000 7f2807fff700 1 --2- 172.21.15.55:0/1147905191 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28080ca2f0 0x7f28080b4290 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009870 tx=0x7f27f0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a61c588885945da server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:13.653 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.646+0000 7f28077fe700 1 -- 172.21.15.55:0/1147905191 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0011830 con 0x7f28080ca2f0 2022-11-27T16:34:13.653 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.646+0000 7f28077fe700 1 -- 172.21.15.55:0/1147905191 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f0011990 con 0x7f28080ca2f0 2022-11-27T16:34:13.654 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.646+0000 7f28077fe700 1 -- 172.21.15.55:0/1147905191 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f0011d20 con 0x7f28080ca2f0 2022-11-27T16:34:13.654 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.647+0000 7f280efca700 1 -- 172.21.15.55:0/1147905191 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28080ca2f0 msgr2=0x7f28080b4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.654 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.647+0000 7f280efca700 1 --2- 172.21.15.55:0/1147905191 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28080ca2f0 0x7f28080b4290 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009870 tx=0x7f27f0009b80 comp rx=0 tx=0).stop 2022-11-27T16:34:13.654 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.647+0000 7f280efca700 1 -- 172.21.15.55:0/1147905191 shutdown_connections 2022-11-27T16:34:13.655 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.647+0000 7f280efca700 1 --2- 172.21.15.55:0/1147905191 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f28080ca2f0 0x7f28080b4290 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.655 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.647+0000 7f280efca700 1 -- 172.21.15.55:0/1147905191 >> 172.21.15.55:0/1147905191 conn(0x7f28080ce8f0 msgr2=0x7f28080cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:13.655 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.647+0000 7f280efca700 1 -- 172.21.15.55:0/1147905191 shutdown_connections 2022-11-27T16:34:13.655 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.647+0000 7f280efca700 1 -- 172.21.15.55:0/1147905191 wait complete. 2022-11-27T16:34:13.656 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.648+0000 7f280efca700 1 Processor -- start 2022-11-27T16:34:13.656 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.648+0000 7f280efca700 1 -- start start 2022-11-27T16:34:13.659 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f280efca700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f280806fae0 0x7f280814ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.660 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f280efca700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28080ca2f0 0x7f28080acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.660 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f280efca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2808159c80 0x7f28080cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.660 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f280efca700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28080cc910 con 0x7f2808159c80 2022-11-27T16:34:13.660 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f280efca700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28080aba50 con 0x7f28080ca2f0 2022-11-27T16:34:13.661 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f280efca700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28080abd30 con 0x7f280806fae0 2022-11-27T16:34:13.661 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f280cd66700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f280806fae0 0x7f280814ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:13.661 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f2807fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28080ca2f0 0x7f28080acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:13.661 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f280cd66700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f280806fae0 0x7f280814ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:41854/0 (socket says 172.21.15.55:41854) 2022-11-27T16:34:13.662 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f2807fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28080ca2f0 0x7f28080acaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58076/0 (socket says 172.21.15.55:58076) 2022-11-27T16:34:13.662 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f280cd66700 1 -- 172.21.15.55:0/1920834489 learned_addr learned my addr 172.21.15.55:0/1920834489 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-11-27T16:34:13.662 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f280d567700 1 --2- 172.21.15.55:0/1920834489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2808159c80 0x7f28080cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:13.662 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f280cd66700 1 -- 172.21.15.55:0/1920834489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28080ca2f0 msgr2=0x7f28080acaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.662 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f280cd66700 1 --2- 172.21.15.55:0/1920834489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28080ca2f0 0x7f28080acaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.663 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f280cd66700 1 -- 172.21.15.55:0/1920834489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2808159c80 msgr2=0x7f28080cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.663 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f280cd66700 1 --2- 172.21.15.55:0/1920834489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2808159c80 0x7f28080cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.663 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f280cd66700 1 -- 172.21.15.55:0/1920834489 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00094a0 con 0x7f280806fae0 2022-11-27T16:34:13.663 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f2807fff700 1 --2- 172.21.15.55:0/1920834489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28080ca2f0 0x7f28080acaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-11-27T16:34:13.664 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.649+0000 7f280cd66700 1 --2- 172.21.15.55:0/1920834489 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f280806fae0 0x7f280814ddd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f280000cbe0 tx=0x7f280000cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:13.664 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.650+0000 7f28057fa700 1 -- 172.21.15.55:0/1920834489 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280000aaa0 con 0x7f280806fae0 2022-11-27T16:34:13.664 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.650+0000 7f28057fa700 1 -- 172.21.15.55:0/1920834489 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280000ac00 con 0x7f280806fae0 2022-11-27T16:34:13.664 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.650+0000 7f28057fa700 1 -- 172.21.15.55:0/1920834489 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000070d0 con 0x7f280806fae0 2022-11-27T16:34:13.665 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.650+0000 7f280efca700 1 -- 172.21.15.55:0/1920834489 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28080ac010 con 0x7f280806fae0 2022-11-27T16:34:13.665 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.650+0000 7f280efca700 1 -- 172.21.15.55:0/1920834489 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28080ac5d0 con 0x7f280806fae0 2022-11-27T16:34:13.665 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.650+0000 7f28057fa700 1 -- 172.21.15.55:0/1920834489 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f2800010070 con 0x7f280806fae0 2022-11-27T16:34:13.665 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.650+0000 7f28057fa700 1 -- 172.21.15.55:0/1920834489 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f280001b7f0 con 0x7f280806fae0 2022-11-27T16:34:13.665 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.651+0000 7f280efca700 1 -- 172.21.15.55:0/1920834489 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2808068b70 con 0x7f280806fae0 2022-11-27T16:34:13.666 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.653+0000 7f28057fa700 1 -- 172.21.15.55:0/1920834489 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71351 (secure 0 0 0) 0x7f2800018070 con 0x7f280806fae0 2022-11-27T16:34:13.740 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.739+0000 7f280efca700 1 -- 172.21.15.55:0/1920834489 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d981890c-4dc6-4292-89f8-a11a3b529962", "id": 3} v 0) v1 -- 0x7f28080663f0 con 0x7f280806fae0 2022-11-27T16:34:13.747 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:13.744+0000 7f3ffc10a200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-11-27T16:34:13.750 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.749+0000 7f28057fa700 1 -- 172.21.15.55:0/1920834489 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d981890c-4dc6-4292-89f8-a11a3b529962", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f280001b430 con 0x7f280806fae0 2022-11-27T16:34:13.751 INFO:teuthology.orchestra.run.smithi055.stdout:3 2022-11-27T16:34:13.752 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.750+0000 7f280efca700 1 -- 172.21.15.55:0/1920834489 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f280806fae0 msgr2=0x7f280814ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.752 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.750+0000 7f280efca700 1 --2- 172.21.15.55:0/1920834489 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f280806fae0 0x7f280814ddd0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f280000cbe0 tx=0x7f280000cef0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.753 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.750+0000 7f280efca700 1 -- 172.21.15.55:0/1920834489 shutdown_connections 2022-11-27T16:34:13.753 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.750+0000 7f280efca700 1 --2- 172.21.15.55:0/1920834489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2808159c80 0x7f28080cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.753 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.750+0000 7f280efca700 1 --2- 172.21.15.55:0/1920834489 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f280806fae0 0x7f280814ddd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.753 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.750+0000 7f280efca700 1 --2- 172.21.15.55:0/1920834489 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f28080ca2f0 0x7f28080acaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.754 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.750+0000 7f280efca700 1 -- 172.21.15.55:0/1920834489 >> 172.21.15.55:0/1920834489 conn(0x7f28080ce8f0 msgr2=0x7f280806a100 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:13.754 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.750+0000 7f280efca700 1 -- 172.21.15.55:0/1920834489 shutdown_connections 2022-11-27T16:34:13.754 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.750+0000 7f280efca700 1 -- 172.21.15.55:0/1920834489 wait complete. 2022-11-27T16:34:13.764 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new de3bdb57-3fc0-4353-a4cf-394d28ed0404 4 2022-11-27T16:34:13.809 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:13.808+0000 7f714aa7a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-11-27T16:34:13.824 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:13.822+0000 7f3ffc10a200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-11-27T16:34:13.889 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.887+0000 7fd8f6b64700 1 Processor -- start 2022-11-27T16:34:13.889 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.887+0000 7fd8f6b64700 1 -- start start 2022-11-27T16:34:13.892 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.888+0000 7fd8f6b64700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd8f00b5a60 0x7fd8f00ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.892 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.888+0000 7fd8f6b64700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8f00cd2a0 0x7fd8f00cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.893 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.888+0000 7fd8f6b64700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f00cc720 con 0x7fd8f00b2950 2022-11-27T16:34:13.893 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.888+0000 7fd8f6b64700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f0159fc0 con 0x7fd8f00b5a60 2022-11-27T16:34:13.893 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.888+0000 7fd8f6b64700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f00cedc0 con 0x7fd8f00cd2a0 2022-11-27T16:34:13.893 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.888+0000 7fd8f5101700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8f00cd2a0 0x7fd8f00cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:13.894 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.888+0000 7fd8f5101700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8f00cd2a0 0x7fd8f00cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:41864/0 (socket says 172.21.15.55:41864) 2022-11-27T16:34:13.894 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.888+0000 7fd8f5101700 1 -- 172.21.15.55:0/195952647 learned_addr learned my addr 172.21.15.55:0/195952647 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-11-27T16:34:13.894 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.888+0000 7fd8f4900700 1 --2- 172.21.15.55:0/195952647 >> v2:172.21.15.6:3300/0 conn(0x7fd8f00b5a60 0x7fd8f00ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:13.894 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.889+0000 7fd8f5101700 1 -- 172.21.15.55:0/195952647 >> v2:172.21.15.6:3300/0 conn(0x7fd8f00b5a60 msgr2=0x7fd8f00ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:13.895 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.889+0000 7fd8f5101700 1 --2- 172.21.15.55:0/195952647 >> v2:172.21.15.6:3300/0 conn(0x7fd8f00b5a60 0x7fd8f00ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.895 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.889+0000 7fd8f5101700 1 -- 172.21.15.55:0/195952647 >> v1:172.21.15.6:6789/0 conn(0x7fd8f00b2950 legacy=0x7fd8f00ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.895 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.889+0000 7fd8f5101700 1 -- 172.21.15.55:0/195952647 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f00cbdf0 con 0x7fd8f00cd2a0 2022-11-27T16:34:13.895 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.889+0000 7fd8f5101700 1 --2- 172.21.15.55:0/195952647 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8f00cd2a0 0x7fd8f00cf520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009e50 tx=0x7fd8e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b8c97bee84bfeb7 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:13.896 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.889+0000 7fd8ef7fe700 1 -- 172.21.15.55:0/195952647 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e800e070 con 0x7fd8f00cd2a0 2022-11-27T16:34:13.896 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.889+0000 7fd8ef7fe700 1 -- 172.21.15.55:0/195952647 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e800b910 con 0x7fd8f00cd2a0 2022-11-27T16:34:13.896 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.889+0000 7fd8ef7fe700 1 -- 172.21.15.55:0/195952647 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e800bcc0 con 0x7fd8f00cd2a0 2022-11-27T16:34:13.896 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.890+0000 7fd8f6b64700 1 -- 172.21.15.55:0/195952647 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8f00cd2a0 msgr2=0x7fd8f00cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.896 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.890+0000 7fd8f6b64700 1 --2- 172.21.15.55:0/195952647 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8f00cd2a0 0x7fd8f00cf520 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009e50 tx=0x7fd8e800b330 comp rx=0 tx=0).stop 2022-11-27T16:34:13.897 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.890+0000 7fd8f6b64700 1 -- 172.21.15.55:0/195952647 shutdown_connections 2022-11-27T16:34:13.897 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.890+0000 7fd8f6b64700 1 --2- 172.21.15.55:0/195952647 >> v2:172.21.15.6:3300/0 conn(0x7fd8f00b5a60 0x7fd8f00ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.897 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.890+0000 7fd8f6b64700 1 --2- 172.21.15.55:0/195952647 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8f00cd2a0 0x7fd8f00cf520 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.897 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.890+0000 7fd8f6b64700 1 -- 172.21.15.55:0/195952647 >> 172.21.15.55:0/195952647 conn(0x7fd8f0064ec0 msgr2=0x7fd8f0065290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:13.898 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.890+0000 7fd8f6b64700 1 -- 172.21.15.55:0/195952647 shutdown_connections 2022-11-27T16:34:13.898 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.890+0000 7fd8f6b64700 1 -- 172.21.15.55:0/195952647 wait complete. 2022-11-27T16:34:13.901 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.892+0000 7fd8f6b64700 1 Processor -- start 2022-11-27T16:34:13.901 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.892+0000 7fd8f6b64700 1 -- start start 2022-11-27T16:34:13.901 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.893+0000 7fd8f6b64700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8f00b2950 0x7fd8f0146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.902 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.893+0000 7fd8f6b64700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8f00b5a60 0x7fd8f00c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.902 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.893+0000 7fd8f6b64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8f00cd2a0 0x7fd8f00cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:13.902 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.893+0000 7fd8f6b64700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f00c6790 con 0x7fd8f00cd2a0 2022-11-27T16:34:13.902 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.893+0000 7fd8f6b64700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f00c6bb0 con 0x7fd8f00b5a60 2022-11-27T16:34:13.902 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.893+0000 7fd8f6b64700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f0146b70 con 0x7fd8f00b2950 2022-11-27T16:34:13.903 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.893+0000 7fd8f4900700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8f00b2950 0x7fd8f0146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:13.903 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.893+0000 7fd8effff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8f00b5a60 0x7fd8f00c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:13.903 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.893+0000 7fd8effff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8f00b5a60 0x7fd8f00c5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58088/0 (socket says 172.21.15.55:58088) 2022-11-27T16:34:13.903 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.893+0000 7fd8f4900700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8f00b2950 0x7fd8f0146630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:41866/0 (socket says 172.21.15.55:41866) 2022-11-27T16:34:13.904 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.893+0000 7fd8effff700 1 -- 172.21.15.55:0/367126747 learned_addr learned my addr 172.21.15.55:0/367126747 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-11-27T16:34:13.904 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.893+0000 7fd8f5101700 1 --2- 172.21.15.55:0/367126747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8f00cd2a0 0x7fd8f00cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:13.904 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.894+0000 7fd8f5101700 1 -- 172.21.15.55:0/367126747 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8f00b2950 msgr2=0x7fd8f0146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.904 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.894+0000 7fd8f5101700 1 --2- 172.21.15.55:0/367126747 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8f00b2950 0x7fd8f0146630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.894+0000 7fd8f5101700 1 -- 172.21.15.55:0/367126747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8f00b5a60 msgr2=0x7fd8f00c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.894+0000 7fd8f5101700 1 --2- 172.21.15.55:0/367126747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8f00b5a60 0x7fd8f00c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.894+0000 7fd8f5101700 1 -- 172.21.15.55:0/367126747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e8009b30 con 0x7fd8f00cd2a0 2022-11-27T16:34:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.894+0000 7fd8effff700 1 --2- 172.21.15.55:0/367126747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8f00b5a60 0x7fd8f00c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-11-27T16:34:13.905 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.894+0000 7fd8f4900700 1 --2- 172.21.15.55:0/367126747 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8f00b2950 0x7fd8f0146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-11-27T16:34:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.894+0000 7fd8f5101700 1 --2- 172.21.15.55:0/367126747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8f00cd2a0 0x7fd8f00cefc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd8f006fd50 tx=0x7fd8e8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.894+0000 7fd8ed7fa700 1 -- 172.21.15.55:0/367126747 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8004800 con 0x7fd8f00cd2a0 2022-11-27T16:34:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.894+0000 7fd8ed7fa700 1 -- 172.21.15.55:0/367126747 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e8004960 con 0x7fd8f00cd2a0 2022-11-27T16:34:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.894+0000 7fd8f6b64700 1 -- 172.21.15.55:0/367126747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f00c5b10 con 0x7fd8f00cd2a0 2022-11-27T16:34:13.906 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.894+0000 7fd8ed7fa700 1 -- 172.21.15.55:0/367126747 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e801b670 con 0x7fd8f00cd2a0 2022-11-27T16:34:13.907 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.894+0000 7fd8f6b64700 1 -- 172.21.15.55:0/367126747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f00c60d0 con 0x7fd8f00cd2a0 2022-11-27T16:34:13.907 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.894+0000 7fd8ed7fa700 1 -- 172.21.15.55:0/367126747 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7fd8e801bac0 con 0x7fd8f00cd2a0 2022-11-27T16:34:13.907 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.894+0000 7fd8ed7fa700 1 -- 172.21.15.55:0/367126747 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fd8e801bd50 con 0x7fd8f00cd2a0 2022-11-27T16:34:13.907 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.895+0000 7fd8f6b64700 1 -- 172.21.15.55:0/367126747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f0068b70 con 0x7fd8f00cd2a0 2022-11-27T16:34:13.908 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.897+0000 7fd8ed7fa700 1 -- 172.21.15.55:0/367126747 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71351 (secure 0 0 0) 0x7fd8e80123f0 con 0x7fd8f00cd2a0 2022-11-27T16:34:13.952 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:13.949+0000 7f3ffc10a200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-11-27T16:34:13.985 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.983+0000 7fd8f6b64700 1 -- 172.21.15.55:0/367126747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd new", "uuid": "de3bdb57-3fc0-4353-a4cf-394d28ed0404", "id": 4} v 0) v1 -- 0x7fd8f00af890 con 0x7fd8f00cd2a0 2022-11-27T16:34:13.988 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.986+0000 7fd8ed7fa700 1 -- 172.21.15.55:0/367126747 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "de3bdb57-3fc0-4353-a4cf-394d28ed0404", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd8e80256e0 con 0x7fd8f00cd2a0 2022-11-27T16:34:13.989 INFO:teuthology.orchestra.run.smithi055.stdout:4 2022-11-27T16:34:13.990 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.987+0000 7fd8f6b64700 1 -- 172.21.15.55:0/367126747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8f00cd2a0 msgr2=0x7fd8f00cefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:13.991 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.987+0000 7fd8f6b64700 1 --2- 172.21.15.55:0/367126747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8f00cd2a0 0x7fd8f00cefc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd8f006fd50 tx=0x7fd8e8004ad0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.991 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.987+0000 7fd8f6b64700 1 -- 172.21.15.55:0/367126747 shutdown_connections 2022-11-27T16:34:13.991 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.987+0000 7fd8f6b64700 1 --2- 172.21.15.55:0/367126747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8f00cd2a0 0x7fd8f00cefc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.992 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.987+0000 7fd8f6b64700 1 --2- 172.21.15.55:0/367126747 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8f00b2950 0x7fd8f0146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.992 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.987+0000 7fd8f6b64700 1 --2- 172.21.15.55:0/367126747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8f00b5a60 0x7fd8f00c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:13.992 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.987+0000 7fd8f6b64700 1 -- 172.21.15.55:0/367126747 >> 172.21.15.55:0/367126747 conn(0x7fd8f0064ec0 msgr2=0x7fd8f00ce420 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:13.993 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.987+0000 7fd8f6b64700 1 -- 172.21.15.55:0/367126747 shutdown_connections 2022-11-27T16:34:13.993 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:13.987+0000 7fd8f6b64700 1 -- 172.21.15.55:0/367126747 wait complete. 2022-11-27T16:34:14.001 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new 8eb1bfed-50ab-408d-8908-9f855f49a683 5 2022-11-27T16:34:14.036 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:14.033+0000 7f3ffc10a200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-11-27T16:34:14.125 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.123+0000 7f4810f6a700 1 Processor -- start 2022-11-27T16:34:14.125 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.123+0000 7f4810f6a700 1 -- start start 2022-11-27T16:34:14.128 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.124+0000 7f4810f6a700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f480c0cd890 0x7f480c0c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.129 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.125+0000 7f4810f6a700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f480c0cb760 0x7f480c0ca230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.129 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.125+0000 7f4810f6a700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f480c0c9880 con 0x7f480c0b12c0 2022-11-27T16:34:14.129 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.125+0000 7f4810f6a700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f480c15d690 con 0x7f480c0cd890 2022-11-27T16:34:14.129 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.125+0000 7f4810f6a700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480c15cb10 con 0x7f480c0cb760 2022-11-27T16:34:14.130 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.125+0000 7f4809d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f480c0cd890 0x7f480c0c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:14.130 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.125+0000 7f480ad9d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f480c0cb760 0x7f480c0ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:14.130 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.125+0000 7f4809d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f480c0cd890 0x7f480c0c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58094/0 (socket says 172.21.15.55:58094) 2022-11-27T16:34:14.130 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.125+0000 7f4809d9b700 1 -- 172.21.15.55:0/251360872 learned_addr learned my addr 172.21.15.55:0/251360872 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-11-27T16:34:14.131 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.125+0000 7f4809d9b700 1 -- 172.21.15.55:0/251360872 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f480c0cb760 msgr2=0x7f480c0ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:14.131 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.125+0000 7f4809d9b700 1 --2- 172.21.15.55:0/251360872 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f480c0cb760 0x7f480c0ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.131 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.125+0000 7f4809d9b700 1 -- 172.21.15.55:0/251360872 >> v1:172.21.15.6:6789/0 conn(0x7f480c0b12c0 legacy=0x7f480c0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.131 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.125+0000 7f480959a700 1 -- 172.21.15.55:0/251360872 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705832010 0 0) 0x7f480c0c9880 con 0x7f480c0b12c0 2022-11-27T16:34:14.131 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.125+0000 7f4809d9b700 1 -- 172.21.15.55:0/251360872 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480c15cdf0 con 0x7f480c0cd890 2022-11-27T16:34:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.125+0000 7f4809d9b700 1 --2- 172.21.15.55:0/251360872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f480c0cd890 0x7f480c0c9cf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f48000098f0 tx=0x7f4800009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0d3ecf56f8a68c server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.125+0000 7f480959a700 1 -- 172.21.15.55:0/251360872 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480000f8a0 con 0x7f480c0cd890 2022-11-27T16:34:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.125+0000 7f480959a700 1 -- 172.21.15.55:0/251360872 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480000fa00 con 0x7f480c0cd890 2022-11-27T16:34:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.125+0000 7f480959a700 1 -- 172.21.15.55:0/251360872 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480000fd90 con 0x7f480c0cd890 2022-11-27T16:34:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.126+0000 7f4810f6a700 1 -- 172.21.15.55:0/251360872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f480c0cd890 msgr2=0x7f480c0c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.126+0000 7f4810f6a700 1 --2- 172.21.15.55:0/251360872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f480c0cd890 0x7f480c0c9cf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f48000098f0 tx=0x7f4800009c00 comp rx=0 tx=0).stop 2022-11-27T16:34:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.126+0000 7f4810f6a700 1 -- 172.21.15.55:0/251360872 shutdown_connections 2022-11-27T16:34:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.126+0000 7f4810f6a700 1 --2- 172.21.15.55:0/251360872 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f480c0cb760 0x7f480c0ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.126+0000 7f4810f6a700 1 --2- 172.21.15.55:0/251360872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f480c0cd890 0x7f480c0c9cf0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.126+0000 7f4810f6a700 1 -- 172.21.15.55:0/251360872 >> 172.21.15.55:0/251360872 conn(0x7f480c0cbc00 msgr2=0x7f480c0cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.126+0000 7f4810f6a700 1 -- 172.21.15.55:0/251360872 shutdown_connections 2022-11-27T16:34:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.126+0000 7f4810f6a700 1 -- 172.21.15.55:0/251360872 wait complete. 2022-11-27T16:34:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.129+0000 7f4810f6a700 1 Processor -- start 2022-11-27T16:34:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.129+0000 7f4810f6a700 1 -- start start 2022-11-27T16:34:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.130+0000 7f4810f6a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f480c0b12c0 0x7f480c0b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.130+0000 7f4810f6a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f480c0cb760 0x7f480c1ed290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.130+0000 7f4810f6a700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f480c0cd890 0x7f480c0c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.130+0000 7f4810f6a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c0b1fb0 con 0x7f480c0b12c0 2022-11-27T16:34:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.130+0000 7f4810f6a700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c1ee230 con 0x7f480c0cb760 2022-11-27T16:34:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.130+0000 7f4810f6a700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480c0c8150 con 0x7f480c0cd890 2022-11-27T16:34:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.130+0000 7f4809d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f480c0cb760 0x7f480c1ed290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:14.141 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.130+0000 7f480ad9d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f480c0cd890 0x7f480c0c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:14.141 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.130+0000 7f4809d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f480c0cb760 0x7f480c1ed290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58100/0 (socket says 172.21.15.55:58100) 2022-11-27T16:34:14.141 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.130+0000 7f480a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f480c0b12c0 0x7f480c0b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:14.142 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.130+0000 7f480ad9d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f480c0cd890 0x7f480c0c7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:41882/0 (socket says 172.21.15.55:41882) 2022-11-27T16:34:14.142 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.130+0000 7f4809d9b700 1 -- 172.21.15.55:0/3661712366 learned_addr learned my addr 172.21.15.55:0/3661712366 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-11-27T16:34:14.142 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.130+0000 7f480ad9d700 1 -- 172.21.15.55:0/3661712366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f480c0cb760 msgr2=0x7f480c1ed290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.130+0000 7f480ad9d700 1 --2- 172.21.15.55:0/3661712366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f480c0cb760 0x7f480c1ed290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.130+0000 7f480ad9d700 1 -- 172.21.15.55:0/3661712366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f480c0b12c0 msgr2=0x7f480c0b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.130+0000 7f480ad9d700 1 --2- 172.21.15.55:0/3661712366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f480c0b12c0 0x7f480c0b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.130+0000 7f480ad9d700 1 -- 172.21.15.55:0/3661712366 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4800009550 con 0x7f480c0cd890 2022-11-27T16:34:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.130+0000 7f480ad9d700 1 --2- 172.21.15.55:0/3661712366 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f480c0cd890 0x7f480c0c7c10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f480400ef90 tx=0x7f480400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.131+0000 7f47faffd700 1 -- 172.21.15.55:0/3661712366 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480400cc90 con 0x7f480c0cd890 2022-11-27T16:34:14.145 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.131+0000 7f47faffd700 1 -- 172.21.15.55:0/3661712366 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480400f040 con 0x7f480c0cd890 2022-11-27T16:34:14.145 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.131+0000 7f4810f6a700 1 -- 172.21.15.55:0/3661712366 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480c1ed990 con 0x7f480c0cd890 2022-11-27T16:34:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.131+0000 7f47faffd700 1 -- 172.21.15.55:0/3661712366 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48040146c0 con 0x7f480c0cd890 2022-11-27T16:34:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.131+0000 7f4810f6a700 1 -- 172.21.15.55:0/3661712366 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480c1edf50 con 0x7f480c0cd890 2022-11-27T16:34:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.131+0000 7f47faffd700 1 -- 172.21.15.55:0/3661712366 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f4804014820 con 0x7f480c0cd890 2022-11-27T16:34:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.131+0000 7f47faffd700 1 -- 172.21.15.55:0/3661712366 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f480401dba0 con 0x7f480c0cd890 2022-11-27T16:34:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.132+0000 7f4810f6a700 1 -- 172.21.15.55:0/3661712366 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f480c0ae620 con 0x7f480c0cd890 2022-11-27T16:34:14.147 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.134+0000 7f47faffd700 1 -- 172.21.15.55:0/3661712366 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71351 (secure 0 0 0) 0x7f480403b6d0 con 0x7f480c0cd890 2022-11-27T16:34:14.244 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.242+0000 7f4810f6a700 1 -- 172.21.15.55:0/3661712366 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8eb1bfed-50ab-408d-8908-9f855f49a683", "id": 5} v 0) v1 -- 0x7f480c068b70 con 0x7f480c0cd890 2022-11-27T16:34:14.251 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.249+0000 7f47faffd700 1 -- 172.21.15.55:0/3661712366 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8eb1bfed-50ab-408d-8908-9f855f49a683", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f480402a070 con 0x7f480c0cd890 2022-11-27T16:34:14.252 INFO:teuthology.orchestra.run.smithi055.stdout:5 2022-11-27T16:34:14.253 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.251+0000 7f4810f6a700 1 -- 172.21.15.55:0/3661712366 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f480c0cd890 msgr2=0x7f480c0c7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.254 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.251+0000 7f4810f6a700 1 --2- 172.21.15.55:0/3661712366 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f480c0cd890 0x7f480c0c7c10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f480400ef90 tx=0x7f480400c3a0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.254 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.251+0000 7f4810f6a700 1 -- 172.21.15.55:0/3661712366 shutdown_connections 2022-11-27T16:34:14.255 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.251+0000 7f4810f6a700 1 --2- 172.21.15.55:0/3661712366 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f480c0cd890 0x7f480c0c7c10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.255 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.251+0000 7f4810f6a700 1 --2- 172.21.15.55:0/3661712366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f480c0b12c0 0x7f480c0b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.256 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.251+0000 7f4810f6a700 1 --2- 172.21.15.55:0/3661712366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f480c0cb760 0x7f480c1ed290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.256 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.251+0000 7f4810f6a700 1 -- 172.21.15.55:0/3661712366 >> 172.21.15.55:0/3661712366 conn(0x7f480c0cbc00 msgr2=0x7f480c1586d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:14.257 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.251+0000 7f4810f6a700 1 -- 172.21.15.55:0/3661712366 shutdown_connections 2022-11-27T16:34:14.257 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.251+0000 7f4810f6a700 1 -- 172.21.15.55:0/3661712366 wait complete. 2022-11-27T16:34:14.274 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new be781377-2ff8-4b5c-8ce8-5cde163b4956 6 2022-11-27T16:34:14.402 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.399+0000 7f1112ff6700 1 Processor -- start 2022-11-27T16:34:14.402 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.399+0000 7f1112ff6700 1 -- start start 2022-11-27T16:34:14.405 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.400+0000 7f1112ff6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f110c0cb6d0 0x7f110c0ae680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.405 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.400+0000 7f1112ff6700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110c0cb240 con 0x7f110c159ca0 2022-11-27T16:34:14.406 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.400+0000 7f1112ff6700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110c0ca950 con 0x7f110c069570 2022-11-27T16:34:14.406 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.400+0000 7f1112ff6700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110c15e770 con 0x7f110c0cb6d0 2022-11-27T16:34:14.406 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.400+0000 7f110bfff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f110c069570 0x7f110c0ccd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54544/0 (socket says 172.21.15.55:54544) 2022-11-27T16:34:14.406 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.400+0000 7f110bfff700 1 -- 172.21.15.55:0/1871520747 learned_addr learned my addr 172.21.15.55:0/1871520747 (peer_addr_for_me v1:172.21.15.55:0/0) 2022-11-27T16:34:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.400+0000 7f1111593700 1 --2- 172.21.15.55:0/1871520747 >> v2:172.21.15.55:3300/0 conn(0x7f110c0cb6d0 0x7f110c0ae680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.401+0000 7f110b7fe700 1 -- 172.21.15.55:0/1871520747 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120999714 0 0) 0x7f110c0ca950 con 0x7f110c069570 2022-11-27T16:34:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.401+0000 7f110b7fe700 1 -- 172.21.15.55:0/1871520747 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10f00035b0 con 0x7f110c069570 2022-11-27T16:34:14.407 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.401+0000 7f110b7fe700 1 -- 172.21.15.55:0/1871520747 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876883681 0 0) 0x7f110c0cb240 con 0x7f110c159ca0 2022-11-27T16:34:14.408 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.401+0000 7f110b7fe700 1 -- 172.21.15.55:0/1871520747 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f110c0ca950 con 0x7f110c159ca0 2022-11-27T16:34:14.408 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.401+0000 7f1111593700 1 -- 172.21.15.55:0/1871520747 >> v1:172.21.15.55:6789/0 conn(0x7f110c069570 legacy=0x7f110c0ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.408 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.401+0000 7f1111593700 1 -- 172.21.15.55:0/1871520747 >> v1:172.21.15.6:6789/0 conn(0x7f110c159ca0 legacy=0x7f110c068e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.408 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.401+0000 7f1111593700 1 -- 172.21.15.55:0/1871520747 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c15a070 con 0x7f110c0cb6d0 2022-11-27T16:34:14.408 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.401+0000 7f1111593700 1 --2- 172.21.15.55:0/1871520747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f110c0cb6d0 0x7f110c0ae680 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1104009d90 tx=0x7f110400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8a4ec2f0c887c46e server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:14.409 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.401+0000 7f110b7fe700 1 -- 172.21.15.55:0/1871520747 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110400e070 con 0x7f110c0cb6d0 2022-11-27T16:34:14.409 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.401+0000 7f110b7fe700 1 -- 172.21.15.55:0/1871520747 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110400bb20 con 0x7f110c0cb6d0 2022-11-27T16:34:14.409 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.401+0000 7f110b7fe700 1 -- 172.21.15.55:0/1871520747 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104012430 con 0x7f110c0cb6d0 2022-11-27T16:34:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.402+0000 7f1112ff6700 1 -- 172.21.15.55:0/1871520747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f110c0cb6d0 msgr2=0x7f110c0ae680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.402+0000 7f1112ff6700 1 --2- 172.21.15.55:0/1871520747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f110c0cb6d0 0x7f110c0ae680 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1104009d90 tx=0x7f110400b330 comp rx=0 tx=0).stop 2022-11-27T16:34:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.402+0000 7f1112ff6700 1 -- 172.21.15.55:0/1871520747 shutdown_connections 2022-11-27T16:34:14.410 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.402+0000 7f1112ff6700 1 --2- 172.21.15.55:0/1871520747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f110c0cb6d0 0x7f110c0ae680 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.411 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.402+0000 7f1112ff6700 1 -- 172.21.15.55:0/1871520747 >> 172.21.15.55:0/1871520747 conn(0x7f110c0cbc00 msgr2=0x7f110c0cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:14.411 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.402+0000 7f1112ff6700 1 -- 172.21.15.55:0/1871520747 shutdown_connections 2022-11-27T16:34:14.411 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.402+0000 7f1112ff6700 1 -- 172.21.15.55:0/1871520747 wait complete. 2022-11-27T16:34:14.415 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.404+0000 7f1112ff6700 1 Processor -- start 2022-11-27T16:34:14.415 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.404+0000 7f1112ff6700 1 -- start start 2022-11-27T16:34:14.416 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.405+0000 7f1112ff6700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f110c069570 0x7f110c0c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.416 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.405+0000 7f1112ff6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110c0cb6d0 0x7f110c1f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.416 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.405+0000 7f1112ff6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f110c159ca0 0x7f110c0c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.417 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.405+0000 7f1112ff6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c06c6a0 con 0x7f110c0cb6d0 2022-11-27T16:34:14.417 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.405+0000 7f1112ff6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c06c070 con 0x7f110c159ca0 2022-11-27T16:34:14.417 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.405+0000 7f1112ff6700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110c1f2030 con 0x7f110c069570 2022-11-27T16:34:14.418 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.405+0000 7f1111593700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f110c159ca0 0x7f110c0c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:14.418 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.405+0000 7f1110d92700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f110c069570 0x7f110c0c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:14.418 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.405+0000 7f1111593700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f110c159ca0 0x7f110c0c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58114/0 (socket says 172.21.15.55:58114) 2022-11-27T16:34:14.419 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.405+0000 7f1110d92700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f110c069570 0x7f110c0c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:41892/0 (socket says 172.21.15.55:41892) 2022-11-27T16:34:14.419 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.405+0000 7f1111593700 1 -- 172.21.15.55:0/3645448924 learned_addr learned my addr 172.21.15.55:0/3645448924 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-11-27T16:34:14.419 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.406+0000 7f110bfff700 1 --2- 172.21.15.55:0/3645448924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110c0cb6d0 0x7f110c1f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:14.420 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.406+0000 7f1111593700 1 -- 172.21.15.55:0/3645448924 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f110c069570 msgr2=0x7f110c0c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.420 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.406+0000 7f1111593700 1 --2- 172.21.15.55:0/3645448924 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f110c069570 0x7f110c0c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.420 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.406+0000 7f1111593700 1 -- 172.21.15.55:0/3645448924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110c0cb6d0 msgr2=0x7f110c1f1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.420 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.406+0000 7f1111593700 1 --2- 172.21.15.55:0/3645448924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110c0cb6d0 0x7f110c1f1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.421 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.406+0000 7f1111593700 1 -- 172.21.15.55:0/3645448924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1104009a70 con 0x7f110c159ca0 2022-11-27T16:34:14.421 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.406+0000 7f1110d92700 1 --2- 172.21.15.55:0/3645448924 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f110c069570 0x7f110c0c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-11-27T16:34:14.421 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.406+0000 7f1111593700 1 --2- 172.21.15.55:0/3645448924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f110c159ca0 0x7f110c0c84e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f110c06fdd0 tx=0x7f1104004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:14.422 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.406+0000 7f11097fa700 1 -- 172.21.15.55:0/3645448924 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1104012430 con 0x7f110c159ca0 2022-11-27T16:34:14.422 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.406+0000 7f11097fa700 1 -- 172.21.15.55:0/3645448924 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1104020070 con 0x7f110c159ca0 2022-11-27T16:34:14.422 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.406+0000 7f1112ff6700 1 -- 172.21.15.55:0/3645448924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110c1f2310 con 0x7f110c159ca0 2022-11-27T16:34:14.422 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.406+0000 7f11097fa700 1 -- 172.21.15.55:0/3645448924 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110401ba50 con 0x7f110c159ca0 2022-11-27T16:34:14.422 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.406+0000 7f1112ff6700 1 -- 172.21.15.55:0/3645448924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110c0c2300 con 0x7f110c159ca0 2022-11-27T16:34:14.423 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.406+0000 7f11097fa700 1 -- 172.21.15.55:0/3645448924 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f1104027480 con 0x7f110c159ca0 2022-11-27T16:34:14.423 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.406+0000 7f11097fa700 1 -- 172.21.15.55:0/3645448924 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f1104022070 con 0x7f110c159ca0 2022-11-27T16:34:14.423 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.407+0000 7f1112ff6700 1 -- 172.21.15.55:0/3645448924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110c06c7e0 con 0x7f110c159ca0 2022-11-27T16:34:14.423 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.409+0000 7f11097fa700 1 -- 172.21.15.55:0/3645448924 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71351 (secure 0 0 0) 0x7f110c06c7e0 con 0x7f110c159ca0 2022-11-27T16:34:14.424 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:14.413+0000 7f714aa7a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-11-27T16:34:14.495 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:14.492+0000 7f3ffc10a200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-11-27T16:34:14.496 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.494+0000 7f1112ff6700 1 -- 172.21.15.55:0/3645448924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd new", "uuid": "be781377-2ff8-4b5c-8ce8-5cde163b4956", "id": 6} v 0) v1 -- 0x7f110c068b70 con 0x7f110c159ca0 2022-11-27T16:34:14.508 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.506+0000 7f11097fa700 1 -- 172.21.15.55:0/3645448924 <== mon.1 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be781377-2ff8-4b5c-8ce8-5cde163b4956", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1104027a20 con 0x7f110c159ca0 2022-11-27T16:34:14.508 INFO:teuthology.orchestra.run.smithi055.stdout:6 2022-11-27T16:34:14.510 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.507+0000 7f1112ff6700 1 -- 172.21.15.55:0/3645448924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f110c159ca0 msgr2=0x7f110c0c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.510 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.507+0000 7f1112ff6700 1 --2- 172.21.15.55:0/3645448924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f110c159ca0 0x7f110c0c84e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f110c06fdd0 tx=0x7f1104004ad0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.511 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.507+0000 7f1112ff6700 1 -- 172.21.15.55:0/3645448924 shutdown_connections 2022-11-27T16:34:14.511 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.507+0000 7f1112ff6700 1 --2- 172.21.15.55:0/3645448924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f110c159ca0 0x7f110c0c84e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.511 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.507+0000 7f1112ff6700 1 --2- 172.21.15.55:0/3645448924 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f110c069570 0x7f110c0c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.511 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.507+0000 7f1112ff6700 1 --2- 172.21.15.55:0/3645448924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f110c0cb6d0 0x7f110c1f1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.512 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.507+0000 7f1112ff6700 1 -- 172.21.15.55:0/3645448924 >> 172.21.15.55:0/3645448924 conn(0x7f110c0cbc00 msgr2=0x7f110c0ad870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:14.512 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.507+0000 7f1112ff6700 1 -- 172.21.15.55:0/3645448924 shutdown_connections 2022-11-27T16:34:14.512 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.507+0000 7f1112ff6700 1 -- 172.21.15.55:0/3645448924 wait complete. 2022-11-27T16:34:14.522 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd new 2940a706-2632-4794-8d6f-dc8df69cf11f 7 2022-11-27T16:34:14.577 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:14.575+0000 7f714aa7a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-11-27T16:34:14.646 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.644+0000 7f2e12226700 1 Processor -- start 2022-11-27T16:34:14.647 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.645+0000 7f2e12226700 1 -- start start 2022-11-27T16:34:14.650 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.645+0000 7f2e12226700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0c15be90 0x7f2e0c0cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.650 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.645+0000 7f2e12226700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e0c0ccde0 0x7f2e0c0cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.651 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.645+0000 7f2e12226700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0c0cf530 con 0x7f2e0c15bac0 2022-11-27T16:34:14.651 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.645+0000 7f2e12226700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0c0cd260 con 0x7f2e0c0ccde0 2022-11-27T16:34:14.651 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.645+0000 7f2e12226700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c06b910 con 0x7f2e0c15be90 2022-11-27T16:34:14.651 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.645+0000 7f2e0affd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0c15be90 0x7f2e0c0cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.645+0000 7f2e0bfff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e0c0ccde0 0x7f2e0c0cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.646+0000 7f2e0affd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0c15be90 0x7f2e0c0cc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:41898/0 (socket says 172.21.15.55:41898) 2022-11-27T16:34:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.646+0000 7f2e0bfff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e0c0ccde0 0x7f2e0c0cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58120/0 (socket says 172.21.15.55:58120) 2022-11-27T16:34:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.646+0000 7f2e0affd700 1 -- 172.21.15.55:0/372286754 learned_addr learned my addr 172.21.15.55:0/372286754 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-11-27T16:34:14.652 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.646+0000 7f2e0affd700 1 -- 172.21.15.55:0/372286754 >> v2:172.21.15.55:3300/0 conn(0x7f2e0c0ccde0 msgr2=0x7f2e0c0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:14.653 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.646+0000 7f2e0affd700 1 --2- 172.21.15.55:0/372286754 >> v2:172.21.15.55:3300/0 conn(0x7f2e0c0ccde0 0x7f2e0c0cfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.653 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.646+0000 7f2e0affd700 1 -- 172.21.15.55:0/372286754 >> v1:172.21.15.6:6789/0 conn(0x7f2e0c15bac0 legacy=0x7f2e0c06a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.653 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.646+0000 7f2e0affd700 1 -- 172.21.15.55:0/372286754 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c06bbf0 con 0x7f2e0c15be90 2022-11-27T16:34:14.653 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.646+0000 7f2e0bfff700 1 --2- 172.21.15.55:0/372286754 >> v2:172.21.15.55:3300/0 conn(0x7f2e0c0ccde0 0x7f2e0c0cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-11-27T16:34:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.646+0000 7f2e0affd700 1 --2- 172.21.15.55:0/372286754 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0c15be90 0x7f2e0c0cc8a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2e000098f0 tx=0x7f2e00009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f04588b4091168a0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.646+0000 7f2e0a7fc700 1 -- 172.21.15.55:0/372286754 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00011830 con 0x7f2e0c15be90 2022-11-27T16:34:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.646+0000 7f2e0a7fc700 1 -- 172.21.15.55:0/372286754 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e00011990 con 0x7f2e0c15be90 2022-11-27T16:34:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.646+0000 7f2e0a7fc700 1 -- 172.21.15.55:0/372286754 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e00011d20 con 0x7f2e0c15be90 2022-11-27T16:34:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.647+0000 7f2e12226700 1 -- 172.21.15.55:0/372286754 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0c15be90 msgr2=0x7f2e0c0cc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.655 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.647+0000 7f2e12226700 1 --2- 172.21.15.55:0/372286754 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0c15be90 0x7f2e0c0cc8a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2e000098f0 tx=0x7f2e00009c00 comp rx=0 tx=0).stop 2022-11-27T16:34:14.655 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.647+0000 7f2e12226700 1 -- 172.21.15.55:0/372286754 shutdown_connections 2022-11-27T16:34:14.655 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.647+0000 7f2e12226700 1 --2- 172.21.15.55:0/372286754 >> v2:172.21.15.55:3300/0 conn(0x7f2e0c0ccde0 0x7f2e0c0cfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.655 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.647+0000 7f2e12226700 1 --2- 172.21.15.55:0/372286754 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0c15be90 0x7f2e0c0cc8a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.647+0000 7f2e12226700 1 -- 172.21.15.55:0/372286754 >> 172.21.15.55:0/372286754 conn(0x7f2e0c064ec0 msgr2=0x7f2e0c065290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.647+0000 7f2e12226700 1 -- 172.21.15.55:0/372286754 shutdown_connections 2022-11-27T16:34:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.647+0000 7f2e12226700 1 -- 172.21.15.55:0/372286754 wait complete. 2022-11-27T16:34:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.648+0000 7f2e12226700 1 Processor -- start 2022-11-27T16:34:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.648+0000 7f2e12226700 1 -- start start 2022-11-27T16:34:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.649+0000 7f2e12226700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0c0ccde0 0x7f2e0c1e3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.649+0000 7f2e12226700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e0c15bac0 0x7f2e0c1f15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.649+0000 7f2e12226700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e0c15be90 0x7f2e0c1f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.649+0000 7f2e12226700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c0c4ec0 con 0x7f2e0c15be90 2022-11-27T16:34:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.649+0000 7f2e12226700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c1e48f0 con 0x7f2e0c15bac0 2022-11-27T16:34:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.649+0000 7f2e12226700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c1e4bd0 con 0x7f2e0c0ccde0 2022-11-27T16:34:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.649+0000 7f2e0b7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0c0ccde0 0x7f2e0c1e3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.649+0000 7f2e0affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e0c15bac0 0x7f2e0c1f15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.649+0000 7f2e0b7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0c0ccde0 0x7f2e0c1e3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:41902/0 (socket says 172.21.15.55:41902) 2022-11-27T16:34:14.661 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.649+0000 7f2e0b7fe700 1 -- 172.21.15.55:0/2467587255 learned_addr learned my addr 172.21.15.55:0/2467587255 (peer_addr_for_me v2:172.21.15.55:0/0) 2022-11-27T16:34:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.649+0000 7f2e0bfff700 1 --2- 172.21.15.55:0/2467587255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e0c15be90 0x7f2e0c1f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.650+0000 7f2e0b7fe700 1 -- 172.21.15.55:0/2467587255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e0c15bac0 msgr2=0x7f2e0c1f15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.650+0000 7f2e0b7fe700 1 --2- 172.21.15.55:0/2467587255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e0c15bac0 0x7f2e0c1f15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.650+0000 7f2e0b7fe700 1 -- 172.21.15.55:0/2467587255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e0c15be90 msgr2=0x7f2e0c1f1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.662 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.650+0000 7f2e0b7fe700 1 --2- 172.21.15.55:0/2467587255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e0c15be90 0x7f2e0c1f1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.650+0000 7f2e0b7fe700 1 -- 172.21.15.55:0/2467587255 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e04009a70 con 0x7f2e0c0ccde0 2022-11-27T16:34:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.650+0000 7f2e0affd700 1 --2- 172.21.15.55:0/2467587255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e0c15bac0 0x7f2e0c1f15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-11-27T16:34:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.650+0000 7f2e0b7fe700 1 --2- 172.21.15.55:0/2467587255 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0c0ccde0 0x7f2e0c1e3f30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00c4e0 tx=0x7f2dfc00c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.650+0000 7f2df3fff700 1 -- 172.21.15.55:0/2467587255 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0052d0 con 0x7f2e0c0ccde0 2022-11-27T16:34:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.650+0000 7f2df3fff700 1 -- 172.21.15.55:0/2467587255 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc005430 con 0x7f2e0c0ccde0 2022-11-27T16:34:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.650+0000 7f2e12226700 1 -- 172.21.15.55:0/2467587255 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e00009550 con 0x7f2e0c0ccde0 2022-11-27T16:34:14.665 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.650+0000 7f2df3fff700 1 -- 172.21.15.55:0/2467587255 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc0038c0 con 0x7f2e0c0ccde0 2022-11-27T16:34:14.665 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.650+0000 7f2e12226700 1 -- 172.21.15.55:0/2467587255 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0c0c5440 con 0x7f2e0c0ccde0 2022-11-27T16:34:14.665 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.651+0000 7f2df3fff700 1 -- 172.21.15.55:0/2467587255 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f2dfc019030 con 0x7f2e0c0ccde0 2022-11-27T16:34:14.665 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.651+0000 7f2df3fff700 1 -- 172.21.15.55:0/2467587255 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f2dfc011e20 con 0x7f2e0c0ccde0 2022-11-27T16:34:14.666 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.651+0000 7f2e12226700 1 -- 172.21.15.55:0/2467587255 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e0c068b70 con 0x7f2e0c0ccde0 2022-11-27T16:34:14.666 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.653+0000 7f2df3fff700 1 -- 172.21.15.55:0/2467587255 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71351 (secure 0 0 0) 0x7f2dfc017070 con 0x7f2e0c0ccde0 2022-11-27T16:34:14.739 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.737+0000 7f2e12226700 1 -- 172.21.15.55:0/2467587255 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2940a706-2632-4794-8d6f-dc8df69cf11f", "id": 7} v 0) v1 -- 0x7f2e0c0cf7a0 con 0x7f2e0c0ccde0 2022-11-27T16:34:14.744 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.743+0000 7f2df3fff700 1 -- 172.21.15.55:0/2467587255 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2940a706-2632-4794-8d6f-dc8df69cf11f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2dfc003a20 con 0x7f2e0c0ccde0 2022-11-27T16:34:14.745 INFO:teuthology.orchestra.run.smithi055.stdout:7 2022-11-27T16:34:14.746 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.744+0000 7f2e12226700 1 -- 172.21.15.55:0/2467587255 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0c0ccde0 msgr2=0x7f2e0c1e3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.747 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.744+0000 7f2e12226700 1 --2- 172.21.15.55:0/2467587255 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0c0ccde0 0x7f2e0c1e3f30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc00c4e0 tx=0x7f2dfc00c7f0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.747 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.744+0000 7f2e12226700 1 -- 172.21.15.55:0/2467587255 shutdown_connections 2022-11-27T16:34:14.747 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.744+0000 7f2e12226700 1 --2- 172.21.15.55:0/2467587255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e0c15be90 0x7f2e0c1f1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.747 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.744+0000 7f2e12226700 1 --2- 172.21.15.55:0/2467587255 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e0c0ccde0 0x7f2e0c1e3f30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.748 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.744+0000 7f2e12226700 1 --2- 172.21.15.55:0/2467587255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e0c15bac0 0x7f2e0c1f15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.748 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.744+0000 7f2e12226700 1 -- 172.21.15.55:0/2467587255 >> 172.21.15.55:0/2467587255 conn(0x7f2e0c064ec0 msgr2=0x7f2e0c15adb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:14.748 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.744+0000 7f2e12226700 1 -- 172.21.15.55:0/2467587255 shutdown_connections 2022-11-27T16:34:14.749 INFO:teuthology.orchestra.run.smithi055.stderr:2022-11-27T16:34:14.744+0000 7f2e12226700 1 -- 172.21.15.55:0/2467587255 wait complete. 2022-11-27T16:34:14.758 INFO:tasks.ceph.osd.0:Restarting daemon 2022-11-27T16:34:14.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-11-27T16:34:14.761 INFO:tasks.ceph.osd.0:Started 2022-11-27T16:34:14.761 INFO:tasks.ceph.osd.1:Restarting daemon 2022-11-27T16:34:14.762 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-11-27T16:34:14.764 INFO:tasks.ceph.osd.1:Started 2022-11-27T16:34:14.764 INFO:tasks.ceph.osd.2:Restarting daemon 2022-11-27T16:34:14.765 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-11-27T16:34:14.767 INFO:tasks.ceph.osd.2:Started 2022-11-27T16:34:14.768 INFO:tasks.ceph.osd.3:Restarting daemon 2022-11-27T16:34:14.768 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-11-27T16:34:14.770 INFO:tasks.ceph.osd.3:Started 2022-11-27T16:34:14.771 INFO:tasks.ceph.osd.4:Restarting daemon 2022-11-27T16:34:14.771 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2022-11-27T16:34:14.774 INFO:tasks.ceph.osd.4:Started 2022-11-27T16:34:14.774 INFO:tasks.ceph.osd.5:Restarting daemon 2022-11-27T16:34:14.775 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2022-11-27T16:34:14.777 INFO:tasks.ceph.osd.5:Started 2022-11-27T16:34:14.777 INFO:tasks.ceph.osd.6:Restarting daemon 2022-11-27T16:34:14.778 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2022-11-27T16:34:14.780 INFO:tasks.ceph.osd.6:Started 2022-11-27T16:34:14.780 INFO:tasks.ceph.osd.7:Restarting daemon 2022-11-27T16:34:14.781 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2022-11-27T16:34:14.783 INFO:tasks.ceph.osd.7:Started 2022-11-27T16:34:14.784 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-11-27T16:34:14.980 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.978+0000 7f131d9b1700 1 Processor -- start 2022-11-27T16:34:14.981 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.978+0000 7f131d9b1700 1 -- start start 2022-11-27T16:34:14.983 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.979+0000 7f131d9b1700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1310036770 0x7f1310007b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.983 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.979+0000 7f131d9b1700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13100566b0 0x7f13100e4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.984 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.979+0000 7f131d9b1700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1310035ef0 con 0x7f13100363a0 2022-11-27T16:34:14.984 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.979+0000 7f131d9b1700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1310009290 con 0x7f13100566b0 2022-11-27T16:34:14.984 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.979+0000 7f131d9b1700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1310035090 con 0x7f1310036770 2022-11-27T16:34:14.984 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.980+0000 7f1317fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1310036770 0x7f1310007b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:14.985 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.980+0000 7f131d1b0700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f13100566b0 0x7f13100e4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:14.985 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.980+0000 7f1317fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1310036770 0x7f1310007b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.6:47630/0 (socket says 172.21.15.6:47630) 2022-11-27T16:34:14.985 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.980+0000 7f1317fff700 1 -- 172.21.15.6:0/1743323486 learned_addr learned my addr 172.21.15.6:0/1743323486 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:14.985 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.980+0000 7f1317fff700 1 -- 172.21.15.6:0/1743323486 >> v2:172.21.15.6:3300/0 conn(0x7f13100566b0 msgr2=0x7f13100e4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:14.986 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.980+0000 7f1317fff700 1 --2- 172.21.15.6:0/1743323486 >> v2:172.21.15.6:3300/0 conn(0x7f13100566b0 0x7f13100e4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.986 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.980+0000 7f1317fff700 1 -- 172.21.15.6:0/1743323486 >> v1:172.21.15.55:6789/0 conn(0x7f13100363a0 legacy=0x7f1310007450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.986 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.980+0000 7f1317fff700 1 -- 172.21.15.6:0/1743323486 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1310009040 con 0x7f1310036770 2022-11-27T16:34:14.986 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.980+0000 7f131d1b0700 1 --2- 172.21.15.6:0/1743323486 >> v2:172.21.15.6:3300/0 conn(0x7f13100566b0 0x7f13100e4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-11-27T16:34:14.986 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.980+0000 7f1317fff700 1 --2- 172.21.15.6:0/1743323486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1310036770 0x7f1310007b60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f13040098f0 tx=0x7f1304009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1421f40931b1bd8d server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:14.987 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.981+0000 7f13177fe700 1 -- 172.21.15.6:0/1743323486 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304011830 con 0x7f1310036770 2022-11-27T16:34:14.987 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.981+0000 7f13177fe700 1 -- 172.21.15.6:0/1743323486 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1304011990 con 0x7f1310036770 2022-11-27T16:34:14.987 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.981+0000 7f13177fe700 1 -- 172.21.15.6:0/1743323486 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304011d20 con 0x7f1310036770 2022-11-27T16:34:14.991 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.982+0000 7f131d9b1700 1 -- 172.21.15.6:0/1743323486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1310036770 msgr2=0x7f1310007b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.991 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.982+0000 7f131d9b1700 1 --2- 172.21.15.6:0/1743323486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1310036770 0x7f1310007b60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f13040098f0 tx=0x7f1304009c00 comp rx=0 tx=0).stop 2022-11-27T16:34:14.991 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.982+0000 7f131d9b1700 1 -- 172.21.15.6:0/1743323486 shutdown_connections 2022-11-27T16:34:14.992 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.982+0000 7f131d9b1700 1 --2- 172.21.15.6:0/1743323486 >> v2:172.21.15.6:3300/0 conn(0x7f13100566b0 0x7f13100e4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.992 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.982+0000 7f131d9b1700 1 --2- 172.21.15.6:0/1743323486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1310036770 0x7f1310007b60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.993 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.982+0000 7f131d9b1700 1 -- 172.21.15.6:0/1743323486 >> 172.21.15.6:0/1743323486 conn(0x7f1310039820 msgr2=0x7f1310055cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:14.993 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.982+0000 7f131d9b1700 1 -- 172.21.15.6:0/1743323486 shutdown_connections 2022-11-27T16:34:14.993 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.982+0000 7f131d9b1700 1 -- 172.21.15.6:0/1743323486 wait complete. 2022-11-27T16:34:14.993 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.984+0000 7f131d9b1700 1 Processor -- start 2022-11-27T16:34:14.994 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.985+0000 7f131d9b1700 1 -- start start 2022-11-27T16:34:14.994 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.987+0000 7f131d9b1700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f13100363a0 0x7f1310020410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.995 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.987+0000 7f131d9b1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1310036770 0x7f13100d68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.995 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.987+0000 7f131d9b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13100566b0 0x7f1310033fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:14.995 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.987+0000 7f131d9b1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13100d7890 con 0x7f13100566b0 2022-11-27T16:34:14.996 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.987+0000 7f131d9b1700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1310021c60 con 0x7f1310036770 2022-11-27T16:34:14.996 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.987+0000 7f131d9b1700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13100d72d0 con 0x7f13100363a0 2022-11-27T16:34:14.996 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.987+0000 7f1317fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1310036770 0x7f13100d68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:14.996 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.988+0000 7f1317fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1310036770 0x7f13100d68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.6:50762/0 (socket says 172.21.15.6:50762) 2022-11-27T16:34:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.988+0000 7f1317fff700 1 -- 172.21.15.6:0/37666774 learned_addr learned my addr 172.21.15.6:0/37666774 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.988+0000 7f131d1b0700 1 --2- 172.21.15.6:0/37666774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13100566b0 0x7f1310033fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.988+0000 7f1317fff700 1 -- 172.21.15.6:0/37666774 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f13100363a0 msgr2=0x7f1310020410 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-11-27T16:34:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.988+0000 7f1317fff700 1 --2- 172.21.15.6:0/37666774 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f13100363a0 0x7f1310020410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.997 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.988+0000 7f1317fff700 1 -- 172.21.15.6:0/37666774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13100566b0 msgr2=0x7f1310033fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.988+0000 7f1317fff700 1 --2- 172.21.15.6:0/37666774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13100566b0 0x7f1310033fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.988+0000 7f1317fff700 1 -- 172.21.15.6:0/37666774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131804e770 con 0x7f1310036770 2022-11-27T16:34:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.988+0000 7f131d1b0700 1 --2- 172.21.15.6:0/37666774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13100566b0 0x7f1310033fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-11-27T16:34:14.998 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.988+0000 7f1317fff700 1 --2- 172.21.15.6:0/37666774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1310036770 0x7f13100d68f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1304014040 tx=0x7f1304004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:14.999 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.988+0000 7f13157fa700 1 -- 172.21.15.6:0/37666774 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13040038a0 con 0x7f1310036770 2022-11-27T16:34:14.999 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.988+0000 7f13157fa700 1 -- 172.21.15.6:0/37666774 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f130401e070 con 0x7f1310036770 2022-11-27T16:34:14.999 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.988+0000 7f13157fa700 1 -- 172.21.15.6:0/37666774 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1304003c00 con 0x7f1310036770 2022-11-27T16:34:15.000 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.989+0000 7f131d9b1700 1 -- 172.21.15.6:0/37666774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1304009550 con 0x7f1310036770 2022-11-27T16:34:15.001 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.989+0000 7f131d9b1700 1 -- 172.21.15.6:0/37666774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1310021f00 con 0x7f1310036770 2022-11-27T16:34:15.001 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.991+0000 7f13157fa700 1 -- 172.21.15.6:0/37666774 <== mon.1 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f130400f050 con 0x7f1310036770 2022-11-27T16:34:15.002 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.991+0000 7f13157fa700 1 -- 172.21.15.6:0/37666774 <== mon.1 v2:172.21.15.55:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f1304004580 con 0x7f1310036770 2022-11-27T16:34:15.002 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.991+0000 7f12faffd700 1 -- 172.21.15.6:0/37666774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ec0052f0 con 0x7f1310036770 2022-11-27T16:34:15.002 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:14.993+0000 7f13157fa700 1 -- 172.21.15.6:0/37666774 <== mon.1 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71351 (secure 0 0 0) 0x7f1304032060 con 0x7f1310036770 2022-11-27T16:34:15.066 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:15.063+0000 7f12faffd700 1 -- 172.21.15.6:0/37666774 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f12ec005870 con 0x7f1310036770 2022-11-27T16:34:15.067 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:15.064+0000 7f13157fa700 1 -- 172.21.15.6:0/37666774 <== mon.1 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7011 (secure 0 0 0) 0x7f1304020070 con 0x7f1310036770 2022-11-27T16:34:15.067 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:34:15.068 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"fsid":"993fccdc-c4ec-45c7-83f5-38e6210b61dd","created":"2022-11-27T16:34:12.138951+0000","modified":"2022-11-27T16:34:14.739276+0000","last_up_change":"0.000000","last_in_change":"2022-11-27T16:34:14.739276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"a1c510ff-24f3-497e-823f-73d31df5e534","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"01055301-2278-4c5b-9963-8787137b7db9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d523a914-8041-42f7-a369-33e54681eb9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d981890c-4dc6-4292-89f8-a11a3b529962","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"de3bdb57-3fc0-4353-a4cf-394d28ed0404","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8eb1bfed-50ab-408d-8908-9f855f49a683","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"be781377-2ff8-4b5c-8ce8-5cde163b4956","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2940a706-2632-4794-8d6f-dc8df69cf11f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-11-27T16:34:15.069 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:15.065+0000 7f12faffd700 1 -- 172.21.15.6:0/37666774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1310036770 msgr2=0x7f13100d68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:15.069 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:15.065+0000 7f12faffd700 1 --2- 172.21.15.6:0/37666774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1310036770 0x7f13100d68f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1304014040 tx=0x7f1304004750 comp rx=0 tx=0).stop 2022-11-27T16:34:15.069 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:15.065+0000 7f12faffd700 1 -- 172.21.15.6:0/37666774 shutdown_connections 2022-11-27T16:34:15.070 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:15.065+0000 7f12faffd700 1 --2- 172.21.15.6:0/37666774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13100566b0 0x7f1310033fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:15.070 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:15.065+0000 7f12faffd700 1 --2- 172.21.15.6:0/37666774 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f13100363a0 0x7f1310020410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:15.070 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:15.065+0000 7f12faffd700 1 --2- 172.21.15.6:0/37666774 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1310036770 0x7f13100d68f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:15.070 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:15.065+0000 7f12faffd700 1 -- 172.21.15.6:0/37666774 >> 172.21.15.6:0/37666774 conn(0x7f1310039820 msgr2=0x7f1310007c60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:15.071 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:15.065+0000 7f12faffd700 1 -- 172.21.15.6:0/37666774 shutdown_connections 2022-11-27T16:34:15.071 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:15.065+0000 7f12faffd700 1 -- 172.21.15.6:0/37666774 wait complete. 2022-11-27T16:34:15.080 INFO:tasks.ceph.ceph_manager.ceph:[] 2022-11-27T16:34:15.081 INFO:tasks.ceph:Waiting for OSDs to come up 2022-11-27T16:34:15.123 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:15.120+0000 7f3ffc10a200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-11-27T16:34:15.284 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:15.281+0000 7f3ffc10a200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-11-27T16:34:15.312 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:15.310+0000 7f714aa7a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-11-27T16:34:15.385 INFO:tasks.ceph.osd.4.smithi055.stderr:2022-11-27T16:34:15.384+0000 7fae8d8c95c0 -1 Falling back to public interface 2022-11-27T16:34:15.387 INFO:tasks.ceph.osd.3.smithi006.stderr:2022-11-27T16:34:15.385+0000 7f690a06e5c0 -1 Falling back to public interface 2022-11-27T16:34:15.389 INFO:tasks.ceph.osd.6.smithi055.stderr:2022-11-27T16:34:15.388+0000 7f5aa39e35c0 -1 Falling back to public interface 2022-11-27T16:34:15.392 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:15.391+0000 7f714aa7a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-11-27T16:34:15.397 INFO:tasks.ceph.osd.0.smithi006.stderr:2022-11-27T16:34:15.395+0000 7f14089dc5c0 -1 Falling back to public interface 2022-11-27T16:34:15.405 INFO:tasks.ceph.osd.5.smithi055.stderr:2022-11-27T16:34:15.403+0000 7ffb683f75c0 -1 Falling back to public interface 2022-11-27T16:34:15.406 INFO:tasks.ceph.osd.2.smithi006.stderr:2022-11-27T16:34:15.403+0000 7f2b953dc5c0 -1 Falling back to public interface 2022-11-27T16:34:15.407 INFO:tasks.ceph.osd.1.smithi006.stderr:2022-11-27T16:34:15.404+0000 7f71012255c0 -1 Falling back to public interface 2022-11-27T16:34:15.407 INFO:tasks.ceph.osd.1.smithi006.stderr:2022-11-27T16:34:15.405+0000 7f70f85e3700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6822/0: (98) Address already in use 2022-11-27T16:34:15.415 INFO:tasks.ceph.osd.7.smithi055.stderr:2022-11-27T16:34:15.414+0000 7f70ee3ff5c0 -1 Falling back to public interface 2022-11-27T16:34:15.539 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:15.537+0000 7f714aa7a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-11-27T16:34:15.703 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:15.701+0000 7f714aa7a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-11-27T16:34:15.841 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:15.838+0000 7f714aa7a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-11-27T16:34:15.889 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-11-27T16:34:15.992 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:15.989+0000 7f3ffc10a200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-11-27T16:34:16.008 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.005+0000 7f6d57150700 1 Processor -- start 2022-11-27T16:34:16.008 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.005+0000 7f6d57150700 1 -- start start 2022-11-27T16:34:16.011 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.006+0000 7f6d57150700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d500b5a60 0x7f6d500ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:16.011 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.006+0000 7f6d57150700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6d500b2950 0x7f6d500ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:16.011 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.006+0000 7f6d57150700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d500cc720 con 0x7f6d500cd0d0 2022-11-27T16:34:16.012 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.006+0000 7f6d57150700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d500cd540 con 0x7f6d500b2950 2022-11-27T16:34:16.012 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.006+0000 7f6d57150700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50159fc0 con 0x7f6d500b5a60 2022-11-27T16:34:16.012 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.006+0000 7f6d4ffff700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6d500b2950 0x7f6d500ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:16.012 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.006+0000 7f6d556ed700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f6d500cd0d0 0x7f6d5015d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58082/0 (socket says 172.21.15.6:58082) 2022-11-27T16:34:16.013 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.006+0000 7f6d556ed700 1 -- 172.21.15.6:0/571403424 learned_addr learned my addr 172.21.15.6:0/571403424 (peer_addr_for_me v1:172.21.15.6:0/0) 2022-11-27T16:34:16.013 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.007+0000 7f6d54eec700 1 --2- 172.21.15.6:0/571403424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d500b5a60 0x7f6d500ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:16.013 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.007+0000 7f6d4ffff700 1 -- 172.21.15.6:0/571403424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d500b5a60 msgr2=0x7f6d500ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:16.013 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.007+0000 7f6d4ffff700 1 --2- 172.21.15.6:0/571403424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d500b5a60 0x7f6d500ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:16.014 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.007+0000 7f6d4ffff700 1 -- 172.21.15.6:0/571403424 >> v1:172.21.15.6:6789/0 conn(0x7f6d500cd0d0 legacy=0x7f6d5015d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:16.014 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.007+0000 7f6d4f7fe700 1 -- 172.21.15.6:0/571403424 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176861450 0 0) 0x7f6d500cc720 con 0x7f6d500cd0d0 2022-11-27T16:34:16.014 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.007+0000 7f6d4ffff700 1 -- 172.21.15.6:0/571403424 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d500cedc0 con 0x7f6d500b2950 2022-11-27T16:34:16.014 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.007+0000 7f6d4ffff700 1 --2- 172.21.15.6:0/571403424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d500b2950 0x7f6d500ccb90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009840 tx=0x7f6d3c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7455b1157e70f4 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:16.014 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.007+0000 7f6d4f7fe700 1 -- 172.21.15.6:0/571403424 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c011830 con 0x7f6d500b2950 2022-11-27T16:34:16.015 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.007+0000 7f6d4f7fe700 1 -- 172.21.15.6:0/571403424 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3c011990 con 0x7f6d500b2950 2022-11-27T16:34:16.015 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.007+0000 7f6d4f7fe700 1 -- 172.21.15.6:0/571403424 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3c011d20 con 0x7f6d500b2950 2022-11-27T16:34:16.015 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.008+0000 7f6d57150700 1 -- 172.21.15.6:0/571403424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d500b2950 msgr2=0x7f6d500ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:16.015 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.008+0000 7f6d57150700 1 --2- 172.21.15.6:0/571403424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d500b2950 0x7f6d500ccb90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009840 tx=0x7f6d3c009b50 comp rx=0 tx=0).stop 2022-11-27T16:34:16.016 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.008+0000 7f6d57150700 1 -- 172.21.15.6:0/571403424 shutdown_connections 2022-11-27T16:34:16.016 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.008+0000 7f6d57150700 1 --2- 172.21.15.6:0/571403424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d500b5a60 0x7f6d500ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:16.017 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.008+0000 7f6d57150700 1 --2- 172.21.15.6:0/571403424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d500b2950 0x7f6d500ccb90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:16.017 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.008+0000 7f6d57150700 1 -- 172.21.15.6:0/571403424 >> 172.21.15.6:0/571403424 conn(0x7f6d50064ec0 msgr2=0x7f6d50065290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:16.017 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.008+0000 7f6d57150700 1 -- 172.21.15.6:0/571403424 shutdown_connections 2022-11-27T16:34:16.017 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.008+0000 7f6d57150700 1 -- 172.21.15.6:0/571403424 wait complete. 2022-11-27T16:34:16.020 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.009+0000 7f6d57150700 1 Processor -- start 2022-11-27T16:34:16.021 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.010+0000 7f6d57150700 1 -- start start 2022-11-27T16:34:16.021 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d57150700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d500b2950 0x7f6d501495f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:16.021 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d57150700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d500b5a60 0x7f6d50152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:16.021 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d57150700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d500cd0d0 0x7f6d50153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:16.022 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d57150700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d500b08e0 con 0x7f6d500b2950 2022-11-27T16:34:16.022 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d57150700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d50149b30 con 0x7f6d500cd0d0 2022-11-27T16:34:16.022 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d57150700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d500b1bd0 con 0x7f6d500b5a60 2022-11-27T16:34:16.022 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d54eec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d500b2950 0x7f6d501495f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:16.023 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d54eec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d500b2950 0x7f6d501495f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58544/0 (socket says 172.21.15.6:58544) 2022-11-27T16:34:16.023 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d54eec700 1 -- 172.21.15.6:0/2404252159 learned_addr learned my addr 172.21.15.6:0/2404252159 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:16.023 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d4ffff700 1 --2- 172.21.15.6:0/2404252159 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d500b5a60 0x7f6d50152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:16.023 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d556ed700 1 --2- 172.21.15.6:0/2404252159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d500cd0d0 0x7f6d50153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:16.023 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d54eec700 1 -- 172.21.15.6:0/2404252159 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d500b5a60 msgr2=0x7f6d50152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:16.024 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d54eec700 1 --2- 172.21.15.6:0/2404252159 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d500b5a60 0x7f6d50152b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:16.024 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d54eec700 1 -- 172.21.15.6:0/2404252159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d500cd0d0 msgr2=0x7f6d50153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:16.024 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d54eec700 1 --2- 172.21.15.6:0/2404252159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d500cd0d0 0x7f6d50153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:16.024 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d54eec700 1 -- 172.21.15.6:0/2404252159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3c0094a0 con 0x7f6d500b2950 2022-11-27T16:34:16.025 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d54eec700 1 --2- 172.21.15.6:0/2404252159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d500b2950 0x7f6d501495f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400e9e0 tx=0x7f6d4400ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:16.025 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d4d7fa700 1 -- 172.21.15.6:0/2404252159 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d44009710 con 0x7f6d500b2950 2022-11-27T16:34:16.025 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d4d7fa700 1 -- 172.21.15.6:0/2404252159 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4400ee80 con 0x7f6d500b2950 2022-11-27T16:34:16.025 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.011+0000 7f6d57150700 1 -- 172.21.15.6:0/2404252159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d500b0b30 con 0x7f6d500b2950 2022-11-27T16:34:16.025 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.012+0000 7f6d4d7fa700 1 -- 172.21.15.6:0/2404252159 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4400ca50 con 0x7f6d500b2950 2022-11-27T16:34:16.026 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.012+0000 7f6d57150700 1 -- 172.21.15.6:0/2404252159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d500b10f0 con 0x7f6d500b2950 2022-11-27T16:34:16.026 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.012+0000 7f6d4d7fa700 1 -- 172.21.15.6:0/2404252159 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 656+0+0 (secure 0 0 0) 0x7f6d44019030 con 0x7f6d500b2950 2022-11-27T16:34:16.026 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.012+0000 7f6d4d7fa700 1 -- 172.21.15.6:0/2404252159 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f6d44006830 con 0x7f6d500b2950 2022-11-27T16:34:16.027 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.012+0000 7f6d57150700 1 -- 172.21.15.6:0/2404252159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d500b1a20 con 0x7f6d500b2950 2022-11-27T16:34:16.027 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.015+0000 7f6d4d7fa700 1 -- 172.21.15.6:0/2404252159 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71351 (secure 0 0 0) 0x7f6d44021060 con 0x7f6d500b2950 2022-11-27T16:34:16.073 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:16.071+0000 7f3ffc10a200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-11-27T16:34:16.087 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.085+0000 7f6d57150700 1 -- 172.21.15.6:0/2404252159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d50068b70 con 0x7f6d500b2950 2022-11-27T16:34:16.088 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.086+0000 7f6d4d7fa700 1 -- 172.21.15.6:0/2404252159 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7011 (secure 0 0 0) 0x7f6d44017070 con 0x7f6d500b2950 2022-11-27T16:34:16.089 INFO:teuthology.misc.health.smithi006.stdout: 2022-11-27T16:34:16.089 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":10,"fsid":"993fccdc-c4ec-45c7-83f5-38e6210b61dd","created":"2022-11-27T16:34:12.138951+0000","modified":"2022-11-27T16:34:14.739276+0000","last_up_change":"0.000000","last_in_change":"2022-11-27T16:34:14.739276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"a1c510ff-24f3-497e-823f-73d31df5e534","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"01055301-2278-4c5b-9963-8787137b7db9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d523a914-8041-42f7-a369-33e54681eb9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d981890c-4dc6-4292-89f8-a11a3b529962","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"de3bdb57-3fc0-4353-a4cf-394d28ed0404","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8eb1bfed-50ab-408d-8908-9f855f49a683","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"be781377-2ff8-4b5c-8ce8-5cde163b4956","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2940a706-2632-4794-8d6f-dc8df69cf11f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-11-27T16:34:16.090 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.087+0000 7f6d57150700 1 -- 172.21.15.6:0/2404252159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d500b2950 msgr2=0x7f6d501495f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:16.090 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.087+0000 7f6d57150700 1 --2- 172.21.15.6:0/2404252159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d500b2950 0x7f6d501495f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6d4400e9e0 tx=0x7f6d4400ecf0 comp rx=0 tx=0).stop 2022-11-27T16:34:16.091 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.087+0000 7f6d57150700 1 -- 172.21.15.6:0/2404252159 shutdown_connections 2022-11-27T16:34:16.091 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.087+0000 7f6d57150700 1 --2- 172.21.15.6:0/2404252159 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d500cd0d0 0x7f6d50153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:16.091 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.087+0000 7f6d57150700 1 --2- 172.21.15.6:0/2404252159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d500b2950 0x7f6d501495f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:16.091 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.087+0000 7f6d57150700 1 --2- 172.21.15.6:0/2404252159 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d500b5a60 0x7f6d50152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:16.092 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.087+0000 7f6d57150700 1 -- 172.21.15.6:0/2404252159 >> 172.21.15.6:0/2404252159 conn(0x7f6d50064ec0 msgr2=0x7f6d500cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:16.092 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.087+0000 7f6d57150700 1 -- 172.21.15.6:0/2404252159 shutdown_connections 2022-11-27T16:34:16.092 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:16.087+0000 7f6d57150700 1 -- 172.21.15.6:0/2404252159 wait complete. 2022-11-27T16:34:16.100 DEBUG:teuthology.misc:0 of 8 OSDs are up 2022-11-27T16:34:16.203 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:16.201+0000 7f714aa7a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-11-27T16:34:16.217 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:16.215+0000 7f3ffc10a200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-11-27T16:34:16.361 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:16.359+0000 7f714aa7a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-11-27T16:34:16.382 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:16.380+0000 7f3ffc10a200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-11-27T16:34:16.481 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:16.479+0000 7f714aa7a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-11-27T16:34:16.520 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:16.517+0000 7f3ffc10a200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-11-27T16:34:16.631 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:16.630+0000 7f714aa7a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-11-27T16:34:16.733 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:16.732+0000 7f714aa7a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-11-27T16:34:16.882 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:16.879+0000 7f3ffc10a200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-11-27T16:34:17.039 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:17.037+0000 7f3ffc10a200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-11-27T16:34:17.100 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:17.098+0000 7f714aa7a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-11-27T16:34:17.159 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:17.157+0000 7f3ffc10a200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-11-27T16:34:17.309 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:17.307+0000 7f3ffc10a200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-11-27T16:34:17.411 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:17.409+0000 7f3ffc10a200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-11-27T16:34:17.707 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:17.705+0000 7f714aa7a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-11-27T16:34:17.780 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:17.777+0000 7f3ffc10a200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-11-27T16:34:18.487 INFO:tasks.ceph.mgr.y.smithi006.stderr:2022-11-27T16:34:18.485+0000 7f3ffc10a200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-11-27T16:34:18.731 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:18.729+0000 7f7102e44700 -1 mgr.server handle_report got status from non-daemon mon.c 2022-11-27T16:34:18.736 INFO:tasks.ceph.mgr.x.smithi055.stderr:2022-11-27T16:34:18.735+0000 7f7102e44700 -1 mgr.server handle_report got status from non-daemon mon.b 2022-11-27T16:34:18.897 INFO:tasks.ceph.osd.6.smithi055.stderr:2022-11-27T16:34:18.895+0000 7f5aa39e35c0 -1 osd.6 0 log_to_monitors true 2022-11-27T16:34:18.910 INFO:tasks.ceph.osd.3.smithi006.stderr:2022-11-27T16:34:18.907+0000 7f690a06e5c0 -1 osd.3 0 log_to_monitors true 2022-11-27T16:34:18.911 INFO:tasks.ceph.osd.0.smithi006.stderr:2022-11-27T16:34:18.909+0000 7f14089dc5c0 -1 osd.0 0 log_to_monitors true 2022-11-27T16:34:18.928 INFO:tasks.ceph.osd.4.smithi055.stderr:2022-11-27T16:34:18.926+0000 7fae8d8c95c0 -1 osd.4 0 log_to_monitors true 2022-11-27T16:34:18.928 INFO:tasks.ceph.osd.5.smithi055.stderr:2022-11-27T16:34:18.926+0000 7ffb683f75c0 -1 osd.5 0 log_to_monitors true 2022-11-27T16:34:18.931 INFO:tasks.ceph.osd.1.smithi006.stderr:2022-11-27T16:34:18.929+0000 7f71012255c0 -1 osd.1 0 log_to_monitors true 2022-11-27T16:34:18.935 INFO:tasks.ceph.osd.2.smithi006.stderr:2022-11-27T16:34:18.933+0000 7f2b953dc5c0 -1 osd.2 0 log_to_monitors true 2022-11-27T16:34:18.954 INFO:tasks.ceph.osd.7.smithi055.stderr:2022-11-27T16:34:18.952+0000 7f70ee3ff5c0 -1 osd.7 0 log_to_monitors true 2022-11-27T16:34:22.372 INFO:tasks.ceph.osd.4.smithi055.stderr:2022-11-27T16:34:22.369+0000 7fae81480700 -1 osd.4 0 waiting for initial osdmap 2022-11-27T16:34:22.373 INFO:tasks.ceph.osd.7.smithi055.stderr:2022-11-27T16:34:22.370+0000 7f70e1fb6700 -1 osd.7 0 waiting for initial osdmap 2022-11-27T16:34:22.373 INFO:tasks.ceph.osd.5.smithi055.stderr:2022-11-27T16:34:22.370+0000 7ffb5bfae700 -1 osd.5 0 waiting for initial osdmap 2022-11-27T16:34:22.386 INFO:tasks.ceph.osd.7.smithi055.stderr:2022-11-27T16:34:22.384+0000 7f70da391700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-11-27T16:34:22.388 INFO:tasks.ceph.osd.4.smithi055.stderr:2022-11-27T16:34:22.387+0000 7fae7985b700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-11-27T16:34:22.391 INFO:tasks.ceph.osd.5.smithi055.stderr:2022-11-27T16:34:22.390+0000 7ffb54389700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-11-27T16:34:22.407 INFO:tasks.ceph.osd.6.smithi055.stderr:2022-11-27T16:34:22.405+0000 7f5a9759a700 -1 osd.6 0 waiting for initial osdmap 2022-11-27T16:34:22.422 INFO:tasks.ceph.osd.6.smithi055.stderr:2022-11-27T16:34:22.420+0000 7f5a8f975700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-11-27T16:34:22.908 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-11-27T16:34:22.922 INFO:tasks.ceph.osd.3.smithi006.stderr:2022-11-27T16:34:22.920+0000 7f68fdc25700 -1 osd.3 0 waiting for initial osdmap 2022-11-27T16:34:22.936 INFO:tasks.ceph.osd.3.smithi006.stderr:2022-11-27T16:34:22.933+0000 7f68f6000700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-11-27T16:34:22.967 INFO:tasks.ceph.osd.2.smithi006.stderr:2022-11-27T16:34:22.965+0000 7f2b88f93700 -1 osd.2 0 waiting for initial osdmap 2022-11-27T16:34:22.981 INFO:tasks.ceph.osd.2.smithi006.stderr:2022-11-27T16:34:22.979+0000 7f2b8136e700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-11-27T16:34:22.985 INFO:tasks.ceph.osd.1.smithi006.stderr:2022-11-27T16:34:22.983+0000 7f70f4ddc700 -1 osd.1 0 waiting for initial osdmap 2022-11-27T16:34:22.995 INFO:tasks.ceph.osd.0.smithi006.stderr:2022-11-27T16:34:22.993+0000 7f13fc593700 -1 osd.0 0 waiting for initial osdmap 2022-11-27T16:34:22.998 INFO:tasks.ceph.osd.1.smithi006.stderr:2022-11-27T16:34:22.996+0000 7f70ed1b7700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-11-27T16:34:23.013 INFO:tasks.ceph.osd.0.smithi006.stderr:2022-11-27T16:34:23.011+0000 7f13f496e700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-11-27T16:34:23.055 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.052+0000 7fc6f0960700 1 Processor -- start 2022-11-27T16:34:23.055 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.052+0000 7fc6f0960700 1 -- start start 2022-11-27T16:34:23.058 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.053+0000 7fc6f0960700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6ec0b12c0 0x7fc6ec0cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:23.058 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.053+0000 7fc6f0960700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6ec0cad00 0x7fc6ec0cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:23.059 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.053+0000 7fc6f0960700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ec0c9880 con 0x7fc6ec0cb760 2022-11-27T16:34:23.059 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.053+0000 7fc6f0960700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6ec15d690 con 0x7fc6ec0cad00 2022-11-27T16:34:23.059 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.053+0000 7fc6f0960700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec15cb10 con 0x7fc6ec0b12c0 2022-11-27T16:34:23.059 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.053+0000 7fc6ead9d700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc6ec0cad00 0x7fc6ec0cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:23.060 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.053+0000 7fc6e9d9b700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fc6ec0cb760 0x7fc6ec0702f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58142/0 (socket says 172.21.15.6:58142) 2022-11-27T16:34:23.060 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.053+0000 7fc6e9d9b700 1 -- 172.21.15.6:0/1612574707 learned_addr learned my addr 172.21.15.6:0/1612574707 (peer_addr_for_me v1:172.21.15.6:0/0) 2022-11-27T16:34:23.060 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.054+0000 7fc6ea59c700 1 --2- 172.21.15.6:0/1612574707 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6ec0b12c0 0x7fc6ec0cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:23.060 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.054+0000 7fc6ead9d700 1 -- 172.21.15.6:0/1612574707 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6ec0b12c0 msgr2=0x7fc6ec0cd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:23.060 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.054+0000 7fc6ead9d700 1 --2- 172.21.15.6:0/1612574707 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6ec0b12c0 0x7fc6ec0cd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:23.061 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.054+0000 7fc6ead9d700 1 -- 172.21.15.6:0/1612574707 >> v1:172.21.15.6:6789/0 conn(0x7fc6ec0cb760 legacy=0x7fc6ec0702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:23.061 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.054+0000 7fc6e959a700 1 -- 172.21.15.6:0/1612574707 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659808714 0 0) 0x7fc6ec0c9880 con 0x7fc6ec0cb760 2022-11-27T16:34:23.061 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.054+0000 7fc6ead9d700 1 -- 172.21.15.6:0/1612574707 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ec15cdf0 con 0x7fc6ec0cad00 2022-11-27T16:34:23.061 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.054+0000 7fc6ead9d700 1 --2- 172.21.15.6:0/1612574707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec0cad00 0x7fc6ec0cd6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009d90 tx=0x7fc6e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f51ecbed1d450713 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:23.062 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.054+0000 7fc6e959a700 1 -- 172.21.15.6:0/1612574707 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e400e070 con 0x7fc6ec0cad00 2022-11-27T16:34:23.062 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.054+0000 7fc6e959a700 1 -- 172.21.15.6:0/1612574707 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e400bbd0 con 0x7fc6ec0cad00 2022-11-27T16:34:23.062 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.054+0000 7fc6e959a700 1 -- 172.21.15.6:0/1612574707 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e4012430 con 0x7fc6ec0cad00 2022-11-27T16:34:23.062 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.055+0000 7fc6f0960700 1 -- 172.21.15.6:0/1612574707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec0cad00 msgr2=0x7fc6ec0cd6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:23.062 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.055+0000 7fc6f0960700 1 --2- 172.21.15.6:0/1612574707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec0cad00 0x7fc6ec0cd6c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009d90 tx=0x7fc6e400b330 comp rx=0 tx=0).stop 2022-11-27T16:34:23.063 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.055+0000 7fc6f0960700 1 -- 172.21.15.6:0/1612574707 shutdown_connections 2022-11-27T16:34:23.063 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.055+0000 7fc6f0960700 1 --2- 172.21.15.6:0/1612574707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec0cad00 0x7fc6ec0cd6c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:23.063 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.055+0000 7fc6f0960700 1 --2- 172.21.15.6:0/1612574707 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6ec0b12c0 0x7fc6ec0cd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:23.063 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.055+0000 7fc6f0960700 1 -- 172.21.15.6:0/1612574707 >> 172.21.15.6:0/1612574707 conn(0x7fc6ec0cbc00 msgr2=0x7fc6ec0cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:23.064 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.055+0000 7fc6f0960700 1 -- 172.21.15.6:0/1612574707 shutdown_connections 2022-11-27T16:34:23.064 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.055+0000 7fc6f0960700 1 -- 172.21.15.6:0/1612574707 wait complete. 2022-11-27T16:34:23.067 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.056+0000 7fc6f0960700 1 Processor -- start 2022-11-27T16:34:23.067 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.057+0000 7fc6f0960700 1 -- start start 2022-11-27T16:34:23.068 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.057+0000 7fc6f0960700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec0b12c0 0x7fc6ec1564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:23.068 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.057+0000 7fc6f0960700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6ec0cad00 0x7fc6ec15a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:23.068 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.058+0000 7fc6f0960700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6ec0cb760 0x7fc6ec15ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:23.068 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.058+0000 7fc6f0960700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec0b1fb0 con 0x7fc6ec0b12c0 2022-11-27T16:34:23.069 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.058+0000 7fc6f0960700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec0c3700 con 0x7fc6ec0cad00 2022-11-27T16:34:23.069 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.058+0000 7fc6f0960700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ec0c2810 con 0x7fc6ec0cb760 2022-11-27T16:34:23.069 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.058+0000 7fc6ea59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec0b12c0 0x7fc6ec1564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:23.070 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.058+0000 7fc6ea59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec0b12c0 0x7fc6ec1564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58608/0 (socket says 172.21.15.6:58608) 2022-11-27T16:34:23.070 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.058+0000 7fc6ea59c700 1 -- 172.21.15.6:0/3152123312 learned_addr learned my addr 172.21.15.6:0/3152123312 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:23.070 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.058+0000 7fc6ea59c700 1 -- 172.21.15.6:0/3152123312 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6ec0cb760 msgr2=0x7fc6ec15ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:23.070 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.058+0000 7fc6ea59c700 1 --2- 172.21.15.6:0/3152123312 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6ec0cb760 0x7fc6ec15ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:23.070 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.058+0000 7fc6ea59c700 1 -- 172.21.15.6:0/3152123312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6ec0cad00 msgr2=0x7fc6ec15a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:23.071 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.058+0000 7fc6ea59c700 1 --2- 172.21.15.6:0/3152123312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6ec0cad00 0x7fc6ec15a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:23.071 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.058+0000 7fc6ea59c700 1 -- 172.21.15.6:0/3152123312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e4009a70 con 0x7fc6ec0b12c0 2022-11-27T16:34:23.071 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.058+0000 7fc6ea59c700 1 --2- 172.21.15.6:0/3152123312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec0b12c0 0x7fc6ec1564f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00e810 tx=0x7fc6dc00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:23.071 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.058+0000 7fc6daffd700 1 -- 172.21.15.6:0/3152123312 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc013610 con 0x7fc6ec0b12c0 2022-11-27T16:34:23.072 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.058+0000 7fc6daffd700 1 -- 172.21.15.6:0/3152123312 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc013770 con 0x7fc6ec0b12c0 2022-11-27T16:34:23.072 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.058+0000 7fc6daffd700 1 -- 172.21.15.6:0/3152123312 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc013b00 con 0x7fc6ec0b12c0 2022-11-27T16:34:23.072 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.058+0000 7fc6f0960700 1 -- 172.21.15.6:0/3152123312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ec0c2af0 con 0x7fc6ec0b12c0 2022-11-27T16:34:23.072 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.058+0000 7fc6f0960700 1 -- 172.21.15.6:0/3152123312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ec0c30b0 con 0x7fc6ec0b12c0 2022-11-27T16:34:23.072 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.059+0000 7fc6f0960700 1 -- 172.21.15.6:0/3152123312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ec068b70 con 0x7fc6ec0b12c0 2022-11-27T16:34:23.073 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.059+0000 7fc6daffd700 1 -- 172.21.15.6:0/3152123312 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 84457+0+0 (secure 0 0 0) 0x7fc6dc023070 con 0x7fc6ec0b12c0 2022-11-27T16:34:23.073 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.060+0000 7fc6daffd700 1 --2- 172.21.15.6:0/3152123312 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fc6c8066540 0x7fc6c80689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:23.073 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.060+0000 7fc6daffd700 1 -- 172.21.15.6:0/3152123312 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7fc6dc0825a0 con 0x7fc6ec0b12c0 2022-11-27T16:34:23.073 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.060+0000 7fc6e9d9b700 1 --2- 172.21.15.6:0/3152123312 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fc6c8066540 0x7fc6c80689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:23.074 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.060+0000 7fc6e9d9b700 1 --2- 172.21.15.6:0/3152123312 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fc6c8066540 0x7fc6c80689f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec1585f0 tx=0x7fc6e00079f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:23.074 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.064+0000 7fc6daffd700 1 -- 172.21.15.6:0/3152123312 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170936 (secure 0 0 0) 0x7fc6dc050b70 con 0x7fc6ec0b12c0 2022-11-27T16:34:23.259 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.256+0000 7fc6f0960700 1 -- 172.21.15.6:0/3152123312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6ec0b5100 con 0x7fc6ec0b12c0 2022-11-27T16:34:23.260 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.257+0000 7fc6daffd700 1 -- 172.21.15.6:0/3152123312 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7011 (secure 0 0 0) 0x7fc6dc021020 con 0x7fc6ec0b12c0 2022-11-27T16:34:23.260 INFO:teuthology.misc.health.smithi006.stdout: 2022-11-27T16:34:23.260 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":12,"fsid":"993fccdc-c4ec-45c7-83f5-38e6210b61dd","created":"2022-11-27T16:34:12.138951+0000","modified":"2022-11-27T16:34:20.880347+0000","last_up_change":"0.000000","last_in_change":"2022-11-27T16:34:14.739276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[],"osds":[{"osd":0,"uuid":"a1c510ff-24f3-497e-823f-73d31df5e534","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"01055301-2278-4c5b-9963-8787137b7db9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d523a914-8041-42f7-a369-33e54681eb9d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d981890c-4dc6-4292-89f8-a11a3b529962","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"de3bdb57-3fc0-4353-a4cf-394d28ed0404","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8eb1bfed-50ab-408d-8908-9f855f49a683","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"be781377-2ff8-4b5c-8ce8-5cde163b4956","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2940a706-2632-4794-8d6f-dc8df69cf11f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-11-27T16:34:23.262 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.259+0000 7fc6f0960700 1 -- 172.21.15.6:0/3152123312 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fc6c8066540 msgr2=0x7fc6c80689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:23.262 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.259+0000 7fc6f0960700 1 --2- 172.21.15.6:0/3152123312 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fc6c8066540 0x7fc6c80689f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec1585f0 tx=0x7fc6e00079f0 comp rx=0 tx=0).stop 2022-11-27T16:34:23.262 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.259+0000 7fc6f0960700 1 -- 172.21.15.6:0/3152123312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec0b12c0 msgr2=0x7fc6ec1564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:23.262 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.259+0000 7fc6f0960700 1 --2- 172.21.15.6:0/3152123312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec0b12c0 0x7fc6ec1564f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc00e810 tx=0x7fc6dc00ebd0 comp rx=0 tx=0).stop 2022-11-27T16:34:23.263 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.259+0000 7fc6f0960700 1 -- 172.21.15.6:0/3152123312 shutdown_connections 2022-11-27T16:34:23.263 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.259+0000 7fc6f0960700 1 --2- 172.21.15.6:0/3152123312 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fc6c8066540 0x7fc6c80689f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:23.263 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.259+0000 7fc6f0960700 1 --2- 172.21.15.6:0/3152123312 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6ec0cb760 0x7fc6ec15ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:23.263 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.259+0000 7fc6f0960700 1 --2- 172.21.15.6:0/3152123312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6ec0b12c0 0x7fc6ec1564f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:23.264 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.259+0000 7fc6f0960700 1 --2- 172.21.15.6:0/3152123312 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6ec0cad00 0x7fc6ec15a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:23.264 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.259+0000 7fc6f0960700 1 -- 172.21.15.6:0/3152123312 >> 172.21.15.6:0/3152123312 conn(0x7fc6ec0cbc00 msgr2=0x7fc6ec0ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:23.264 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.259+0000 7fc6f0960700 1 -- 172.21.15.6:0/3152123312 shutdown_connections 2022-11-27T16:34:23.264 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:23.259+0000 7fc6f0960700 1 -- 172.21.15.6:0/3152123312 wait complete. 2022-11-27T16:34:23.274 DEBUG:teuthology.misc:0 of 8 OSDs are up 2022-11-27T16:34:27.491 DEBUG:teuthology.orchestra.run.smithi006:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-11-27T16:34:27.494 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-11-27T16:34:30.081 DEBUG:teuthology.orchestra.run.smithi006:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-11-27T16:34:30.210 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.208+0000 7f5fd9887700 1 Processor -- start 2022-11-27T16:34:30.211 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.208+0000 7f5fd9887700 1 -- start start 2022-11-27T16:34:30.214 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.208+0000 7f5fd9887700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5fd40b1750 0x7f5fd40d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:30.214 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.208+0000 7f5fd9887700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5fd40b57e0 0x7f5fd40ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:30.215 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.208+0000 7f5fd9887700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd40d0860 con 0x7f5fd415bde0 2022-11-27T16:34:30.215 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.208+0000 7f5fd9887700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd40cc970 con 0x7f5fd40b1750 2022-11-27T16:34:30.215 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.208+0000 7f5fd9887700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40ccc50 con 0x7f5fd40b57e0 2022-11-27T16:34:30.215 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.209+0000 7f5fd37fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5fd40b57e0 0x7f5fd40ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:30.216 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.209+0000 7f5fd27fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5fd40b1750 0x7f5fd40d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:30.216 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.209+0000 7f5fd37fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5fd40b57e0 0x7f5fd40ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.6:47896/0 (socket says 172.21.15.6:47896) 2022-11-27T16:34:30.216 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.209+0000 7f5fd37fe700 1 -- 172.21.15.6:0/2462233502 learned_addr learned my addr 172.21.15.6:0/2462233502 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:30.217 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.209+0000 7f5fd27fc700 1 -- 172.21.15.6:0/2462233502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5fd40b57e0 msgr2=0x7f5fd40ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:30.217 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.209+0000 7f5fd27fc700 1 --2- 172.21.15.6:0/2462233502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5fd40b57e0 0x7f5fd40ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:30.217 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.209+0000 7f5fd27fc700 1 -- 172.21.15.6:0/2462233502 >> v1:172.21.15.55:6789/0 conn(0x7f5fd415bde0 legacy=0x7f5fd40b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:30.217 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.209+0000 7f5fd27fc700 1 -- 172.21.15.6:0/2462233502 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd40ccf30 con 0x7f5fd40b1750 2022-11-27T16:34:30.218 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.209+0000 7f5fd1ffb700 1 -- 172.21.15.6:0/2462233502 <== mon.1 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927592587 0 0) 0x7f5fd40d0860 con 0x7f5fd415bde0 2022-11-27T16:34:30.218 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.209+0000 7f5fd27fc700 1 --2- 172.21.15.6:0/2462233502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fd40b1750 0x7f5fd40d0fd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009840 tx=0x7f5fbc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81933866ca6d1195 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:30.218 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.210+0000 7f5fd1ffb700 1 -- 172.21.15.6:0/2462233502 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc011830 con 0x7f5fd40b1750 2022-11-27T16:34:30.218 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.210+0000 7f5fd1ffb700 1 -- 172.21.15.6:0/2462233502 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc011990 con 0x7f5fd40b1750 2022-11-27T16:34:30.219 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.210+0000 7f5fd1ffb700 1 -- 172.21.15.6:0/2462233502 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc011d20 con 0x7f5fd40b1750 2022-11-27T16:34:30.219 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.210+0000 7f5fd9887700 1 -- 172.21.15.6:0/2462233502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fd40b1750 msgr2=0x7f5fd40d0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:30.220 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.210+0000 7f5fd9887700 1 --2- 172.21.15.6:0/2462233502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fd40b1750 0x7f5fd40d0fd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009840 tx=0x7f5fbc009b50 comp rx=0 tx=0).stop 2022-11-27T16:34:30.220 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.210+0000 7f5fd9887700 1 -- 172.21.15.6:0/2462233502 shutdown_connections 2022-11-27T16:34:30.221 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.210+0000 7f5fd9887700 1 --2- 172.21.15.6:0/2462233502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5fd40b57e0 0x7f5fd40ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:30.221 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.210+0000 7f5fd9887700 1 --2- 172.21.15.6:0/2462233502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fd40b1750 0x7f5fd40d0fd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:30.222 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.210+0000 7f5fd9887700 1 -- 172.21.15.6:0/2462233502 >> 172.21.15.6:0/2462233502 conn(0x7f5fd4069a70 msgr2=0x7f5fd4069e70 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:30.222 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.210+0000 7f5fd9887700 1 -- 172.21.15.6:0/2462233502 shutdown_connections 2022-11-27T16:34:30.223 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.210+0000 7f5fd9887700 1 -- 172.21.15.6:0/2462233502 wait complete. 2022-11-27T16:34:30.223 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.211+0000 7f5fd9887700 1 Processor -- start 2022-11-27T16:34:30.224 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.212+0000 7f5fd9887700 1 -- start start 2022-11-27T16:34:30.230 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.212+0000 7f5fd9887700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fd40b1750 0x7f5fd41581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:30.231 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.212+0000 7f5fd9887700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fd40b57e0 0x7f5fd415c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:30.231 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.212+0000 7f5fd9887700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5fd415bde0 0x7f5fd41578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:30.231 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.212+0000 7f5fd9887700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd415cb00 con 0x7f5fd40b57e0 2022-11-27T16:34:30.232 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.212+0000 7f5fd9887700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd40c6df0 con 0x7f5fd40b1750 2022-11-27T16:34:30.232 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.212+0000 7f5fd9887700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd415cd10 con 0x7f5fd415bde0 2022-11-27T16:34:30.232 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.213+0000 7f5fd27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fd40b57e0 0x7f5fd415c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:30.232 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.213+0000 7f5fd27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fd40b57e0 0x7f5fd415c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58798/0 (socket says 172.21.15.6:58798) 2022-11-27T16:34:30.233 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.213+0000 7f5fd27fc700 1 -- 172.21.15.6:0/2858942885 learned_addr learned my addr 172.21.15.6:0/2858942885 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:30.233 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.213+0000 7f5fd2ffd700 1 --2- 172.21.15.6:0/2858942885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fd40b1750 0x7f5fd41581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:30.234 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.213+0000 7f5fd37fe700 1 --2- 172.21.15.6:0/2858942885 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5fd415bde0 0x7f5fd41578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:30.234 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.213+0000 7f5fd27fc700 1 -- 172.21.15.6:0/2858942885 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5fd415bde0 msgr2=0x7f5fd41578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:30.234 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.213+0000 7f5fd27fc700 1 --2- 172.21.15.6:0/2858942885 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5fd415bde0 0x7f5fd41578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:30.235 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.213+0000 7f5fd27fc700 1 -- 172.21.15.6:0/2858942885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fd40b1750 msgr2=0x7f5fd41581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:30.235 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.213+0000 7f5fd27fc700 1 --2- 172.21.15.6:0/2858942885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fd40b1750 0x7f5fd41581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:30.235 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.213+0000 7f5fd27fc700 1 -- 172.21.15.6:0/2858942885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fbc0094a0 con 0x7f5fd40b57e0 2022-11-27T16:34:30.235 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.213+0000 7f5fd37fe700 1 --2- 172.21.15.6:0/2858942885 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5fd415bde0 0x7f5fd41578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-11-27T16:34:30.235 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.213+0000 7f5fd27fc700 1 --2- 172.21.15.6:0/2858942885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fd40b57e0 0x7f5fd415c5c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009fd0 tx=0x7f5fbc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:30.236 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.213+0000 7f5fcbfff700 1 -- 172.21.15.6:0/2858942885 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc0036a0 con 0x7f5fd40b57e0 2022-11-27T16:34:30.236 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.213+0000 7f5fcbfff700 1 -- 172.21.15.6:0/2858942885 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc01f070 con 0x7f5fd40b57e0 2022-11-27T16:34:30.236 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.213+0000 7f5fd9887700 1 -- 172.21.15.6:0/2858942885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd415cff0 con 0x7f5fd40b57e0 2022-11-27T16:34:30.236 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.213+0000 7f5fcbfff700 1 -- 172.21.15.6:0/2858942885 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc003a20 con 0x7f5fd40b57e0 2022-11-27T16:34:30.237 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.213+0000 7f5fd9887700 1 -- 172.21.15.6:0/2858942885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd415d5b0 con 0x7f5fd40b57e0 2022-11-27T16:34:30.237 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.214+0000 7f5fd9887700 1 -- 172.21.15.6:0/2858942885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd415d740 con 0x7f5fd40b57e0 2022-11-27T16:34:30.237 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.215+0000 7f5fcbfff700 1 -- 172.21.15.6:0/2858942885 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7f5fbc00f050 con 0x7f5fd40b57e0 2022-11-27T16:34:30.237 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.215+0000 7f5fcbfff700 1 --2- 172.21.15.6:0/2858942885 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f5fb8066590 0x7f5fb8068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:30.237 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.215+0000 7f5fcbfff700 1 -- 172.21.15.6:0/2858942885 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5fbc021070 con 0x7f5fd40b57e0 2022-11-27T16:34:30.238 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.215+0000 7f5fd2ffd700 1 --2- 172.21.15.6:0/2858942885 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f5fb8066590 0x7f5fb8068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:30.238 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.216+0000 7f5fd2ffd700 1 --2- 172.21.15.6:0/2858942885 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f5fb8066590 0x7f5fb8068a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4000f60 tx=0x7f5fc4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:30.238 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.220+0000 7f5fcbfff700 1 -- 172.21.15.6:0/2858942885 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170936 (secure 0 0 0) 0x7f5fbc052810 con 0x7f5fd40b57e0 2022-11-27T16:34:30.411 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.409+0000 7f5fd9887700 1 -- 172.21.15.6:0/2858942885 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fd4068b70 con 0x7f5fd40b57e0 2022-11-27T16:34:30.412 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.410+0000 7f5fcbfff700 1 -- 172.21.15.6:0/2858942885 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12125 (secure 0 0 0) 0x7f5fbc015090 con 0x7f5fd40b57e0 2022-11-27T16:34:30.413 INFO:teuthology.misc.health.smithi006.stdout: 2022-11-27T16:34:30.413 INFO:teuthology.misc.health.smithi006.stdout:{"epoch":16,"fsid":"993fccdc-c4ec-45c7-83f5-38e6210b61dd","created":"2022-11-27T16:34:12.138951+0000","modified":"2022-11-27T16:34:26.428255+0000","last_up_change":"2022-11-27T16:34:23.393159+0000","last_in_change":"2022-11-27T16:34:14.739276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-11-27T16:34:23.785795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"a1c510ff-24f3-497e-823f-73d31df5e534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":101340},{"type":"v1","addr":"172.21.15.6:6809","nonce":101340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":101340},{"type":"v1","addr":"172.21.15.6:6811","nonce":101340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":101340},{"type":"v1","addr":"172.21.15.6:6815","nonce":101340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":101340},{"type":"v1","addr":"172.21.15.6:6813","nonce":101340}]},"public_addr":"172.21.15.6:6809/101340","cluster_addr":"172.21.15.6:6811/101340","heartbeat_back_addr":"172.21.15.6:6815/101340","heartbeat_front_addr":"172.21.15.6:6813/101340","state":["exists","up"]},{"osd":1,"uuid":"01055301-2278-4c5b-9963-8787137b7db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":101342},{"type":"v1","addr":"172.21.15.6:6823","nonce":101342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":101342},{"type":"v1","addr":"172.21.15.6:6827","nonce":101342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":101342},{"type":"v1","addr":"172.21.15.6:6831","nonce":101342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":101342},{"type":"v1","addr":"172.21.15.6:6829","nonce":101342}]},"public_addr":"172.21.15.6:6823/101342","cluster_addr":"172.21.15.6:6827/101342","heartbeat_back_addr":"172.21.15.6:6831/101342","heartbeat_front_addr":"172.21.15.6:6829/101342","state":["exists","up"]},{"osd":2,"uuid":"d523a914-8041-42f7-a369-33e54681eb9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":101343},{"type":"v1","addr":"172.21.15.6:6817","nonce":101343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":101343},{"type":"v1","addr":"172.21.15.6:6819","nonce":101343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":101343},{"type":"v1","addr":"172.21.15.6:6826","nonce":101343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":101343},{"type":"v1","addr":"172.21.15.6:6822","nonce":101343}]},"public_addr":"172.21.15.6:6817/101343","cluster_addr":"172.21.15.6:6819/101343","heartbeat_back_addr":"172.21.15.6:6826/101343","heartbeat_front_addr":"172.21.15.6:6822/101343","state":["exists","up"]},{"osd":3,"uuid":"d981890c-4dc6-4292-89f8-a11a3b529962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":101341},{"type":"v1","addr":"172.21.15.6:6801","nonce":101341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":101341},{"type":"v1","addr":"172.21.15.6:6803","nonce":101341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":101341},{"type":"v1","addr":"172.21.15.6:6807","nonce":101341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":101341},{"type":"v1","addr":"172.21.15.6:6805","nonce":101341}]},"public_addr":"172.21.15.6:6801/101341","cluster_addr":"172.21.15.6:6803/101341","heartbeat_back_addr":"172.21.15.6:6807/101341","heartbeat_front_addr":"172.21.15.6:6805/101341","state":["exists","up"]},{"osd":4,"uuid":"de3bdb57-3fc0-4353-a4cf-394d28ed0404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":101567},{"type":"v1","addr":"172.21.15.55:6801","nonce":101567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":101567},{"type":"v1","addr":"172.21.15.55:6803","nonce":101567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":101567},{"type":"v1","addr":"172.21.15.55:6807","nonce":101567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":101567},{"type":"v1","addr":"172.21.15.55:6805","nonce":101567}]},"public_addr":"172.21.15.55:6801/101567","cluster_addr":"172.21.15.55:6803/101567","heartbeat_back_addr":"172.21.15.55:6807/101567","heartbeat_front_addr":"172.21.15.55:6805/101567","state":["exists","up"]},{"osd":5,"uuid":"8eb1bfed-50ab-408d-8908-9f855f49a683","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":101577},{"type":"v1","addr":"172.21.15.55:6817","nonce":101577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":101577},{"type":"v1","addr":"172.21.15.55:6819","nonce":101577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":101577},{"type":"v1","addr":"172.21.15.55:6823","nonce":101577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":101577},{"type":"v1","addr":"172.21.15.55:6821","nonce":101577}]},"public_addr":"172.21.15.55:6817/101577","cluster_addr":"172.21.15.55:6819/101577","heartbeat_back_addr":"172.21.15.55:6823/101577","heartbeat_front_addr":"172.21.15.55:6821/101577","state":["exists","up"]},{"osd":6,"uuid":"be781377-2ff8-4b5c-8ce8-5cde163b4956","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":101568},{"type":"v1","addr":"172.21.15.55:6809","nonce":101568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":101568},{"type":"v1","addr":"172.21.15.55:6811","nonce":101568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":101568},{"type":"v1","addr":"172.21.15.55:6815","nonce":101568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":101568},{"type":"v1","addr":"172.21.15.55:6813","nonce":101568}]},"public_addr":"172.21.15.55:6809/101568","cluster_addr":"172.21.15.55:6811/101568","heartbeat_back_addr":"172.21.15.55:6815/101568","heartbeat_front_addr":"172.21.15.55:6813/101568","state":["exists","up"]},{"osd":7,"uuid":"2940a706-2632-4794-8d6f-dc8df69cf11f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":101598},{"type":"v1","addr":"172.21.15.55:6825","nonce":101598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":101598},{"type":"v1","addr":"172.21.15.55:6827","nonce":101598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":101598},{"type":"v1","addr":"172.21.15.55:6831","nonce":101598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":101598},{"type":"v1","addr":"172.21.15.55:6829","nonce":101598}]},"public_addr":"172.21.15.55:6825/101598","cluster_addr":"172.21.15.55:6827/101598","heartbeat_back_addr":"172.21.15.55:6831/101598","heartbeat_front_addr":"172.21.15.55:6829/101598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.901980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.967714+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.968394+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.862378+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.910978+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.919584+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.868135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.951725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-11-27T16:34:30.415 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.412+0000 7f5fd9887700 1 -- 172.21.15.6:0/2858942885 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f5fb8066590 msgr2=0x7f5fb8068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:30.415 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.412+0000 7f5fd9887700 1 --2- 172.21.15.6:0/2858942885 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f5fb8066590 0x7f5fb8068a40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4000f60 tx=0x7f5fc4009040 comp rx=0 tx=0).stop 2022-11-27T16:34:30.415 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.412+0000 7f5fd9887700 1 -- 172.21.15.6:0/2858942885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fd40b57e0 msgr2=0x7f5fd415c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:30.415 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.412+0000 7f5fd9887700 1 --2- 172.21.15.6:0/2858942885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fd40b57e0 0x7f5fd415c5c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc009fd0 tx=0x7f5fbc004750 comp rx=0 tx=0).stop 2022-11-27T16:34:30.416 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.412+0000 7f5fd9887700 1 -- 172.21.15.6:0/2858942885 shutdown_connections 2022-11-27T16:34:30.416 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.412+0000 7f5fd9887700 1 --2- 172.21.15.6:0/2858942885 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f5fb8066590 0x7f5fb8068a40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:30.416 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.412+0000 7f5fd9887700 1 --2- 172.21.15.6:0/2858942885 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5fd415bde0 0x7f5fd41578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:30.417 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.412+0000 7f5fd9887700 1 --2- 172.21.15.6:0/2858942885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fd40b1750 0x7f5fd41581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:30.417 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.412+0000 7f5fd9887700 1 --2- 172.21.15.6:0/2858942885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5fd40b57e0 0x7f5fd415c5c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:30.417 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.412+0000 7f5fd9887700 1 -- 172.21.15.6:0/2858942885 >> 172.21.15.6:0/2858942885 conn(0x7f5fd4069a70 msgr2=0x7f5fd40b5cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:30.417 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.412+0000 7f5fd9887700 1 -- 172.21.15.6:0/2858942885 shutdown_connections 2022-11-27T16:34:30.418 INFO:teuthology.misc.health.smithi006.stderr:2022-11-27T16:34:30.412+0000 7f5fd9887700 1 -- 172.21.15.6:0/2858942885 wait complete. 2022-11-27T16:34:30.426 DEBUG:teuthology.misc:8 of 8 OSDs are up 2022-11-27T16:34:30.427 INFO:tasks.ceph:Creating RBD pool 2022-11-27T16:34:30.427 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd pool create rbd 8 2022-11-27T16:34:30.552 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.549+0000 7fbd87a06700 1 Processor -- start 2022-11-27T16:34:30.552 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.549+0000 7fbd87a06700 1 -- start start 2022-11-27T16:34:30.555 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.550+0000 7fbd87a06700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbd800701f0 0x7fbd800ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:30.555 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.550+0000 7fbd87a06700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd800cdc80 0x7fbd800ce0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:30.556 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.550+0000 7fbd87a06700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd800c9c40 con 0x7fbd8015bd30 2022-11-27T16:34:30.556 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.550+0000 7fbd87a06700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8015c100 con 0x7fbd800cdc80 2022-11-27T16:34:30.556 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.550+0000 7fbd87a06700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd800c9070 con 0x7fbd800701f0 2022-11-27T16:34:30.556 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.550+0000 7fbd85fa3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd800cdc80 0x7fbd800ce0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:30.557 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.550+0000 7fbd85fa3700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fbd800cdc80 0x7fbd800ce0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58808/0 (socket says 172.21.15.6:58808) 2022-11-27T16:34:30.557 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.550+0000 7fbd85fa3700 1 -- 172.21.15.6:0/2215214560 learned_addr learned my addr 172.21.15.6:0/2215214560 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:30.557 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.551+0000 7fbd84fa1700 1 --2- 172.21.15.6:0/2215214560 >> v2:172.21.15.55:3300/0 conn(0x7fbd800701f0 0x7fbd800ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:30.557 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.551+0000 7fbd85fa3700 1 -- 172.21.15.6:0/2215214560 >> v2:172.21.15.55:3300/0 conn(0x7fbd800701f0 msgr2=0x7fbd800ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:30.558 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.551+0000 7fbd85fa3700 1 --2- 172.21.15.6:0/2215214560 >> v2:172.21.15.55:3300/0 conn(0x7fbd800701f0 0x7fbd800ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:30.558 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.551+0000 7fbd85fa3700 1 -- 172.21.15.6:0/2215214560 >> v1:172.21.15.55:6789/0 conn(0x7fbd8015bd30 legacy=0x7fbd8006fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:30.558 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.551+0000 7fbd85fa3700 1 -- 172.21.15.6:0/2215214560 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd800c9310 con 0x7fbd800cdc80 2022-11-27T16:34:30.558 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.551+0000 7fbd85fa3700 1 --2- 172.21.15.6:0/2215214560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd800cdc80 0x7fbd800ce0f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbd800cb340 tx=0x7fbd7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37cfbf96f1186332 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:30.558 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.551+0000 7fbd6ffff700 1 -- 172.21.15.6:0/2215214560 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd7800e070 con 0x7fbd800cdc80 2022-11-27T16:34:30.559 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.551+0000 7fbd6ffff700 1 -- 172.21.15.6:0/2215214560 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd78003a20 con 0x7fbd800cdc80 2022-11-27T16:34:30.559 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.551+0000 7fbd6ffff700 1 -- 172.21.15.6:0/2215214560 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78003dd0 con 0x7fbd800cdc80 2022-11-27T16:34:30.559 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.552+0000 7fbd87a06700 1 -- 172.21.15.6:0/2215214560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd800cdc80 msgr2=0x7fbd800ce0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:30.559 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.552+0000 7fbd87a06700 1 --2- 172.21.15.6:0/2215214560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd800cdc80 0x7fbd800ce0f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbd800cb340 tx=0x7fbd7800b330 comp rx=0 tx=0).stop 2022-11-27T16:34:30.560 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.552+0000 7fbd87a06700 1 -- 172.21.15.6:0/2215214560 shutdown_connections 2022-11-27T16:34:30.560 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.552+0000 7fbd87a06700 1 --2- 172.21.15.6:0/2215214560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd800cdc80 0x7fbd800ce0f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:30.560 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.552+0000 7fbd87a06700 1 --2- 172.21.15.6:0/2215214560 >> v2:172.21.15.55:3300/0 conn(0x7fbd800701f0 0x7fbd800ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:30.560 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.552+0000 7fbd87a06700 1 -- 172.21.15.6:0/2215214560 >> 172.21.15.6:0/2215214560 conn(0x7fbd800ce8f0 msgr2=0x7fbd800cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:30.561 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.552+0000 7fbd87a06700 1 -- 172.21.15.6:0/2215214560 shutdown_connections 2022-11-27T16:34:30.561 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.552+0000 7fbd87a06700 1 -- 172.21.15.6:0/2215214560 wait complete. 2022-11-27T16:34:30.561 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.553+0000 7fbd87a06700 1 Processor -- start 2022-11-27T16:34:30.561 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.553+0000 7fbd87a06700 1 -- start start 2022-11-27T16:34:30.565 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd87a06700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd800701f0 0x7fbd80155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:30.565 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd87a06700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd800cdc80 0x7fbd801f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:30.565 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd87a06700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd8015bd30 0x7fbd800ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:30.566 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd87a06700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd8015f170 con 0x7fbd8015bd30 2022-11-27T16:34:30.566 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd87a06700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd801f2840 con 0x7fbd800cdc80 2022-11-27T16:34:30.566 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd87a06700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd80156f90 con 0x7fbd800701f0 2022-11-27T16:34:30.566 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd85fa3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd8015bd30 0x7fbd800ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:30.567 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd85fa3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd8015bd30 0x7fbd800ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58814/0 (socket says 172.21.15.6:58814) 2022-11-27T16:34:30.567 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd85fa3700 1 -- 172.21.15.6:0/169096321 learned_addr learned my addr 172.21.15.6:0/169096321 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:30.567 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd85fa3700 1 -- 172.21.15.6:0/169096321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd800701f0 msgr2=0x7fbd80155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:30.568 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd85fa3700 1 --2- 172.21.15.6:0/169096321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd800701f0 0x7fbd80155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:30.568 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd84fa1700 1 --2- 172.21.15.6:0/169096321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd800cdc80 0x7fbd801f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:30.568 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd85fa3700 1 -- 172.21.15.6:0/169096321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd800cdc80 msgr2=0x7fbd801f29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:30.568 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd85fa3700 1 --2- 172.21.15.6:0/169096321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd800cdc80 0x7fbd801f29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:30.569 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd85fa3700 1 -- 172.21.15.6:0/169096321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd78009b30 con 0x7fbd8015bd30 2022-11-27T16:34:30.569 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd85fa3700 1 --2- 172.21.15.6:0/169096321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd8015bd30 0x7fbd800ca6a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800b370 tx=0x7fbd78004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:30.569 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd6dffb700 1 -- 172.21.15.6:0/169096321 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78004440 con 0x7fbd8015bd30 2022-11-27T16:34:30.569 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd6dffb700 1 -- 172.21.15.6:0/169096321 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd780045a0 con 0x7fbd8015bd30 2022-11-27T16:34:30.570 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd87a06700 1 -- 172.21.15.6:0/169096321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd80157270 con 0x7fbd8015bd30 2022-11-27T16:34:30.570 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.554+0000 7fbd6dffb700 1 -- 172.21.15.6:0/169096321 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd78004950 con 0x7fbd8015bd30 2022-11-27T16:34:30.570 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.555+0000 7fbd87a06700 1 -- 172.21.15.6:0/169096321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd80157830 con 0x7fbd8015bd30 2022-11-27T16:34:30.570 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.555+0000 7fbd87a06700 1 -- 172.21.15.6:0/169096321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd80157a50 con 0x7fbd8015bd30 2022-11-27T16:34:30.570 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.556+0000 7fbd6dffb700 1 -- 172.21.15.6:0/169096321 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7fbd78022030 con 0x7fbd8015bd30 2022-11-27T16:34:30.571 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.556+0000 7fbd6dffb700 1 --2- 172.21.15.6:0/169096321 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fbd60066590 0x7fbd60068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:30.571 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.556+0000 7fbd6dffb700 1 -- 172.21.15.6:0/169096321 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fbd780846f0 con 0x7fbd8015bd30 2022-11-27T16:34:30.571 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.556+0000 7fbd857a2700 1 --2- 172.21.15.6:0/169096321 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fbd60066590 0x7fbd60068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:30.571 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.557+0000 7fbd857a2700 1 --2- 172.21.15.6:0/169096321 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fbd60066590 0x7fbd60068a40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbd70003df0 tx=0x7fbd70007a40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:30.572 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.561+0000 7fbd6dffb700 1 -- 172.21.15.6:0/169096321 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170936 (secure 0 0 0) 0x7fbd780522b0 con 0x7fbd8015bd30 2022-11-27T16:34:30.753 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:30.751+0000 7fbd87a06700 1 -- 172.21.15.6:0/169096321 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fbd80068b70 con 0x7fbd8015bd30 2022-11-27T16:34:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.460+0000 7fbd6dffb700 1 -- 172.21.15.6:0/169096321 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7fbd780558d0 con 0x7fbd8015bd30 2022-11-27T16:34:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.463+0000 7fbd87a06700 1 -- 172.21.15.6:0/169096321 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fbd60066590 msgr2=0x7fbd60068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.463+0000 7fbd87a06700 1 --2- 172.21.15.6:0/169096321 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fbd60066590 0x7fbd60068a40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbd70003df0 tx=0x7fbd70007a40 comp rx=0 tx=0).stop 2022-11-27T16:34:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.463+0000 7fbd87a06700 1 -- 172.21.15.6:0/169096321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd8015bd30 msgr2=0x7fbd800ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.463+0000 7fbd87a06700 1 --2- 172.21.15.6:0/169096321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd8015bd30 0x7fbd800ca6a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fbd7800b370 tx=0x7fbd78004ad0 comp rx=0 tx=0).stop 2022-11-27T16:34:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.463+0000 7fbd87a06700 1 -- 172.21.15.6:0/169096321 shutdown_connections 2022-11-27T16:34:31.468 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.463+0000 7fbd87a06700 1 --2- 172.21.15.6:0/169096321 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fbd60066590 0x7fbd60068a40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:31.468 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.463+0000 7fbd87a06700 1 --2- 172.21.15.6:0/169096321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd8015bd30 0x7fbd800ca6a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:31.468 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.463+0000 7fbd87a06700 1 --2- 172.21.15.6:0/169096321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbd800701f0 0x7fbd80155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:31.469 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.463+0000 7fbd87a06700 1 --2- 172.21.15.6:0/169096321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd800cdc80 0x7fbd801f29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:31.469 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.463+0000 7fbd87a06700 1 -- 172.21.15.6:0/169096321 >> 172.21.15.6:0/169096321 conn(0x7fbd800ce8f0 msgr2=0x7fbd800ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:31.469 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.463+0000 7fbd87a06700 1 -- 172.21.15.6:0/169096321 shutdown_connections 2022-11-27T16:34:31.469 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.463+0000 7fbd87a06700 1 -- 172.21.15.6:0/169096321 wait complete. 2022-11-27T16:34:31.469 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'rbd' created 2022-11-27T16:34:31.480 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2022-11-27T16:34:31.613 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.611+0000 7f7744046700 1 Processor -- start 2022-11-27T16:34:31.613 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.611+0000 7f7744046700 1 -- start start 2022-11-27T16:34:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.611+0000 7f7744046700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f773c15bef0 0x7f773c069f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.612+0000 7f7744046700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f773c15c2c0 0x7f773c06a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.612+0000 7f7744046700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773c0cac70 con 0x7f773c0ce860 2022-11-27T16:34:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.612+0000 7f7744046700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773c0ca970 con 0x7f773c15bef0 2022-11-27T16:34:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.612+0000 7f7744046700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0cedd0 con 0x7f773c15c2c0 2022-11-27T16:34:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.612+0000 7f7741de2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f773c15bef0 0x7f773c069f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.612+0000 7f77425e3700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f773c0ce860 0x7f773c0ccb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58362/0 (socket says 172.21.15.6:58362) 2022-11-27T16:34:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.612+0000 7f77425e3700 1 -- 172.21.15.6:0/744466716 learned_addr learned my addr 172.21.15.6:0/744466716 (peer_addr_for_me v1:172.21.15.6:0/0) 2022-11-27T16:34:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.612+0000 7f77415e1700 1 --2- 172.21.15.6:0/744466716 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f773c15c2c0 0x7f773c06a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.612+0000 7f7741de2700 1 -- 172.21.15.6:0/744466716 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f773c15c2c0 msgr2=0x7f773c06a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:31.619 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.612+0000 7f7741de2700 1 --2- 172.21.15.6:0/744466716 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f773c15c2c0 0x7f773c06a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:31.620 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.612+0000 7f7741de2700 1 -- 172.21.15.6:0/744466716 >> v1:172.21.15.6:6789/0 conn(0x7f773c0ce860 legacy=0x7f773c0ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:31.620 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.612+0000 7f7740de0700 1 -- 172.21.15.6:0/744466716 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155962269 0 0) 0x7f773c0cac70 con 0x7f773c0ce860 2022-11-27T16:34:31.620 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.612+0000 7f7741de2700 1 -- 172.21.15.6:0/744466716 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c0cf0b0 con 0x7f773c15bef0 2022-11-27T16:34:31.620 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.612+0000 7f7741de2700 1 --2- 172.21.15.6:0/744466716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f773c15bef0 0x7f773c069f70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7730009840 tx=0x7f7730009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b697603e414125 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:31.621 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.612+0000 7f7740de0700 1 -- 172.21.15.6:0/744466716 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730011830 con 0x7f773c15bef0 2022-11-27T16:34:31.621 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.612+0000 7f7740de0700 1 -- 172.21.15.6:0/744466716 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7730011990 con 0x7f773c15bef0 2022-11-27T16:34:31.621 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.612+0000 7f7740de0700 1 -- 172.21.15.6:0/744466716 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730011d20 con 0x7f773c15bef0 2022-11-27T16:34:31.621 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.613+0000 7f7744046700 1 -- 172.21.15.6:0/744466716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f773c15bef0 msgr2=0x7f773c069f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:31.622 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.613+0000 7f7744046700 1 --2- 172.21.15.6:0/744466716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f773c15bef0 0x7f773c069f70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7730009840 tx=0x7f7730009b50 comp rx=0 tx=0).stop 2022-11-27T16:34:31.622 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.613+0000 7f7744046700 1 -- 172.21.15.6:0/744466716 shutdown_connections 2022-11-27T16:34:31.622 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.613+0000 7f7744046700 1 --2- 172.21.15.6:0/744466716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f773c15bef0 0x7f773c069f70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:31.622 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.613+0000 7f7744046700 1 --2- 172.21.15.6:0/744466716 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f773c15c2c0 0x7f773c06a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.613+0000 7f7744046700 1 -- 172.21.15.6:0/744466716 >> 172.21.15.6:0/744466716 conn(0x7f773c099560 msgr2=0x7f773c0d0280 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.613+0000 7f7744046700 1 -- 172.21.15.6:0/744466716 shutdown_connections 2022-11-27T16:34:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.613+0000 7f7744046700 1 -- 172.21.15.6:0/744466716 wait complete. 2022-11-27T16:34:31.623 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.614+0000 7f7744046700 1 Processor -- start 2022-11-27T16:34:31.624 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.614+0000 7f7744046700 1 -- start start 2022-11-27T16:34:31.627 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.615+0000 7f7744046700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f773c0ce860 0x7f773c09dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:31.628 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.615+0000 7f7744046700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f773c15bef0 0x7f773c15a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:31.628 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.615+0000 7f7744046700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f773c15c2c0 0x7f773c0b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:31.628 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.615+0000 7f7744046700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c15d690 con 0x7f773c15bef0 2022-11-27T16:34:31.628 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.615+0000 7f7744046700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0c8870 con 0x7f773c0ce860 2022-11-27T16:34:31.629 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.615+0000 7f7744046700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c15d0d0 con 0x7f773c15c2c0 2022-11-27T16:34:31.629 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.615+0000 7f77415e1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f773c15bef0 0x7f773c15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:31.629 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.615+0000 7f77415e1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f773c15bef0 0x7f773c15a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58826/0 (socket says 172.21.15.6:58826) 2022-11-27T16:34:31.629 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.615+0000 7f77415e1700 1 -- 172.21.15.6:0/2071878860 learned_addr learned my addr 172.21.15.6:0/2071878860 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:31.630 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.615+0000 7f7741de2700 1 --2- 172.21.15.6:0/2071878860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f773c0ce860 0x7f773c09dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:31.630 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.615+0000 7f77425e3700 1 --2- 172.21.15.6:0/2071878860 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f773c15c2c0 0x7f773c0b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:31.630 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.615+0000 7f77415e1700 1 -- 172.21.15.6:0/2071878860 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f773c15c2c0 msgr2=0x7f773c0b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:31.630 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.615+0000 7f77415e1700 1 --2- 172.21.15.6:0/2071878860 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f773c15c2c0 0x7f773c0b1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:31.631 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.615+0000 7f77415e1700 1 -- 172.21.15.6:0/2071878860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f773c0ce860 msgr2=0x7f773c09dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:31.631 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.615+0000 7f77415e1700 1 --2- 172.21.15.6:0/2071878860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f773c0ce860 0x7f773c09dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:31.631 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.615+0000 7f77415e1700 1 -- 172.21.15.6:0/2071878860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77300094a0 con 0x7f773c15bef0 2022-11-27T16:34:31.631 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.615+0000 7f7741de2700 1 --2- 172.21.15.6:0/2071878860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f773c0ce860 0x7f773c09dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-11-27T16:34:31.632 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.616+0000 7f77415e1700 1 --2- 172.21.15.6:0/2071878860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f773c15bef0 0x7f773c15a500 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f773800e990 tx=0x7f773800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:31.632 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.616+0000 7f772e7fc700 1 -- 172.21.15.6:0/2071878860 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77380096f0 con 0x7f773c15bef0 2022-11-27T16:34:31.632 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.616+0000 7f772e7fc700 1 -- 172.21.15.6:0/2071878860 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773800c850 con 0x7f773c15bef0 2022-11-27T16:34:31.632 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.616+0000 7f7744046700 1 -- 172.21.15.6:0/2071878860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773c15d3b0 con 0x7f773c15bef0 2022-11-27T16:34:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.616+0000 7f772e7fc700 1 -- 172.21.15.6:0/2071878860 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773800cbc0 con 0x7f773c15bef0 2022-11-27T16:34:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.616+0000 7f7744046700 1 -- 172.21.15.6:0/2071878860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773c15c840 con 0x7f773c15bef0 2022-11-27T16:34:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.617+0000 7f7744046700 1 -- 172.21.15.6:0/2071878860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773c08a830 con 0x7f773c15bef0 2022-11-27T16:34:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.617+0000 7f772e7fc700 1 -- 172.21.15.6:0/2071878860 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7f7738023070 con 0x7f773c15bef0 2022-11-27T16:34:31.634 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.618+0000 7f772e7fc700 1 --2- 172.21.15.6:0/2071878860 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f771c066590 0x7f771c068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:31.634 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.618+0000 7f772e7fc700 1 -- 172.21.15.6:0/2071878860 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f7738083820 con 0x7f773c15bef0 2022-11-27T16:34:31.634 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.618+0000 7f7741de2700 1 --2- 172.21.15.6:0/2071878860 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f771c066590 0x7f771c068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:31.634 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.619+0000 7f7741de2700 1 --2- 172.21.15.6:0/2071878860 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f771c066590 0x7f771c068a40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7730009b90 tx=0x7f7730008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:31.635 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.622+0000 7f772e7fc700 1 -- 172.21.15.6:0/2071878860 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170936 (secure 0 0 0) 0x7f7738051290 con 0x7f773c15bef0 2022-11-27T16:34:31.820 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:31.814+0000 7f7744046700 1 -- 172.21.15.6:0/2071878860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f773c04e190 con 0x7f773c15bef0 2022-11-27T16:34:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.467+0000 7f772e7fc700 1 -- 172.21.15.6:0/2071878860 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f77380210c0 con 0x7f773c15bef0 2022-11-27T16:34:32.473 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.470+0000 7f7744046700 1 -- 172.21.15.6:0/2071878860 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f771c066590 msgr2=0x7f771c068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:32.473 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.470+0000 7f7744046700 1 --2- 172.21.15.6:0/2071878860 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f771c066590 0x7f771c068a40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7730009b90 tx=0x7f7730008030 comp rx=0 tx=0).stop 2022-11-27T16:34:32.474 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.470+0000 7f7744046700 1 -- 172.21.15.6:0/2071878860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f773c15bef0 msgr2=0x7f773c15a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:32.474 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.470+0000 7f7744046700 1 --2- 172.21.15.6:0/2071878860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f773c15bef0 0x7f773c15a500 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f773800e990 tx=0x7f773800ed50 comp rx=0 tx=0).stop 2022-11-27T16:34:32.474 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.470+0000 7f7744046700 1 -- 172.21.15.6:0/2071878860 shutdown_connections 2022-11-27T16:34:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.470+0000 7f7744046700 1 --2- 172.21.15.6:0/2071878860 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f771c066590 0x7f771c068a40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.470+0000 7f7744046700 1 --2- 172.21.15.6:0/2071878860 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f773c15c2c0 0x7f773c0b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.470+0000 7f7744046700 1 --2- 172.21.15.6:0/2071878860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f773c0ce860 0x7f773c09dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.470+0000 7f7744046700 1 --2- 172.21.15.6:0/2071878860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f773c15bef0 0x7f773c15a500 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.470+0000 7f7744046700 1 -- 172.21.15.6:0/2071878860 >> 172.21.15.6:0/2071878860 conn(0x7f773c099560 msgr2=0x7f773c06d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.470+0000 7f7744046700 1 -- 172.21.15.6:0/2071878860 shutdown_connections 2022-11-27T16:34:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.470+0000 7f7744046700 1 -- 172.21.15.6:0/2071878860 wait complete. 2022-11-27T16:34:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:enabled application 'rbd' on pool 'rbd' 2022-11-27T16:34:32.490 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2022-11-27T16:34:32.490 INFO:tasks.ceph.mds.a:Restarting daemon 2022-11-27T16:34:32.491 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-11-27T16:34:32.493 INFO:tasks.ceph.mds.a:Started 2022-11-27T16:34:32.494 INFO:tasks.ceph.mds.c:Restarting daemon 2022-11-27T16:34:32.494 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-11-27T16:34:32.496 INFO:tasks.ceph.mds.c:Started 2022-11-27T16:34:32.497 INFO:tasks.ceph.mds.b:Restarting daemon 2022-11-27T16:34:32.497 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-11-27T16:34:32.500 INFO:tasks.ceph.mds.b:Started 2022-11-27T16:34:32.500 INFO:tasks.ceph.mds.d:Restarting daemon 2022-11-27T16:34:32.500 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2022-11-27T16:34:32.503 INFO:tasks.ceph.mds.d:Started 2022-11-27T16:34:32.503 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2022-11-27T16:34:32.504 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-11-27T16:34:32.582 INFO:tasks.ceph.mds.c.smithi006.stdout:starting mds.c at 2022-11-27T16:34:32.582 INFO:tasks.ceph.mds.a.smithi006.stdout:starting mds.a at 2022-11-27T16:34:32.590 INFO:tasks.ceph.mds.b.smithi055.stdout:starting mds.b at 2022-11-27T16:34:32.591 INFO:tasks.ceph.mds.d.smithi055.stdout:starting mds.d at 2022-11-27T16:34:32.642 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.640+0000 7f7746d32700 1 Processor -- start 2022-11-27T16:34:32.643 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.640+0000 7f7746d32700 1 -- start start 2022-11-27T16:34:32.648 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.641+0000 7f7746d32700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f77400b12c0 0x7f77400cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:32.648 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.641+0000 7f7746d32700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f77400cb760 0x7f77400cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.641+0000 7f7746d32700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77400c9880 con 0x7f77400cb210 2022-11-27T16:34:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.641+0000 7f7746d32700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f774015d690 con 0x7f77400b12c0 2022-11-27T16:34:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.641+0000 7f7746d32700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f774015cb10 con 0x7f77400cb760 2022-11-27T16:34:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.641+0000 7f7744ace700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f77400b12c0 0x7f77400cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:32.649 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.641+0000 7f77452cf700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f77400cb210 0x7f77400702f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58402/0 (socket says 172.21.15.6:58402) 2022-11-27T16:34:32.650 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.641+0000 7f77452cf700 1 -- 172.21.15.6:0/3092256988 learned_addr learned my addr 172.21.15.6:0/3092256988 (peer_addr_for_me v1:172.21.15.6:0/0) 2022-11-27T16:34:32.650 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.641+0000 7f773ffff700 1 --2- 172.21.15.6:0/3092256988 >> v2:172.21.15.55:3300/0 conn(0x7f77400cb760 0x7f77400cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:32.650 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.641+0000 7f7744ace700 1 -- 172.21.15.6:0/3092256988 >> v2:172.21.15.55:3300/0 conn(0x7f77400cb760 msgr2=0x7f77400cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:32.650 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.641+0000 7f7744ace700 1 --2- 172.21.15.6:0/3092256988 >> v2:172.21.15.55:3300/0 conn(0x7f77400cb760 0x7f77400cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.641+0000 7f7744ace700 1 -- 172.21.15.6:0/3092256988 >> v1:172.21.15.6:6789/0 conn(0x7f77400cb210 legacy=0x7f77400702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.641+0000 7f7744ace700 1 -- 172.21.15.6:0/3092256988 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774015cdf0 con 0x7f77400b12c0 2022-11-27T16:34:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.641+0000 7f773f7fe700 1 -- 172.21.15.6:0/3092256988 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806528195 0 0) 0x7f77400c9880 con 0x7f77400cb210 2022-11-27T16:34:32.651 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.641+0000 7f7744ace700 1 --2- 172.21.15.6:0/3092256988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77400b12c0 0x7f77400cd180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7740071790 tx=0x7f773800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1223b717853aa51 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:32.652 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.641+0000 7f773f7fe700 1 -- 172.21.15.6:0/3092256988 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773800e070 con 0x7f77400b12c0 2022-11-27T16:34:32.652 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.641+0000 7f773f7fe700 1 -- 172.21.15.6:0/3092256988 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773800bbd0 con 0x7f77400b12c0 2022-11-27T16:34:32.652 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.641+0000 7f773f7fe700 1 -- 172.21.15.6:0/3092256988 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738012430 con 0x7f77400b12c0 2022-11-27T16:34:32.652 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.642+0000 7f7746d32700 1 -- 172.21.15.6:0/3092256988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77400b12c0 msgr2=0x7f77400cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:32.652 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.642+0000 7f7746d32700 1 --2- 172.21.15.6:0/3092256988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77400b12c0 0x7f77400cd180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7740071790 tx=0x7f773800b330 comp rx=0 tx=0).stop 2022-11-27T16:34:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.642+0000 7f7746d32700 1 -- 172.21.15.6:0/3092256988 shutdown_connections 2022-11-27T16:34:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.642+0000 7f7746d32700 1 --2- 172.21.15.6:0/3092256988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77400b12c0 0x7f77400cd180 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.642+0000 7f7746d32700 1 --2- 172.21.15.6:0/3092256988 >> v2:172.21.15.55:3300/0 conn(0x7f77400cb760 0x7f77400cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:32.653 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.642+0000 7f7746d32700 1 -- 172.21.15.6:0/3092256988 >> 172.21.15.6:0/3092256988 conn(0x7f77400cbc00 msgr2=0x7f77400cc000 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.642+0000 7f7746d32700 1 -- 172.21.15.6:0/3092256988 shutdown_connections 2022-11-27T16:34:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.642+0000 7f7746d32700 1 -- 172.21.15.6:0/3092256988 wait complete. 2022-11-27T16:34:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.643+0000 7f7746d32700 1 Processor -- start 2022-11-27T16:34:32.654 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.643+0000 7f7746d32700 1 -- start start 2022-11-27T16:34:32.655 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.644+0000 7f7746d32700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77400b12c0 0x7f774014dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:32.655 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.644+0000 7f7746d32700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77400cb210 0x7f77401569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:32.655 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.644+0000 7f7746d32700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f77400cb760 0x7f77400c7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:32.655 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.644+0000 7f7746d32700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774014e260 con 0x7f77400b12c0 2022-11-27T16:34:32.656 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.644+0000 7f7746d32700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7740156520 con 0x7f77400cb210 2022-11-27T16:34:32.656 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.644+0000 7f7746d32700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77400c6ff0 con 0x7f77400cb760 2022-11-27T16:34:32.656 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.644+0000 7f7744ace700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77400b12c0 0x7f774014dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:32.656 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.644+0000 7f7744ace700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77400b12c0 0x7f774014dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58864/0 (socket says 172.21.15.6:58864) 2022-11-27T16:34:32.657 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.644+0000 7f7744ace700 1 -- 172.21.15.6:0/941340324 learned_addr learned my addr 172.21.15.6:0/941340324 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:32.657 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.644+0000 7f773ffff700 1 --2- 172.21.15.6:0/941340324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77400cb210 0x7f77401569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:32.657 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.644+0000 7f77452cf700 1 --2- 172.21.15.6:0/941340324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f77400cb760 0x7f77400c7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:32.657 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.644+0000 7f7744ace700 1 -- 172.21.15.6:0/941340324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f77400cb760 msgr2=0x7f77400c7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:32.657 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.644+0000 7f7744ace700 1 --2- 172.21.15.6:0/941340324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f77400cb760 0x7f77400c7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.644+0000 7f7744ace700 1 -- 172.21.15.6:0/941340324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77400cb210 msgr2=0x7f77401569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.644+0000 7f7744ace700 1 --2- 172.21.15.6:0/941340324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77400cb210 0x7f77401569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.644+0000 7f7744ace700 1 -- 172.21.15.6:0/941340324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7738009a70 con 0x7f77400b12c0 2022-11-27T16:34:32.658 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.645+0000 7f7744ace700 1 --2- 172.21.15.6:0/941340324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77400b12c0 0x7f774014dd20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7738014040 tx=0x7f7738004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:32.659 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.645+0000 7f773d7fa700 1 -- 172.21.15.6:0/941340324 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738012430 con 0x7f77400b12c0 2022-11-27T16:34:32.659 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.645+0000 7f773d7fa700 1 -- 172.21.15.6:0/941340324 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7738020070 con 0x7f77400b12c0 2022-11-27T16:34:32.659 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.645+0000 7f7746d32700 1 -- 172.21.15.6:0/941340324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7740155ed0 con 0x7f77400b12c0 2022-11-27T16:34:32.659 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.645+0000 7f773d7fa700 1 -- 172.21.15.6:0/941340324 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738004280 con 0x7f77400b12c0 2022-11-27T16:34:32.659 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.645+0000 7f7746d32700 1 -- 172.21.15.6:0/941340324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7740156ef0 con 0x7f77400b12c0 2022-11-27T16:34:32.660 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.646+0000 7f7746d32700 1 -- 172.21.15.6:0/941340324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7740155d30 con 0x7f77400b12c0 2022-11-27T16:34:32.661 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.646+0000 7f773d7fa700 1 -- 172.21.15.6:0/941340324 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7f773802e070 con 0x7f77400b12c0 2022-11-27T16:34:32.661 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.647+0000 7f773d7fa700 1 --2- 172.21.15.6:0/941340324 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f77240665c0 0x7f7724068a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:32.661 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.647+0000 7f773d7fa700 1 -- 172.21.15.6:0/941340324 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7738022070 con 0x7f77400b12c0 2022-11-27T16:34:32.662 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.647+0000 7f773ffff700 1 --2- 172.21.15.6:0/941340324 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f77240665c0 0x7f7724068a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:32.662 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.647+0000 7f773ffff700 1 --2- 172.21.15.6:0/941340324 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f77240665c0 0x7f7724068a70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7740151950 tx=0x7f7728008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:32.662 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.651+0000 7f773d7fa700 1 -- 172.21.15.6:0/941340324 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170936 (secure 0 0 0) 0x7f7740155d30 con 0x7f77400b12c0 2022-11-27T16:34:32.846 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.844+0000 7f7746d32700 1 -- 172.21.15.6:0/941340324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7740155d30 con 0x7f77400b12c0 2022-11-27T16:34:32.847 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.844+0000 7f773d7fa700 1 -- 172.21.15.6:0/941340324 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13658 (secure 0 0 0) 0x7f7740155d30 con 0x7f77400b12c0 2022-11-27T16:34:32.847 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:34:32.848 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"fsid":"993fccdc-c4ec-45c7-83f5-38e6210b61dd","created":"2022-11-27T16:34:12.138951+0000","modified":"2022-11-27T16:34:32.460241+0000","last_up_change":"2022-11-27T16:34:23.393159+0000","last_in_change":"2022-11-27T16:34:14.739276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-11-27T16:34:23.785795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-11-27T16:34:30.782541+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a1c510ff-24f3-497e-823f-73d31df5e534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":101340},{"type":"v1","addr":"172.21.15.6:6809","nonce":101340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":101340},{"type":"v1","addr":"172.21.15.6:6811","nonce":101340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":101340},{"type":"v1","addr":"172.21.15.6:6815","nonce":101340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":101340},{"type":"v1","addr":"172.21.15.6:6813","nonce":101340}]},"public_addr":"172.21.15.6:6809/101340","cluster_addr":"172.21.15.6:6811/101340","heartbeat_back_addr":"172.21.15.6:6815/101340","heartbeat_front_addr":"172.21.15.6:6813/101340","state":["exists","up"]},{"osd":1,"uuid":"01055301-2278-4c5b-9963-8787137b7db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":101342},{"type":"v1","addr":"172.21.15.6:6823","nonce":101342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":101342},{"type":"v1","addr":"172.21.15.6:6827","nonce":101342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":101342},{"type":"v1","addr":"172.21.15.6:6831","nonce":101342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":101342},{"type":"v1","addr":"172.21.15.6:6829","nonce":101342}]},"public_addr":"172.21.15.6:6823/101342","cluster_addr":"172.21.15.6:6827/101342","heartbeat_back_addr":"172.21.15.6:6831/101342","heartbeat_front_addr":"172.21.15.6:6829/101342","state":["exists","up"]},{"osd":2,"uuid":"d523a914-8041-42f7-a369-33e54681eb9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":101343},{"type":"v1","addr":"172.21.15.6:6817","nonce":101343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":101343},{"type":"v1","addr":"172.21.15.6:6819","nonce":101343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":101343},{"type":"v1","addr":"172.21.15.6:6826","nonce":101343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":101343},{"type":"v1","addr":"172.21.15.6:6822","nonce":101343}]},"public_addr":"172.21.15.6:6817/101343","cluster_addr":"172.21.15.6:6819/101343","heartbeat_back_addr":"172.21.15.6:6826/101343","heartbeat_front_addr":"172.21.15.6:6822/101343","state":["exists","up"]},{"osd":3,"uuid":"d981890c-4dc6-4292-89f8-a11a3b529962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":101341},{"type":"v1","addr":"172.21.15.6:6801","nonce":101341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":101341},{"type":"v1","addr":"172.21.15.6:6803","nonce":101341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":101341},{"type":"v1","addr":"172.21.15.6:6807","nonce":101341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":101341},{"type":"v1","addr":"172.21.15.6:6805","nonce":101341}]},"public_addr":"172.21.15.6:6801/101341","cluster_addr":"172.21.15.6:6803/101341","heartbeat_back_addr":"172.21.15.6:6807/101341","heartbeat_front_addr":"172.21.15.6:6805/101341","state":["exists","up"]},{"osd":4,"uuid":"de3bdb57-3fc0-4353-a4cf-394d28ed0404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":101567},{"type":"v1","addr":"172.21.15.55:6801","nonce":101567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":101567},{"type":"v1","addr":"172.21.15.55:6803","nonce":101567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":101567},{"type":"v1","addr":"172.21.15.55:6807","nonce":101567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":101567},{"type":"v1","addr":"172.21.15.55:6805","nonce":101567}]},"public_addr":"172.21.15.55:6801/101567","cluster_addr":"172.21.15.55:6803/101567","heartbeat_back_addr":"172.21.15.55:6807/101567","heartbeat_front_addr":"172.21.15.55:6805/101567","state":["exists","up"]},{"osd":5,"uuid":"8eb1bfed-50ab-408d-8908-9f855f49a683","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":101577},{"type":"v1","addr":"172.21.15.55:6817","nonce":101577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":101577},{"type":"v1","addr":"172.21.15.55:6819","nonce":101577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":101577},{"type":"v1","addr":"172.21.15.55:6823","nonce":101577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":101577},{"type":"v1","addr":"172.21.15.55:6821","nonce":101577}]},"public_addr":"172.21.15.55:6817/101577","cluster_addr":"172.21.15.55:6819/101577","heartbeat_back_addr":"172.21.15.55:6823/101577","heartbeat_front_addr":"172.21.15.55:6821/101577","state":["exists","up"]},{"osd":6,"uuid":"be781377-2ff8-4b5c-8ce8-5cde163b4956","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":101568},{"type":"v1","addr":"172.21.15.55:6809","nonce":101568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":101568},{"type":"v1","addr":"172.21.15.55:6811","nonce":101568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":101568},{"type":"v1","addr":"172.21.15.55:6815","nonce":101568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":101568},{"type":"v1","addr":"172.21.15.55:6813","nonce":101568}]},"public_addr":"172.21.15.55:6809/101568","cluster_addr":"172.21.15.55:6811/101568","heartbeat_back_addr":"172.21.15.55:6815/101568","heartbeat_front_addr":"172.21.15.55:6813/101568","state":["exists","up"]},{"osd":7,"uuid":"2940a706-2632-4794-8d6f-dc8df69cf11f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":101598},{"type":"v1","addr":"172.21.15.55:6825","nonce":101598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":101598},{"type":"v1","addr":"172.21.15.55:6827","nonce":101598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":101598},{"type":"v1","addr":"172.21.15.55:6831","nonce":101598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":101598},{"type":"v1","addr":"172.21.15.55:6829","nonce":101598}]},"public_addr":"172.21.15.55:6825/101598","cluster_addr":"172.21.15.55:6827/101598","heartbeat_back_addr":"172.21.15.55:6831/101598","heartbeat_front_addr":"172.21.15.55:6829/101598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.901980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.967714+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.968394+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.862378+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.910978+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.919584+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.868135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.951725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-11-27T16:34:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.846+0000 7f7746d32700 1 -- 172.21.15.6:0/941340324 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f77240665c0 msgr2=0x7f7724068a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:32.849 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.846+0000 7f7746d32700 1 --2- 172.21.15.6:0/941340324 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f77240665c0 0x7f7724068a70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7740151950 tx=0x7f7728008040 comp rx=0 tx=0).stop 2022-11-27T16:34:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.846+0000 7f7746d32700 1 -- 172.21.15.6:0/941340324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77400b12c0 msgr2=0x7f774014dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.846+0000 7f7746d32700 1 --2- 172.21.15.6:0/941340324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77400b12c0 0x7f774014dd20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7738014040 tx=0x7f7738004ad0 comp rx=0 tx=0).stop 2022-11-27T16:34:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.847+0000 7f7746d32700 1 -- 172.21.15.6:0/941340324 shutdown_connections 2022-11-27T16:34:32.850 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.847+0000 7f7746d32700 1 --2- 172.21.15.6:0/941340324 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f77240665c0 0x7f7724068a70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.847+0000 7f7746d32700 1 --2- 172.21.15.6:0/941340324 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f77400cb760 0x7f77400c7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.847+0000 7f7746d32700 1 --2- 172.21.15.6:0/941340324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77400b12c0 0x7f774014dd20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.847+0000 7f7746d32700 1 --2- 172.21.15.6:0/941340324 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77400cb210 0x7f77401569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.847+0000 7f7746d32700 1 -- 172.21.15.6:0/941340324 >> 172.21.15.6:0/941340324 conn(0x7f77400cbc00 msgr2=0x7f77400ccf40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:32.851 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.847+0000 7f7746d32700 1 -- 172.21.15.6:0/941340324 shutdown_connections 2022-11-27T16:34:32.852 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.847+0000 7f7746d32700 1 -- 172.21.15.6:0/941340324 wait complete. 2022-11-27T16:34:32.861 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-11-27T16:34:23.785795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-11-27T16:34:30.782541+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-11-27T16:34:32.862 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-11-27T16:34:32.990 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.987+0000 7f09f9959700 1 Processor -- start 2022-11-27T16:34:32.990 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.987+0000 7f09f9959700 1 -- start start 2022-11-27T16:34:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.988+0000 7f09f9959700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f09f40b5a60 0x7f09f40ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.988+0000 7f09f9959700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f40b2950 0x7f09f40ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.988+0000 7f09f9959700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f40cc720 con 0x7f09f40cd0d0 2022-11-27T16:34:32.993 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.988+0000 7f09f9959700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f40cd540 con 0x7f09f40b5a60 2022-11-27T16:34:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.988+0000 7f09f9959700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f4159fc0 con 0x7f09f40b2950 2022-11-27T16:34:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.988+0000 7f09f27fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f40b2950 0x7f09f40ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.988+0000 7f09f2ffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f09f40b5a60 0x7f09f40ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:32.994 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.988+0000 7f09f27fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f40b2950 0x7f09f40ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.6:47974/0 (socket says 172.21.15.6:47974) 2022-11-27T16:34:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.988+0000 7f09f2ffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f09f40b5a60 0x7f09f40ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.6:51100/0 (socket says 172.21.15.6:51100) 2022-11-27T16:34:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.988+0000 7f09f27fc700 1 -- 172.21.15.6:0/3638632289 learned_addr learned my addr 172.21.15.6:0/3638632289 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.988+0000 7f09f37fe700 1 --1- 172.21.15.6:0/3638632289 >> v1:172.21.15.55:6789/0 conn(0x7f09f40cd0d0 0x7f09f415d6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.6:44814/0 (socket says 172.21.15.6:44814) 2022-11-27T16:34:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.989+0000 7f09f2ffd700 1 -- 172.21.15.6:0/3638632289 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f40b2950 msgr2=0x7f09f40ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:32.995 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.989+0000 7f09f2ffd700 1 --2- 172.21.15.6:0/3638632289 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f40b2950 0x7f09f40ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:32.996 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.989+0000 7f09f2ffd700 1 -- 172.21.15.6:0/3638632289 >> v1:172.21.15.55:6789/0 conn(0x7f09f40cd0d0 legacy=0x7f09f415d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:32.996 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.989+0000 7f09f2ffd700 1 -- 172.21.15.6:0/3638632289 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f40cedc0 con 0x7f09f40b5a60 2022-11-27T16:34:32.996 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.989+0000 7f09f2ffd700 1 --2- 172.21.15.6:0/3638632289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f40b5a60 0x7f09f40ce7c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009840 tx=0x7f09e8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=620f6f723e81056 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:32.996 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.989+0000 7f09f1ffb700 1 -- 172.21.15.6:0/3638632289 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8011830 con 0x7f09f40b5a60 2022-11-27T16:34:32.997 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.989+0000 7f09f1ffb700 1 -- 172.21.15.6:0/3638632289 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e8011990 con 0x7f09f40b5a60 2022-11-27T16:34:32.997 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.989+0000 7f09f1ffb700 1 -- 172.21.15.6:0/3638632289 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8011d20 con 0x7f09f40b5a60 2022-11-27T16:34:32.997 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.990+0000 7f09f9959700 1 -- 172.21.15.6:0/3638632289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f40b5a60 msgr2=0x7f09f40ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:32.997 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.990+0000 7f09f9959700 1 --2- 172.21.15.6:0/3638632289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f40b5a60 0x7f09f40ce7c0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f09e8009840 tx=0x7f09e8009b50 comp rx=0 tx=0).stop 2022-11-27T16:34:32.998 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.990+0000 7f09f9959700 1 -- 172.21.15.6:0/3638632289 shutdown_connections 2022-11-27T16:34:32.998 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.990+0000 7f09f9959700 1 --2- 172.21.15.6:0/3638632289 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f40b5a60 0x7f09f40ce7c0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:32.998 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.990+0000 7f09f9959700 1 --2- 172.21.15.6:0/3638632289 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f40b2950 0x7f09f40ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:32.998 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.990+0000 7f09f9959700 1 -- 172.21.15.6:0/3638632289 >> 172.21.15.6:0/3638632289 conn(0x7f09f4064ec0 msgr2=0x7f09f4065290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:32.998 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.990+0000 7f09f9959700 1 -- 172.21.15.6:0/3638632289 shutdown_connections 2022-11-27T16:34:32.999 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.990+0000 7f09f9959700 1 -- 172.21.15.6:0/3638632289 wait complete. 2022-11-27T16:34:33.002 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.991+0000 7f09f9959700 1 Processor -- start 2022-11-27T16:34:33.002 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.992+0000 7f09f9959700 1 -- start start 2022-11-27T16:34:33.003 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.992+0000 7f09f9959700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f40b2950 0x7f09f415ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:33.003 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09f9959700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f40b5a60 0x7f09f40c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:33.003 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09f9959700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f40cd0d0 0x7f09f40c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:33.003 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09f9959700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f4154a90 con 0x7f09f40b5a60 2022-11-27T16:34:33.004 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09f9959700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f415c000 con 0x7f09f40cd0d0 2022-11-27T16:34:33.004 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09f9959700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f4155010 con 0x7f09f40b2950 2022-11-27T16:34:33.004 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09f27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f40b5a60 0x7f09f40c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:33.004 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09f27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f40b5a60 0x7f09f40c60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58878/0 (socket says 172.21.15.6:58878) 2022-11-27T16:34:33.005 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09f27fc700 1 -- 172.21.15.6:0/3088465423 learned_addr learned my addr 172.21.15.6:0/3088465423 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:33.005 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09f37fe700 1 --2- 172.21.15.6:0/3088465423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f40cd0d0 0x7f09f40c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:33.005 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09f2ffd700 1 --2- 172.21.15.6:0/3088465423 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f40b2950 0x7f09f415ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:33.005 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09f27fc700 1 -- 172.21.15.6:0/3088465423 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f40b2950 msgr2=0x7f09f415ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:33.005 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09f27fc700 1 --2- 172.21.15.6:0/3088465423 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f40b2950 0x7f09f415ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.006 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09f27fc700 1 -- 172.21.15.6:0/3088465423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f40cd0d0 msgr2=0x7f09f40c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:33.006 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09f27fc700 1 --2- 172.21.15.6:0/3088465423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f40cd0d0 0x7f09f40c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.006 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09f27fc700 1 -- 172.21.15.6:0/3088465423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e80094a0 con 0x7f09f40b5a60 2022-11-27T16:34:33.006 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09f27fc700 1 --2- 172.21.15.6:0/3088465423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f40b5a60 0x7f09f40c60e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f09e400e910 tx=0x7f09e400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:33.007 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09dbfff700 1 -- 172.21.15.6:0/3088465423 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e40096a0 con 0x7f09f40b5a60 2022-11-27T16:34:33.007 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09dbfff700 1 -- 172.21.15.6:0/3088465423 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e4013680 con 0x7f09f40b5a60 2022-11-27T16:34:33.007 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09dbfff700 1 -- 172.21.15.6:0/3088465423 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4013a30 con 0x7f09f40b5a60 2022-11-27T16:34:33.007 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09f9959700 1 -- 172.21.15.6:0/3088465423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f40c6b60 con 0x7f09f40b5a60 2022-11-27T16:34:33.008 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.993+0000 7f09f9959700 1 -- 172.21.15.6:0/3088465423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f415c250 con 0x7f09f40b5a60 2022-11-27T16:34:33.008 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.994+0000 7f09f9959700 1 -- 172.21.15.6:0/3088465423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f4072a30 con 0x7f09f40b5a60 2022-11-27T16:34:33.008 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.995+0000 7f09dbfff700 1 -- 172.21.15.6:0/3088465423 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7f09e4019030 con 0x7f09f40b5a60 2022-11-27T16:34:33.008 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.995+0000 7f09dbfff700 1 --2- 172.21.15.6:0/3088465423 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f09d4066590 0x7f09d4068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:33.008 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.995+0000 7f09dbfff700 1 -- 172.21.15.6:0/3088465423 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f09e4083280 con 0x7f09f40b5a60 2022-11-27T16:34:33.009 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.996+0000 7f09f2ffd700 1 --2- 172.21.15.6:0/3088465423 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f09d4066590 0x7f09d4068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:33.009 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.996+0000 7f09f2ffd700 1 --2- 172.21.15.6:0/3088465423 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f09d4066590 0x7f09d4068a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f09e8000c00 tx=0x7f09e8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:33.009 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:32.999+0000 7f09dbfff700 1 -- 172.21.15.6:0/3088465423 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170936 (secure 0 0 0) 0x7f09e4050bf0 con 0x7f09f40b5a60 2022-11-27T16:34:33.192 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.189+0000 7f09f9959700 1 -- 172.21.15.6:0/3088465423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f09f40cc310 con 0x7f09f40b5a60 2022-11-27T16:34:33.192 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.190+0000 7f09dbfff700 1 -- 172.21.15.6:0/3088465423 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f09e4054210 con 0x7f09f40b5a60 2022-11-27T16:34:33.193 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2022-11-27T16:34:33.194 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.192+0000 7f09f9959700 1 -- 172.21.15.6:0/3088465423 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f09d4066590 msgr2=0x7f09d4068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:33.195 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.192+0000 7f09f9959700 1 --2- 172.21.15.6:0/3088465423 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f09d4066590 0x7f09d4068a40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f09e8000c00 tx=0x7f09e8008030 comp rx=0 tx=0).stop 2022-11-27T16:34:33.195 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.192+0000 7f09f9959700 1 -- 172.21.15.6:0/3088465423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f40b5a60 msgr2=0x7f09f40c60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:33.195 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.192+0000 7f09f9959700 1 --2- 172.21.15.6:0/3088465423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f40b5a60 0x7f09f40c60e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f09e400e910 tx=0x7f09e400ec20 comp rx=0 tx=0).stop 2022-11-27T16:34:33.195 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.192+0000 7f09f9959700 1 -- 172.21.15.6:0/3088465423 shutdown_connections 2022-11-27T16:34:33.196 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.192+0000 7f09f9959700 1 --2- 172.21.15.6:0/3088465423 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f09d4066590 0x7f09d4068a40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.196 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.192+0000 7f09f9959700 1 --2- 172.21.15.6:0/3088465423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09f40cd0d0 0x7f09f40c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.196 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.192+0000 7f09f9959700 1 --2- 172.21.15.6:0/3088465423 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f09f40b2950 0x7f09f415ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.196 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.192+0000 7f09f9959700 1 --2- 172.21.15.6:0/3088465423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09f40b5a60 0x7f09f40c60e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.197 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.192+0000 7f09f9959700 1 -- 172.21.15.6:0/3088465423 >> 172.21.15.6:0/3088465423 conn(0x7f09f4064ec0 msgr2=0x7f09f4159090 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:33.197 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.192+0000 7f09f9959700 1 -- 172.21.15.6:0/3088465423 shutdown_connections 2022-11-27T16:34:33.197 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.192+0000 7f09f9959700 1 -- 172.21.15.6:0/3088465423 wait complete. 2022-11-27T16:34:33.206 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-11-27T16:34:33.334 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.331+0000 7fb3ff9d2700 1 Processor -- start 2022-11-27T16:34:33.334 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.331+0000 7fb3ff9d2700 1 -- start start 2022-11-27T16:34:33.337 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.332+0000 7fb3ff9d2700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3f815bd30 0x7fb3f80ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:33.338 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.332+0000 7fb3ff9d2700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb3f80ce390 0x7fb3f806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:33.338 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.332+0000 7fb3ff9d2700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f80c9c40 con 0x7fb3f806fae0 2022-11-27T16:34:33.338 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.332+0000 7fb3ff9d2700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f8070490 con 0x7fb3f815bd30 2022-11-27T16:34:33.339 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.332+0000 7fb3ff9d2700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3f815c100 con 0x7fb3f80ce390 2022-11-27T16:34:33.339 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.332+0000 7fb3fd76e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3f815bd30 0x7fb3f80ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:33.339 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.332+0000 7fb3fd76e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fb3f815bd30 0x7fb3f80ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58884/0 (socket says 172.21.15.6:58884) 2022-11-27T16:34:33.339 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.332+0000 7fb3fd76e700 1 -- 172.21.15.6:0/3502344307 learned_addr learned my addr 172.21.15.6:0/3502344307 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:33.340 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.333+0000 7fb3fdf6f700 1 --2- 172.21.15.6:0/3502344307 >> v2:172.21.15.55:3300/0 conn(0x7fb3f80ce390 0x7fb3f806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:33.340 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.333+0000 7fb3fd76e700 1 -- 172.21.15.6:0/3502344307 >> v2:172.21.15.55:3300/0 conn(0x7fb3f80ce390 msgr2=0x7fb3f806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:33.340 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.333+0000 7fb3fd76e700 1 --2- 172.21.15.6:0/3502344307 >> v2:172.21.15.55:3300/0 conn(0x7fb3f80ce390 0x7fb3f806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.341 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.333+0000 7fb3fd76e700 1 -- 172.21.15.6:0/3502344307 >> v1:172.21.15.55:6789/0 conn(0x7fb3f806fae0 legacy=0x7fb3f80cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:33.341 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.333+0000 7fb3fd76e700 1 -- 172.21.15.6:0/3502344307 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f80c9070 con 0x7fb3f815bd30 2022-11-27T16:34:33.341 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.333+0000 7fb3fdf6f700 1 --2- 172.21.15.6:0/3502344307 >> v2:172.21.15.55:3300/0 conn(0x7fb3f80ce390 0x7fb3f806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-11-27T16:34:33.341 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.333+0000 7fb3fd76e700 1 --2- 172.21.15.6:0/3502344307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f815bd30 0x7fb3f80ca0d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8065500 tx=0x7fb3e8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecdc6e41c4272887 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:33.342 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.333+0000 7fb3effff700 1 -- 172.21.15.6:0/3502344307 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8004230 con 0x7fb3f815bd30 2022-11-27T16:34:33.342 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.333+0000 7fb3effff700 1 -- 172.21.15.6:0/3502344307 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e8004390 con 0x7fb3f815bd30 2022-11-27T16:34:33.342 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.333+0000 7fb3effff700 1 -- 172.21.15.6:0/3502344307 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e80036a0 con 0x7fb3f815bd30 2022-11-27T16:34:33.342 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.333+0000 7fb3ff9d2700 1 -- 172.21.15.6:0/3502344307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f815bd30 msgr2=0x7fb3f80ca0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:33.343 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.333+0000 7fb3ff9d2700 1 --2- 172.21.15.6:0/3502344307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f815bd30 0x7fb3f80ca0d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8065500 tx=0x7fb3e8009bd0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.343 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.334+0000 7fb3ff9d2700 1 -- 172.21.15.6:0/3502344307 shutdown_connections 2022-11-27T16:34:33.343 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.334+0000 7fb3ff9d2700 1 --2- 172.21.15.6:0/3502344307 >> v2:172.21.15.55:3300/0 conn(0x7fb3f80ce390 0x7fb3f806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.343 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.334+0000 7fb3ff9d2700 1 --2- 172.21.15.6:0/3502344307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f815bd30 0x7fb3f80ca0d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.344 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.334+0000 7fb3ff9d2700 1 -- 172.21.15.6:0/3502344307 >> 172.21.15.6:0/3502344307 conn(0x7fb3f80ce8f0 msgr2=0x7fb3f80cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:33.345 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.334+0000 7fb3ff9d2700 1 -- 172.21.15.6:0/3502344307 shutdown_connections 2022-11-27T16:34:33.345 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.334+0000 7fb3ff9d2700 1 -- 172.21.15.6:0/3502344307 wait complete. 2022-11-27T16:34:33.346 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.335+0000 7fb3ff9d2700 1 Processor -- start 2022-11-27T16:34:33.346 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.335+0000 7fb3ff9d2700 1 -- start start 2022-11-27T16:34:33.350 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3ff9d2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3f806fae0 0x7fb3f8152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:33.350 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3ff9d2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f80ce390 0x7fb3f81f1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:33.350 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3ff9d2700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3f815bd30 0x7fb3f815e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:33.351 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3ff9d2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f8156b90 con 0x7fb3f80ce390 2022-11-27T16:34:33.351 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3ff9d2700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f815eb50 con 0x7fb3f806fae0 2022-11-27T16:34:33.351 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3ff9d2700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f8158550 con 0x7fb3f815bd30 2022-11-27T16:34:33.352 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3fcf6d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f80ce390 0x7fb3f81f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:33.352 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3fcf6d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f80ce390 0x7fb3f81f1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58892/0 (socket says 172.21.15.6:58892) 2022-11-27T16:34:33.352 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3fcf6d700 1 -- 172.21.15.6:0/3090207963 learned_addr learned my addr 172.21.15.6:0/3090207963 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:33.353 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3fd76e700 1 --2- 172.21.15.6:0/3090207963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3f806fae0 0x7fb3f8152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:33.353 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3fcf6d700 1 -- 172.21.15.6:0/3090207963 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3f815bd30 msgr2=0x7fb3f815e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:33.353 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3fdf6f700 1 --2- 172.21.15.6:0/3090207963 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3f815bd30 0x7fb3f815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:33.353 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3fcf6d700 1 --2- 172.21.15.6:0/3090207963 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3f815bd30 0x7fb3f815e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.354 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3fcf6d700 1 -- 172.21.15.6:0/3090207963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3f806fae0 msgr2=0x7fb3f8152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:33.354 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3fcf6d700 1 --2- 172.21.15.6:0/3090207963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3f806fae0 0x7fb3f8152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.354 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3fcf6d700 1 -- 172.21.15.6:0/3090207963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e8009550 con 0x7fb3f80ce390 2022-11-27T16:34:33.354 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3fd76e700 1 --2- 172.21.15.6:0/3090207963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3f806fae0 0x7fb3f8152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-11-27T16:34:33.355 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3fcf6d700 1 --2- 172.21.15.6:0/3090207963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f80ce390 0x7fb3f81f1860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400b4a0 tx=0x7fb3f400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:33.355 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3edffb700 1 -- 172.21.15.6:0/3090207963 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4011830 con 0x7fb3f80ce390 2022-11-27T16:34:33.355 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3edffb700 1 -- 172.21.15.6:0/3090207963 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f4011990 con 0x7fb3f80ce390 2022-11-27T16:34:33.356 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3edffb700 1 -- 172.21.15.6:0/3090207963 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4011d40 con 0x7fb3f80ce390 2022-11-27T16:34:33.356 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.336+0000 7fb3ff9d2700 1 -- 172.21.15.6:0/3090207963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f81f1e90 con 0x7fb3f80ce390 2022-11-27T16:34:33.356 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.337+0000 7fb3ff9d2700 1 -- 172.21.15.6:0/3090207963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f81f2450 con 0x7fb3f80ce390 2022-11-27T16:34:33.356 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.337+0000 7fb3ff9d2700 1 -- 172.21.15.6:0/3090207963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f8156d00 con 0x7fb3f80ce390 2022-11-27T16:34:33.357 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.338+0000 7fb3edffb700 1 -- 172.21.15.6:0/3090207963 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7fb3f400f050 con 0x7fb3f80ce390 2022-11-27T16:34:33.357 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.338+0000 7fb3edffb700 1 --2- 172.21.15.6:0/3090207963 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fb3e0066590 0x7fb3e0068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:33.357 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.338+0000 7fb3edffb700 1 -- 172.21.15.6:0/3090207963 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb3f4083050 con 0x7fb3f80ce390 2022-11-27T16:34:33.357 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.338+0000 7fb3fd76e700 1 --2- 172.21.15.6:0/3090207963 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fb3e0066590 0x7fb3e0068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:33.358 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.339+0000 7fb3fd76e700 1 --2- 172.21.15.6:0/3090207963 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fb3e0066590 0x7fb3e0068a40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009c10 tx=0x7fb3e8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:33.358 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.342+0000 7fb3edffb700 1 -- 172.21.15.6:0/3090207963 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170936 (secure 0 0 0) 0x7fb3f8156d00 con 0x7fb3f80ce390 2022-11-27T16:34:33.535 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.533+0000 7fb3ff9d2700 1 -- 172.21.15.6:0/3090207963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb3f8068b70 con 0x7fb3f80ce390 2022-11-27T16:34:33.536 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.533+0000 7fb3edffb700 1 -- 172.21.15.6:0/3090207963 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb3f4050ab0 con 0x7fb3f80ce390 2022-11-27T16:34:33.537 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2022-11-27T16:34:33.539 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.535+0000 7fb3ff9d2700 1 -- 172.21.15.6:0/3090207963 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fb3e0066590 msgr2=0x7fb3e0068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:33.540 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.535+0000 7fb3ff9d2700 1 --2- 172.21.15.6:0/3090207963 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fb3e0066590 0x7fb3e0068a40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009c10 tx=0x7fb3e8008030 comp rx=0 tx=0).stop 2022-11-27T16:34:33.540 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.535+0000 7fb3ff9d2700 1 -- 172.21.15.6:0/3090207963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f80ce390 msgr2=0x7fb3f81f1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:33.540 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.535+0000 7fb3ff9d2700 1 --2- 172.21.15.6:0/3090207963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f80ce390 0x7fb3f81f1860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400b4a0 tx=0x7fb3f400b860 comp rx=0 tx=0).stop 2022-11-27T16:34:33.541 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.535+0000 7fb3ff9d2700 1 -- 172.21.15.6:0/3090207963 shutdown_connections 2022-11-27T16:34:33.541 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.535+0000 7fb3ff9d2700 1 --2- 172.21.15.6:0/3090207963 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fb3e0066590 0x7fb3e0068a40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.542 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.535+0000 7fb3ff9d2700 1 --2- 172.21.15.6:0/3090207963 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3f815bd30 0x7fb3f815e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.542 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.535+0000 7fb3ff9d2700 1 --2- 172.21.15.6:0/3090207963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3f806fae0 0x7fb3f8152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.542 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.535+0000 7fb3ff9d2700 1 --2- 172.21.15.6:0/3090207963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3f80ce390 0x7fb3f81f1860 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.543 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.535+0000 7fb3ff9d2700 1 -- 172.21.15.6:0/3090207963 >> 172.21.15.6:0/3090207963 conn(0x7fb3f80ce8f0 msgr2=0x7fb3f80ca6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:33.543 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.535+0000 7fb3ff9d2700 1 -- 172.21.15.6:0/3090207963 shutdown_connections 2022-11-27T16:34:33.544 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.536+0000 7fb3ff9d2700 1 -- 172.21.15.6:0/3090207963 wait complete. 2022-11-27T16:34:33.550 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-11-27T16:34:33.675 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.673+0000 7fea34f73700 1 Processor -- start 2022-11-27T16:34:33.676 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.673+0000 7fea34f73700 1 -- start start 2022-11-27T16:34:33.679 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.674+0000 7fea34f73700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fea300ca0c0 0x7fea300cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:33.679 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.674+0000 7fea34f73700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea3006d3f0 0x7fea300c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:33.680 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.674+0000 7fea34f73700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea300ce740 con 0x7fea3006fae0 2022-11-27T16:34:33.680 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.674+0000 7fea34f73700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea3006bf80 con 0x7fea3006d3f0 2022-11-27T16:34:33.680 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.674+0000 7fea34f73700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea300ce180 con 0x7fea300ca0c0 2022-11-27T16:34:33.680 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.674+0000 7fea2dd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea3006d3f0 0x7fea300c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.674+0000 7fea2dd9b700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fea3006d3f0 0x7fea300c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58906/0 (socket says 172.21.15.6:58906) 2022-11-27T16:34:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.674+0000 7fea2ed9d700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fea3006fae0 0x7fea3006c410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58444/0 (socket says 172.21.15.6:58444) 2022-11-27T16:34:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.674+0000 7fea2dd9b700 1 -- 172.21.15.6:0/4220335463 learned_addr learned my addr 172.21.15.6:0/4220335463 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.674+0000 7fea2e59c700 1 --2- 172.21.15.6:0/4220335463 >> v2:172.21.15.55:3300/0 conn(0x7fea300ca0c0 0x7fea300cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.674+0000 7fea2dd9b700 1 -- 172.21.15.6:0/4220335463 >> v2:172.21.15.55:3300/0 conn(0x7fea300ca0c0 msgr2=0x7fea300cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.674+0000 7fea2dd9b700 1 --2- 172.21.15.6:0/4220335463 >> v2:172.21.15.55:3300/0 conn(0x7fea300ca0c0 0x7fea300cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.674+0000 7fea2dd9b700 1 -- 172.21.15.6:0/4220335463 >> v1:172.21.15.6:6789/0 conn(0x7fea3006fae0 legacy=0x7fea3006c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:33.683 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.674+0000 7fea2dd9b700 1 -- 172.21.15.6:0/4220335463 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea300ce460 con 0x7fea3006d3f0 2022-11-27T16:34:33.683 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.674+0000 7fea2dd9b700 1 --2- 172.21.15.6:0/4220335463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea3006d3f0 0x7fea300c8f40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fea30070820 tx=0x7fea20009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a9347faec92172 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:33.683 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.675+0000 7fea2d59a700 1 -- 172.21.15.6:0/4220335463 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2000b870 con 0x7fea3006d3f0 2022-11-27T16:34:33.683 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.675+0000 7fea2d59a700 1 -- 172.21.15.6:0/4220335463 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2000b9d0 con 0x7fea3006d3f0 2022-11-27T16:34:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.675+0000 7fea2d59a700 1 -- 172.21.15.6:0/4220335463 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2000bd60 con 0x7fea3006d3f0 2022-11-27T16:34:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.675+0000 7fea34f73700 1 -- 172.21.15.6:0/4220335463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea3006d3f0 msgr2=0x7fea300c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.675+0000 7fea34f73700 1 --2- 172.21.15.6:0/4220335463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea3006d3f0 0x7fea300c8f40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fea30070820 tx=0x7fea20009bd0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.675+0000 7fea34f73700 1 -- 172.21.15.6:0/4220335463 shutdown_connections 2022-11-27T16:34:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.675+0000 7fea34f73700 1 --2- 172.21.15.6:0/4220335463 >> v2:172.21.15.55:3300/0 conn(0x7fea300ca0c0 0x7fea300cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.675+0000 7fea34f73700 1 --2- 172.21.15.6:0/4220335463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea3006d3f0 0x7fea300c8f40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.675+0000 7fea34f73700 1 -- 172.21.15.6:0/4220335463 >> 172.21.15.6:0/4220335463 conn(0x7fea300ce8f0 msgr2=0x7fea300cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.675+0000 7fea34f73700 1 -- 172.21.15.6:0/4220335463 shutdown_connections 2022-11-27T16:34:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.675+0000 7fea34f73700 1 -- 172.21.15.6:0/4220335463 wait complete. 2022-11-27T16:34:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.677+0000 7fea34f73700 1 Processor -- start 2022-11-27T16:34:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.677+0000 7fea34f73700 1 -- start start 2022-11-27T16:34:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.677+0000 7fea34f73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea3006d3f0 0x7fea3015a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.677+0000 7fea34f73700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea3006fae0 0x7fea3014d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.677+0000 7fea34f73700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fea300ca0c0 0x7fea30159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.677+0000 7fea34f73700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3015b270 con 0x7fea3006d3f0 2022-11-27T16:34:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.677+0000 7fea34f73700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea300c4360 con 0x7fea3006fae0 2022-11-27T16:34:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.677+0000 7fea34f73700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea3015af90 con 0x7fea300ca0c0 2022-11-27T16:34:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.677+0000 7fea2e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea3006d3f0 0x7fea3015a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.677+0000 7fea2e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea3006d3f0 0x7fea3015a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58908/0 (socket says 172.21.15.6:58908) 2022-11-27T16:34:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.677+0000 7fea2e59c700 1 -- 172.21.15.6:0/480984517 learned_addr learned my addr 172.21.15.6:0/480984517 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.678+0000 7fea2dd9b700 1 --2- 172.21.15.6:0/480984517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea3006fae0 0x7fea3014d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.678+0000 7fea2e59c700 1 -- 172.21.15.6:0/480984517 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fea300ca0c0 msgr2=0x7fea30159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.678+0000 7fea2ed9d700 1 --2- 172.21.15.6:0/480984517 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fea300ca0c0 0x7fea30159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.678+0000 7fea2e59c700 1 --2- 172.21.15.6:0/480984517 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fea300ca0c0 0x7fea30159cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.678+0000 7fea2e59c700 1 -- 172.21.15.6:0/480984517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea3006fae0 msgr2=0x7fea3014d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.678+0000 7fea2e59c700 1 --2- 172.21.15.6:0/480984517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea3006fae0 0x7fea3014d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.678+0000 7fea2e59c700 1 -- 172.21.15.6:0/480984517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea20009550 con 0x7fea3006d3f0 2022-11-27T16:34:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.678+0000 7fea2dd9b700 1 --2- 172.21.15.6:0/480984517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea3006fae0 0x7fea3014d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-11-27T16:34:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.678+0000 7fea2e59c700 1 --2- 172.21.15.6:0/480984517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea3006d3f0 0x7fea3015a740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fea2400d830 tx=0x7fea2400dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:33.695 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.678+0000 7fea1effd700 1 -- 172.21.15.6:0/480984517 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea240125f0 con 0x7fea3006d3f0 2022-11-27T16:34:33.695 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.678+0000 7fea1effd700 1 -- 172.21.15.6:0/480984517 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea24012750 con 0x7fea3006d3f0 2022-11-27T16:34:33.695 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.678+0000 7fea34f73700 1 -- 172.21.15.6:0/480984517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea300c3d10 con 0x7fea3006d3f0 2022-11-27T16:34:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.678+0000 7fea1effd700 1 -- 172.21.15.6:0/480984517 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24012b00 con 0x7fea3006d3f0 2022-11-27T16:34:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.678+0000 7fea34f73700 1 -- 172.21.15.6:0/480984517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3015ac80 con 0x7fea3006d3f0 2022-11-27T16:34:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.679+0000 7fea34f73700 1 -- 172.21.15.6:0/480984517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea300c4640 con 0x7fea3006d3f0 2022-11-27T16:34:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.679+0000 7fea1effd700 1 -- 172.21.15.6:0/480984517 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7fea24012c60 con 0x7fea3006d3f0 2022-11-27T16:34:33.697 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.680+0000 7fea1effd700 1 --2- 172.21.15.6:0/480984517 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fea0c066590 0x7fea0c068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:33.697 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.680+0000 7fea1effd700 1 -- 172.21.15.6:0/480984517 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fea24083940 con 0x7fea3006d3f0 2022-11-27T16:34:33.697 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.680+0000 7fea2dd9b700 1 --2- 172.21.15.6:0/480984517 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fea0c066590 0x7fea0c068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:33.697 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.680+0000 7fea2dd9b700 1 --2- 172.21.15.6:0/480984517 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fea0c066590 0x7fea0c068a40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fea301f5140 tx=0x7fea20008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:33.698 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.684+0000 7fea1effd700 1 -- 172.21.15.6:0/480984517 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170936 (secure 0 0 0) 0x7fea240513a0 con 0x7fea3006d3f0 2022-11-27T16:34:33.922 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.919+0000 7fea34f73700 1 -- 172.21.15.6:0/480984517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea30068b70 con 0x7fea3006d3f0 2022-11-27T16:34:33.922 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.920+0000 7fea1effd700 1 -- 172.21.15.6:0/480984517 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3515 (secure 0 0 0) 0x7fea240549c0 con 0x7fea3006d3f0 2022-11-27T16:34:33.923 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:34:33.923 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6837/3669140719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6835","nonce":3669140719},{"type":"v1","addr":"172.21.15.55:6837","nonce":3669140719}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6834/947119834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":947119834},{"type":"v1","addr":"172.21.15.6:6834","nonce":947119834}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1784597877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6833","nonce":1784597877},{"type":"v1","addr":"172.21.15.6:6835","nonce":1784597877}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6836/3863992085","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":3863992085},{"type":"v1","addr":"172.21.15.55:6836","nonce":3863992085}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2022-11-27T16:34:33.925 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.922+0000 7fea34f73700 1 -- 172.21.15.6:0/480984517 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fea0c066590 msgr2=0x7fea0c068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:33.925 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.922+0000 7fea34f73700 1 --2- 172.21.15.6:0/480984517 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fea0c066590 0x7fea0c068a40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fea301f5140 tx=0x7fea20008030 comp rx=0 tx=0).stop 2022-11-27T16:34:33.926 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.922+0000 7fea34f73700 1 -- 172.21.15.6:0/480984517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea3006d3f0 msgr2=0x7fea3015a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:33.926 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.922+0000 7fea34f73700 1 --2- 172.21.15.6:0/480984517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea3006d3f0 0x7fea3015a740 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fea2400d830 tx=0x7fea2400dbf0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.926 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.922+0000 7fea34f73700 1 -- 172.21.15.6:0/480984517 shutdown_connections 2022-11-27T16:34:33.926 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.922+0000 7fea34f73700 1 --2- 172.21.15.6:0/480984517 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fea0c066590 0x7fea0c068a40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.927 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.922+0000 7fea34f73700 1 --2- 172.21.15.6:0/480984517 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fea300ca0c0 0x7fea30159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.927 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.922+0000 7fea34f73700 1 --2- 172.21.15.6:0/480984517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea3006d3f0 0x7fea3015a740 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.927 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.922+0000 7fea34f73700 1 --2- 172.21.15.6:0/480984517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea3006fae0 0x7fea3014d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:33.927 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.922+0000 7fea34f73700 1 -- 172.21.15.6:0/480984517 >> 172.21.15.6:0/480984517 conn(0x7fea300ce8f0 msgr2=0x7fea300cbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:33.927 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.922+0000 7fea34f73700 1 -- 172.21.15.6:0/480984517 shutdown_connections 2022-11-27T16:34:33.928 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:33.922+0000 7fea34f73700 1 -- 172.21.15.6:0/480984517 wait complete. 2022-11-27T16:34:33.928 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 3 2022-11-27T16:34:33.937 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-11-27T16:34:34.062 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.060+0000 7fd91141e700 1 Processor -- start 2022-11-27T16:34:34.063 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.060+0000 7fd91141e700 1 -- start start 2022-11-27T16:34:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.061+0000 7fd91141e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd90c15be90 0x7fd90c0cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.061+0000 7fd91141e700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd90c0ccde0 0x7fd90c0cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:34.066 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.061+0000 7fd91141e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd90c0cf530 con 0x7fd90c15bac0 2022-11-27T16:34:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.061+0000 7fd91141e700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd90c0cd260 con 0x7fd90c0ccde0 2022-11-27T16:34:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.061+0000 7fd91141e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c06b910 con 0x7fd90c15be90 2022-11-27T16:34:34.067 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.061+0000 7fd90b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd90c0ccde0 0x7fd90c0cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.061+0000 7fd90b7fe700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fd90c0ccde0 0x7fd90c0cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58920/0 (socket says 172.21.15.6:58920) 2022-11-27T16:34:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.061+0000 7fd90b7fe700 1 -- 172.21.15.6:0/649466053 learned_addr learned my addr 172.21.15.6:0/649466053 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.061+0000 7fd90a7fc700 1 --2- 172.21.15.6:0/649466053 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd90c15be90 0x7fd90c0cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.061+0000 7fd90b7fe700 1 -- 172.21.15.6:0/649466053 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd90c15be90 msgr2=0x7fd90c0cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:34.068 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.061+0000 7fd90b7fe700 1 --2- 172.21.15.6:0/649466053 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd90c15be90 0x7fd90c0cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.061+0000 7fd90b7fe700 1 -- 172.21.15.6:0/649466053 >> v1:172.21.15.55:6789/0 conn(0x7fd90c15bac0 legacy=0x7fd90c06a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.061+0000 7fd90b7fe700 1 -- 172.21.15.6:0/649466053 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c06bbf0 con 0x7fd90c0ccde0 2022-11-27T16:34:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.061+0000 7fd90b7fe700 1 --2- 172.21.15.6:0/649466053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c0ccde0 0x7fd90c0cfcc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd904009e50 tx=0x7fd90400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a673e61b6ceac3 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.062+0000 7fd909ffb700 1 -- 172.21.15.6:0/649466053 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90400e070 con 0x7fd90c0ccde0 2022-11-27T16:34:34.069 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.062+0000 7fd909ffb700 1 -- 172.21.15.6:0/649466053 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90400b910 con 0x7fd90c0ccde0 2022-11-27T16:34:34.070 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.062+0000 7fd909ffb700 1 -- 172.21.15.6:0/649466053 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90400bcc0 con 0x7fd90c0ccde0 2022-11-27T16:34:34.070 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.062+0000 7fd91141e700 1 -- 172.21.15.6:0/649466053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c0ccde0 msgr2=0x7fd90c0cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:34.070 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.062+0000 7fd91141e700 1 --2- 172.21.15.6:0/649466053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c0ccde0 0x7fd90c0cfcc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd904009e50 tx=0x7fd90400b330 comp rx=0 tx=0).stop 2022-11-27T16:34:34.070 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.062+0000 7fd91141e700 1 -- 172.21.15.6:0/649466053 shutdown_connections 2022-11-27T16:34:34.071 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.062+0000 7fd91141e700 1 --2- 172.21.15.6:0/649466053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c0ccde0 0x7fd90c0cfcc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.071 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.062+0000 7fd91141e700 1 --2- 172.21.15.6:0/649466053 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd90c15be90 0x7fd90c0cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.071 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.062+0000 7fd91141e700 1 -- 172.21.15.6:0/649466053 >> 172.21.15.6:0/649466053 conn(0x7fd90c064ec0 msgr2=0x7fd90c065290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.062+0000 7fd91141e700 1 -- 172.21.15.6:0/649466053 shutdown_connections 2022-11-27T16:34:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.062+0000 7fd91141e700 1 -- 172.21.15.6:0/649466053 wait complete. 2022-11-27T16:34:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.064+0000 7fd91141e700 1 Processor -- start 2022-11-27T16:34:34.072 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.064+0000 7fd91141e700 1 -- start start 2022-11-27T16:34:34.075 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.064+0000 7fd91141e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd90c0ccde0 0x7fd90c1551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.064+0000 7fd91141e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c15bac0 0x7fd90c0b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.064+0000 7fd91141e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd90c15be90 0x7fd90c1f09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.064+0000 7fd91141e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c156110 con 0x7fd90c15bac0 2022-11-27T16:34:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.064+0000 7fd91141e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c1f50b0 con 0x7fd90c15be90 2022-11-27T16:34:34.077 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.064+0000 7fd91141e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90c1f5390 con 0x7fd90c0ccde0 2022-11-27T16:34:34.077 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.064+0000 7fd90a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c15bac0 0x7fd90c0b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:34.077 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.064+0000 7fd90a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c15bac0 0x7fd90c0b5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58924/0 (socket says 172.21.15.6:58924) 2022-11-27T16:34:34.078 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.065+0000 7fd90a7fc700 1 -- 172.21.15.6:0/3550202915 learned_addr learned my addr 172.21.15.6:0/3550202915 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:34.078 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.065+0000 7fd90affd700 1 --2- 172.21.15.6:0/3550202915 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd90c0ccde0 0x7fd90c1551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:34.078 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.065+0000 7fd90b7fe700 1 --2- 172.21.15.6:0/3550202915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd90c15be90 0x7fd90c1f09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:34.078 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.065+0000 7fd90a7fc700 1 -- 172.21.15.6:0/3550202915 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd90c0ccde0 msgr2=0x7fd90c1551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.065+0000 7fd90a7fc700 1 --2- 172.21.15.6:0/3550202915 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd90c0ccde0 0x7fd90c1551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.065+0000 7fd90a7fc700 1 -- 172.21.15.6:0/3550202915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd90c15be90 msgr2=0x7fd90c1f09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.065+0000 7fd90a7fc700 1 --2- 172.21.15.6:0/3550202915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd90c15be90 0x7fd90c1f09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.079 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.065+0000 7fd90a7fc700 1 -- 172.21.15.6:0/3550202915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd904009b30 con 0x7fd90c15bac0 2022-11-27T16:34:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.065+0000 7fd90a7fc700 1 --2- 172.21.15.6:0/3550202915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c15bac0 0x7fd90c0b5290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00e870 tx=0x7fd8fc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.065+0000 7fd8f37fe700 1 -- 172.21.15.6:0/3550202915 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc009590 con 0x7fd90c15bac0 2022-11-27T16:34:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.065+0000 7fd8f37fe700 1 -- 172.21.15.6:0/3550202915 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8fc013680 con 0x7fd90c15bac0 2022-11-27T16:34:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.065+0000 7fd91141e700 1 -- 172.21.15.6:0/3550202915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90c1f5670 con 0x7fd90c15bac0 2022-11-27T16:34:34.081 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.065+0000 7fd8f37fe700 1 -- 172.21.15.6:0/3550202915 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc0139f0 con 0x7fd90c15bac0 2022-11-27T16:34:34.081 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.065+0000 7fd91141e700 1 -- 172.21.15.6:0/3550202915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90c0b57d0 con 0x7fd90c15bac0 2022-11-27T16:34:34.081 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.066+0000 7fd91141e700 1 -- 172.21.15.6:0/3550202915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90c1562c0 con 0x7fd90c15bac0 2022-11-27T16:34:34.081 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.067+0000 7fd8f37fe700 1 -- 172.21.15.6:0/3550202915 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7fd8fc019030 con 0x7fd90c15bac0 2022-11-27T16:34:34.081 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.067+0000 7fd8f37fe700 1 --2- 172.21.15.6:0/3550202915 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fd8ec066590 0x7fd8ec068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.067+0000 7fd8f37fe700 1 -- 172.21.15.6:0/3550202915 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd8fc083100 con 0x7fd90c15bac0 2022-11-27T16:34:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.067+0000 7fd90affd700 1 --2- 172.21.15.6:0/3550202915 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fd8ec066590 0x7fd8ec068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.068+0000 7fd90affd700 1 --2- 172.21.15.6:0/3550202915 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fd8ec066590 0x7fd8ec068a40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd900007fd0 tx=0x7fd900009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:34.082 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.071+0000 7fd8f37fe700 1 -- 172.21.15.6:0/3550202915 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170936 (secure 0 0 0) 0x7fd90c1562c0 con 0x7fd90c15bac0 2022-11-27T16:34:34.264 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.262+0000 7fd91141e700 1 -- 172.21.15.6:0/3550202915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd90c068b70 con 0x7fd90c15bac0 2022-11-27T16:34:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.263+0000 7fd8f37fe700 1 -- 172.21.15.6:0/3550202915 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13645 (secure 0 0 0) 0x7fd8fc050b60 con 0x7fd90c15bac0 2022-11-27T16:34:34.266 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:34:34.266 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":19,"fsid":"993fccdc-c4ec-45c7-83f5-38e6210b61dd","created":"2022-11-27T16:34:12.138951+0000","modified":"2022-11-27T16:34:33.466431+0000","last_up_change":"2022-11-27T16:34:23.393159+0000","last_in_change":"2022-11-27T16:34:14.739276+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-11-27T16:34:23.785795+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-11-27T16:34:30.782541+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"a1c510ff-24f3-497e-823f-73d31df5e534","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":101340},{"type":"v1","addr":"172.21.15.6:6809","nonce":101340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":101340},{"type":"v1","addr":"172.21.15.6:6811","nonce":101340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":101340},{"type":"v1","addr":"172.21.15.6:6815","nonce":101340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":101340},{"type":"v1","addr":"172.21.15.6:6813","nonce":101340}]},"public_addr":"172.21.15.6:6809/101340","cluster_addr":"172.21.15.6:6811/101340","heartbeat_back_addr":"172.21.15.6:6815/101340","heartbeat_front_addr":"172.21.15.6:6813/101340","state":["exists","up"]},{"osd":1,"uuid":"01055301-2278-4c5b-9963-8787137b7db9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":101342},{"type":"v1","addr":"172.21.15.6:6823","nonce":101342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6825","nonce":101342},{"type":"v1","addr":"172.21.15.6:6827","nonce":101342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":101342},{"type":"v1","addr":"172.21.15.6:6831","nonce":101342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":101342},{"type":"v1","addr":"172.21.15.6:6829","nonce":101342}]},"public_addr":"172.21.15.6:6823/101342","cluster_addr":"172.21.15.6:6827/101342","heartbeat_back_addr":"172.21.15.6:6831/101342","heartbeat_front_addr":"172.21.15.6:6829/101342","state":["exists","up"]},{"osd":2,"uuid":"d523a914-8041-42f7-a369-33e54681eb9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":101343},{"type":"v1","addr":"172.21.15.6:6817","nonce":101343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":101343},{"type":"v1","addr":"172.21.15.6:6819","nonce":101343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":101343},{"type":"v1","addr":"172.21.15.6:6826","nonce":101343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6821","nonce":101343},{"type":"v1","addr":"172.21.15.6:6822","nonce":101343}]},"public_addr":"172.21.15.6:6817/101343","cluster_addr":"172.21.15.6:6819/101343","heartbeat_back_addr":"172.21.15.6:6826/101343","heartbeat_front_addr":"172.21.15.6:6822/101343","state":["exists","up"]},{"osd":3,"uuid":"d981890c-4dc6-4292-89f8-a11a3b529962","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":101341},{"type":"v1","addr":"172.21.15.6:6801","nonce":101341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":101341},{"type":"v1","addr":"172.21.15.6:6803","nonce":101341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":101341},{"type":"v1","addr":"172.21.15.6:6807","nonce":101341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":101341},{"type":"v1","addr":"172.21.15.6:6805","nonce":101341}]},"public_addr":"172.21.15.6:6801/101341","cluster_addr":"172.21.15.6:6803/101341","heartbeat_back_addr":"172.21.15.6:6807/101341","heartbeat_front_addr":"172.21.15.6:6805/101341","state":["exists","up"]},{"osd":4,"uuid":"de3bdb57-3fc0-4353-a4cf-394d28ed0404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":101567},{"type":"v1","addr":"172.21.15.55:6801","nonce":101567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":101567},{"type":"v1","addr":"172.21.15.55:6803","nonce":101567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":101567},{"type":"v1","addr":"172.21.15.55:6807","nonce":101567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":101567},{"type":"v1","addr":"172.21.15.55:6805","nonce":101567}]},"public_addr":"172.21.15.55:6801/101567","cluster_addr":"172.21.15.55:6803/101567","heartbeat_back_addr":"172.21.15.55:6807/101567","heartbeat_front_addr":"172.21.15.55:6805/101567","state":["exists","up"]},{"osd":5,"uuid":"8eb1bfed-50ab-408d-8908-9f855f49a683","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":101577},{"type":"v1","addr":"172.21.15.55:6817","nonce":101577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6818","nonce":101577},{"type":"v1","addr":"172.21.15.55:6819","nonce":101577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6822","nonce":101577},{"type":"v1","addr":"172.21.15.55:6823","nonce":101577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":101577},{"type":"v1","addr":"172.21.15.55:6821","nonce":101577}]},"public_addr":"172.21.15.55:6817/101577","cluster_addr":"172.21.15.55:6819/101577","heartbeat_back_addr":"172.21.15.55:6823/101577","heartbeat_front_addr":"172.21.15.55:6821/101577","state":["exists","up"]},{"osd":6,"uuid":"be781377-2ff8-4b5c-8ce8-5cde163b4956","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":101568},{"type":"v1","addr":"172.21.15.55:6809","nonce":101568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":101568},{"type":"v1","addr":"172.21.15.55:6811","nonce":101568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6814","nonce":101568},{"type":"v1","addr":"172.21.15.55:6815","nonce":101568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":101568},{"type":"v1","addr":"172.21.15.55:6813","nonce":101568}]},"public_addr":"172.21.15.55:6809/101568","cluster_addr":"172.21.15.55:6811/101568","heartbeat_back_addr":"172.21.15.55:6815/101568","heartbeat_front_addr":"172.21.15.55:6813/101568","state":["exists","up"]},{"osd":7,"uuid":"2940a706-2632-4794-8d6f-dc8df69cf11f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":101598},{"type":"v1","addr":"172.21.15.55:6825","nonce":101598}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":101598},{"type":"v1","addr":"172.21.15.55:6827","nonce":101598}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":101598},{"type":"v1","addr":"172.21.15.55:6831","nonce":101598}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":101598},{"type":"v1","addr":"172.21.15.55:6829","nonce":101598}]},"public_addr":"172.21.15.55:6825/101598","cluster_addr":"172.21.15.55:6827/101598","heartbeat_back_addr":"172.21.15.55:6831/101598","heartbeat_front_addr":"172.21.15.55:6829/101598","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.901980+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.967714+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.968394+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.862378+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.910978+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.919584+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.868135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2022-11-27T16:34:19.951725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-11-27T16:34:34.268 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.265+0000 7fd91141e700 1 -- 172.21.15.6:0/3550202915 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fd8ec066590 msgr2=0x7fd8ec068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:34.269 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.265+0000 7fd91141e700 1 --2- 172.21.15.6:0/3550202915 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fd8ec066590 0x7fd8ec068a40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd900007fd0 tx=0x7fd900009040 comp rx=0 tx=0).stop 2022-11-27T16:34:34.269 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.265+0000 7fd91141e700 1 -- 172.21.15.6:0/3550202915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c15bac0 msgr2=0x7fd90c0b5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:34.270 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.265+0000 7fd91141e700 1 --2- 172.21.15.6:0/3550202915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c15bac0 0x7fd90c0b5290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00e870 tx=0x7fd8fc00eb80 comp rx=0 tx=0).stop 2022-11-27T16:34:34.270 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.265+0000 7fd91141e700 1 -- 172.21.15.6:0/3550202915 shutdown_connections 2022-11-27T16:34:34.271 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.265+0000 7fd91141e700 1 --2- 172.21.15.6:0/3550202915 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fd8ec066590 0x7fd8ec068a40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.271 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.265+0000 7fd91141e700 1 --2- 172.21.15.6:0/3550202915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd90c15be90 0x7fd90c1f09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.271 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.265+0000 7fd91141e700 1 --2- 172.21.15.6:0/3550202915 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd90c0ccde0 0x7fd90c1551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.272 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.265+0000 7fd91141e700 1 --2- 172.21.15.6:0/3550202915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd90c15bac0 0x7fd90c0b5290 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.272 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.265+0000 7fd91141e700 1 -- 172.21.15.6:0/3550202915 >> 172.21.15.6:0/3550202915 conn(0x7fd90c064ec0 msgr2=0x7fd90c0afbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:34.273 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.265+0000 7fd91141e700 1 -- 172.21.15.6:0/3550202915 shutdown_connections 2022-11-27T16:34:34.273 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.265+0000 7fd91141e700 1 -- 172.21.15.6:0/3550202915 wait complete. 2022-11-27T16:34:34.280 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-11-27T16:34:23.785795+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-11-27T16:34:30.782541+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-11-27T16:34:34.281 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-11-27T16:34:34.408 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.405+0000 7fae5a348700 1 Processor -- start 2022-11-27T16:34:34.408 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.405+0000 7fae5a348700 1 -- start start 2022-11-27T16:34:34.412 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.406+0000 7fae5a348700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae5415bd30 0x7fae540ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:34.412 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.406+0000 7fae5a348700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae540ce390 0x7fae5406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:34.412 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.406+0000 7fae5a348700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae540c9c40 con 0x7fae5406fae0 2022-11-27T16:34:34.412 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.406+0000 7fae5a348700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae54070490 con 0x7fae540ce390 2022-11-27T16:34:34.413 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.406+0000 7fae5a348700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5415c100 con 0x7fae5415bd30 2022-11-27T16:34:34.413 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.406+0000 7fae537fe700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7fae5406fae0 0x7fae540cdc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58470/0 (socket says 172.21.15.6:58470) 2022-11-27T16:34:34.413 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.406+0000 7fae537fe700 1 -- 172.21.15.6:0/740372710 learned_addr learned my addr 172.21.15.6:0/740372710 (peer_addr_for_me v1:172.21.15.6:0/0) 2022-11-27T16:34:34.413 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.406+0000 7fae588e5700 1 --2- 172.21.15.6:0/740372710 >> v2:172.21.15.55:3300/0 conn(0x7fae540ce390 0x7fae5406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:34.414 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.406+0000 7fae53fff700 1 --2- 172.21.15.6:0/740372710 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae5415bd30 0x7fae540ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:34.414 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.407+0000 7fae52ffd700 1 -- 172.21.15.6:0/740372710 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4086655998 0 0) 0x7fae540c9c40 con 0x7fae5406fae0 2022-11-27T16:34:34.414 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.407+0000 7fae52ffd700 1 -- 172.21.15.6:0/740372710 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae340035b0 con 0x7fae5406fae0 2022-11-27T16:34:34.414 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.407+0000 7fae588e5700 1 -- 172.21.15.6:0/740372710 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae5415bd30 msgr2=0x7fae540ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:34.414 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.407+0000 7fae588e5700 1 --2- 172.21.15.6:0/740372710 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae5415bd30 0x7fae540ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.415 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.407+0000 7fae588e5700 1 -- 172.21.15.6:0/740372710 >> v1:172.21.15.6:6789/0 conn(0x7fae5406fae0 legacy=0x7fae540cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:34.415 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.407+0000 7fae52ffd700 1 -- 172.21.15.6:0/740372710 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3279085454 0 0) 0x7fae340035b0 con 0x7fae5406fae0 2022-11-27T16:34:34.415 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.407+0000 7fae588e5700 1 -- 172.21.15.6:0/740372710 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae540c9070 con 0x7fae540ce390 2022-11-27T16:34:34.415 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.407+0000 7fae588e5700 1 --2- 172.21.15.6:0/740372710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae540ce390 0x7fae5406ff50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009d90 tx=0x7fae4c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ba5bef4eea28a3 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:34.416 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.407+0000 7fae52ffd700 1 -- 172.21.15.6:0/740372710 <== mon.1 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c00e070 con 0x7fae540ce390 2022-11-27T16:34:34.416 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.407+0000 7fae52ffd700 1 -- 172.21.15.6:0/740372710 <== mon.1 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4c003a20 con 0x7fae540ce390 2022-11-27T16:34:34.416 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.407+0000 7fae52ffd700 1 -- 172.21.15.6:0/740372710 <== mon.1 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae44001670 con 0x7fae540ce390 2022-11-27T16:34:34.416 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.408+0000 7fae5a348700 1 -- 172.21.15.6:0/740372710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae540ce390 msgr2=0x7fae5406ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:34.417 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.408+0000 7fae5a348700 1 --2- 172.21.15.6:0/740372710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae540ce390 0x7fae5406ff50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009d90 tx=0x7fae4c00b330 comp rx=0 tx=0).stop 2022-11-27T16:34:34.417 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.408+0000 7fae5a348700 1 -- 172.21.15.6:0/740372710 shutdown_connections 2022-11-27T16:34:34.417 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.408+0000 7fae5a348700 1 --2- 172.21.15.6:0/740372710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae540ce390 0x7fae5406ff50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.417 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.408+0000 7fae5a348700 1 --2- 172.21.15.6:0/740372710 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae5415bd30 0x7fae540ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.418 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.408+0000 7fae5a348700 1 -- 172.21.15.6:0/740372710 >> 172.21.15.6:0/740372710 conn(0x7fae540ce8f0 msgr2=0x7fae540cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:34.418 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.408+0000 7fae5a348700 1 -- 172.21.15.6:0/740372710 shutdown_connections 2022-11-27T16:34:34.418 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.408+0000 7fae5a348700 1 -- 172.21.15.6:0/740372710 wait complete. 2022-11-27T16:34:34.418 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.409+0000 7fae5a348700 1 Processor -- start 2022-11-27T16:34:34.418 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.409+0000 7fae5a348700 1 -- start start 2022-11-27T16:34:34.422 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.410+0000 7fae5a348700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae5406fae0 0x7fae54158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:34.422 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.410+0000 7fae5a348700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae540ce390 0x7fae540ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:34.423 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.410+0000 7fae5a348700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae5415bd30 0x7fae540ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:34.423 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.410+0000 7fae5a348700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae541f2480 con 0x7fae540ce390 2022-11-27T16:34:34.423 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.410+0000 7fae5a348700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae541f1ae0 con 0x7fae5415bd30 2022-11-27T16:34:34.423 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.410+0000 7fae5a348700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae541f1dc0 con 0x7fae5406fae0 2022-11-27T16:34:34.424 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.410+0000 7fae537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae540ce390 0x7fae540ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:34.424 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.410+0000 7fae537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae540ce390 0x7fae540ad450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58938/0 (socket says 172.21.15.6:58938) 2022-11-27T16:34:34.424 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.410+0000 7fae537fe700 1 -- 172.21.15.6:0/3329303969 learned_addr learned my addr 172.21.15.6:0/3329303969 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:34.424 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.410+0000 7fae588e5700 1 --2- 172.21.15.6:0/3329303969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae5415bd30 0x7fae540ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:34.425 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.410+0000 7fae53fff700 1 --2- 172.21.15.6:0/3329303969 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae5406fae0 0x7fae54158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:34.425 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.410+0000 7fae537fe700 1 -- 172.21.15.6:0/3329303969 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae5406fae0 msgr2=0x7fae54158c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:34.425 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.410+0000 7fae537fe700 1 --2- 172.21.15.6:0/3329303969 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae5406fae0 0x7fae54158c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.425 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.410+0000 7fae537fe700 1 -- 172.21.15.6:0/3329303969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae5415bd30 msgr2=0x7fae540ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:34.426 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.410+0000 7fae537fe700 1 --2- 172.21.15.6:0/3329303969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae5415bd30 0x7fae540ad990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.426 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.410+0000 7fae537fe700 1 -- 172.21.15.6:0/3329303969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c009a70 con 0x7fae540ce390 2022-11-27T16:34:34.426 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.410+0000 7fae588e5700 1 --2- 172.21.15.6:0/3329303969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae5415bd30 0x7fae540ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-11-27T16:34:34.426 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.410+0000 7fae53fff700 1 --2- 172.21.15.6:0/3329303969 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae5406fae0 0x7fae54158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-11-27T16:34:34.426 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.411+0000 7fae537fe700 1 --2- 172.21.15.6:0/3329303969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae540ce390 0x7fae540ad450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fae4400c750 tx=0x7fae4400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:34.427 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.411+0000 7fae50ff9700 1 -- 172.21.15.6:0/3329303969 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae44004c80 con 0x7fae540ce390 2022-11-27T16:34:34.427 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.411+0000 7fae50ff9700 1 -- 172.21.15.6:0/3329303969 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae44004de0 con 0x7fae540ce390 2022-11-27T16:34:34.427 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.411+0000 7fae5a348700 1 -- 172.21.15.6:0/3329303969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae541f20a0 con 0x7fae540ce390 2022-11-27T16:34:34.427 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.411+0000 7fae50ff9700 1 -- 172.21.15.6:0/3329303969 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae440072f0 con 0x7fae540ce390 2022-11-27T16:34:34.428 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.411+0000 7fae5a348700 1 -- 172.21.15.6:0/3329303969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae541f28a0 con 0x7fae540ce390 2022-11-27T16:34:34.428 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.412+0000 7fae5a348700 1 -- 172.21.15.6:0/3329303969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae541f25c0 con 0x7fae540ce390 2022-11-27T16:34:34.428 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.412+0000 7fae50ff9700 1 -- 172.21.15.6:0/3329303969 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7fae4401a020 con 0x7fae540ce390 2022-11-27T16:34:34.429 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.412+0000 7fae50ff9700 1 --2- 172.21.15.6:0/3329303969 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fae38066590 0x7fae38068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:34.429 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.413+0000 7fae50ff9700 1 -- 172.21.15.6:0/3329303969 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fae44083120 con 0x7fae540ce390 2022-11-27T16:34:34.429 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.413+0000 7fae53fff700 1 --2- 172.21.15.6:0/3329303969 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fae38066590 0x7fae38068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:34.429 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.413+0000 7fae53fff700 1 --2- 172.21.15.6:0/3329303969 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fae38066590 0x7fae38068a40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fae3c009c30 tx=0x7fae3c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:34.429 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.417+0000 7fae50ff9700 1 -- 172.21.15.6:0/3329303969 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170936 (secure 0 0 0) 0x7fae541f25c0 con 0x7fae540ce390 2022-11-27T16:34:34.608 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.605+0000 7fae5a348700 1 -- 172.21.15.6:0/3329303969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae541f25c0 con 0x7fae540ce390 2022-11-27T16:34:34.608 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.605+0000 7fae50ff9700 1 -- 172.21.15.6:0/3329303969 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae541f25c0 con 0x7fae540ce390 2022-11-27T16:34:34.608 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2022-11-27T16:34:34.610 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.607+0000 7fae5a348700 1 -- 172.21.15.6:0/3329303969 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fae38066590 msgr2=0x7fae38068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:34.610 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.607+0000 7fae5a348700 1 --2- 172.21.15.6:0/3329303969 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fae38066590 0x7fae38068a40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fae3c009c30 tx=0x7fae3c008040 comp rx=0 tx=0).stop 2022-11-27T16:34:34.611 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.607+0000 7fae5a348700 1 -- 172.21.15.6:0/3329303969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae540ce390 msgr2=0x7fae540ad450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:34.611 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.607+0000 7fae5a348700 1 --2- 172.21.15.6:0/3329303969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae540ce390 0x7fae540ad450 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fae4400c750 tx=0x7fae4400cb10 comp rx=0 tx=0).stop 2022-11-27T16:34:34.611 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.607+0000 7fae5a348700 1 -- 172.21.15.6:0/3329303969 shutdown_connections 2022-11-27T16:34:34.612 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.607+0000 7fae5a348700 1 --2- 172.21.15.6:0/3329303969 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fae38066590 0x7fae38068a40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.612 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.607+0000 7fae5a348700 1 --2- 172.21.15.6:0/3329303969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae5415bd30 0x7fae540ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.612 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.607+0000 7fae5a348700 1 --2- 172.21.15.6:0/3329303969 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fae5406fae0 0x7fae54158c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.612 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.607+0000 7fae5a348700 1 --2- 172.21.15.6:0/3329303969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae540ce390 0x7fae540ad450 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.612 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.607+0000 7fae5a348700 1 -- 172.21.15.6:0/3329303969 >> 172.21.15.6:0/3329303969 conn(0x7fae540ce8f0 msgr2=0x7fae540ab9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:34.613 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.608+0000 7fae5a348700 1 -- 172.21.15.6:0/3329303969 shutdown_connections 2022-11-27T16:34:34.613 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.608+0000 7fae5a348700 1 -- 172.21.15.6:0/3329303969 wait complete. 2022-11-27T16:34:34.623 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-11-27T16:34:34.751 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.748+0000 7f6c8b030700 1 Processor -- start 2022-11-27T16:34:34.751 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.748+0000 7f6c8b030700 1 -- start start 2022-11-27T16:34:34.754 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.749+0000 7f6c8b030700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6c840b2950 0x7f6c840ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:34.754 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.749+0000 7f6c8b030700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c840cd2a0 0x7f6c840cf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:34.755 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.749+0000 7f6c8b030700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c840cc720 con 0x7f6c840b5a60 2022-11-27T16:34:34.755 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.749+0000 7f6c8b030700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c84159fc0 con 0x7f6c840cd2a0 2022-11-27T16:34:34.755 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.749+0000 7f6c8b030700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c840cedc0 con 0x7f6c840b2950 2022-11-27T16:34:34.755 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.749+0000 7f6c895cd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c840cd2a0 0x7f6c840cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.749+0000 7f6c895cd700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f6c840cd2a0 0x7f6c840cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58950/0 (socket says 172.21.15.6:58950) 2022-11-27T16:34:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.749+0000 7f6c895cd700 1 -- 172.21.15.6:0/2764739116 learned_addr learned my addr 172.21.15.6:0/2764739116 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.749+0000 7f6c83fff700 1 --2- 172.21.15.6:0/2764739116 >> v2:172.21.15.55:3300/0 conn(0x7f6c840b2950 0x7f6c840ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:34.756 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.749+0000 7f6c895cd700 1 -- 172.21.15.6:0/2764739116 >> v2:172.21.15.55:3300/0 conn(0x7f6c840b2950 msgr2=0x7f6c840ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.749+0000 7f6c895cd700 1 --2- 172.21.15.6:0/2764739116 >> v2:172.21.15.55:3300/0 conn(0x7f6c840b2950 0x7f6c840ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.749+0000 7f6c895cd700 1 -- 172.21.15.6:0/2764739116 >> v1:172.21.15.55:6789/0 conn(0x7f6c840b5a60 legacy=0x7f6c840ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.749+0000 7f6c895cd700 1 -- 172.21.15.6:0/2764739116 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c840cbdf0 con 0x7f6c840cd2a0 2022-11-27T16:34:34.757 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.749+0000 7f6c83fff700 1 --2- 172.21.15.6:0/2764739116 >> v2:172.21.15.55:3300/0 conn(0x7f6c840b2950 0x7f6c840ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-11-27T16:34:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.750+0000 7f6c895cd700 1 --2- 172.21.15.6:0/2764739116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c840cd2a0 0x7f6c840cf520 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6c8406fd50 tx=0x7f6c7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=377e551cb0132d9b server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.750+0000 7f6c837fe700 1 -- 172.21.15.6:0/2764739116 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c00e070 con 0x7f6c840cd2a0 2022-11-27T16:34:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.750+0000 7f6c837fe700 1 -- 172.21.15.6:0/2764739116 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c003a20 con 0x7f6c840cd2a0 2022-11-27T16:34:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.750+0000 7f6c837fe700 1 -- 172.21.15.6:0/2764739116 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c003dd0 con 0x7f6c840cd2a0 2022-11-27T16:34:34.758 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.750+0000 7f6c8b030700 1 -- 172.21.15.6:0/2764739116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c840cd2a0 msgr2=0x7f6c840cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.750+0000 7f6c8b030700 1 --2- 172.21.15.6:0/2764739116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c840cd2a0 0x7f6c840cf520 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6c8406fd50 tx=0x7f6c7c00b330 comp rx=0 tx=0).stop 2022-11-27T16:34:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.750+0000 7f6c8b030700 1 -- 172.21.15.6:0/2764739116 shutdown_connections 2022-11-27T16:34:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.750+0000 7f6c8b030700 1 --2- 172.21.15.6:0/2764739116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c840cd2a0 0x7f6c840cf520 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.759 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.750+0000 7f6c8b030700 1 --2- 172.21.15.6:0/2764739116 >> v2:172.21.15.55:3300/0 conn(0x7f6c840b2950 0x7f6c840ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.750+0000 7f6c8b030700 1 -- 172.21.15.6:0/2764739116 >> 172.21.15.6:0/2764739116 conn(0x7f6c84064ec0 msgr2=0x7f6c84065290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.750+0000 7f6c8b030700 1 -- 172.21.15.6:0/2764739116 shutdown_connections 2022-11-27T16:34:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.750+0000 7f6c8b030700 1 -- 172.21.15.6:0/2764739116 wait complete. 2022-11-27T16:34:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.752+0000 7f6c8b030700 1 Processor -- start 2022-11-27T16:34:34.760 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.752+0000 7f6c8b030700 1 -- start start 2022-11-27T16:34:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c8b030700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c840b2950 0x7f6c841554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c8b030700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c840b5a60 0x7f6c8415b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c8b030700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c840cd2a0 0x7f6c8406aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c8b030700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c84155a30 con 0x7f6c840cd2a0 2022-11-27T16:34:34.764 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c8b030700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8415a720 con 0x7f6c840b5a60 2022-11-27T16:34:34.765 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c8b030700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8415aa00 con 0x7f6c840b2950 2022-11-27T16:34:34.765 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c895cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c840cd2a0 0x7f6c8406aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:34.765 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c895cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c840cd2a0 0x7f6c8406aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58956/0 (socket says 172.21.15.6:58956) 2022-11-27T16:34:34.765 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c895cd700 1 -- 172.21.15.6:0/2044225848 learned_addr learned my addr 172.21.15.6:0/2044225848 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:34.766 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c83fff700 1 --2- 172.21.15.6:0/2044225848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c840b5a60 0x7f6c8415b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:34.766 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c88dcc700 1 --2- 172.21.15.6:0/2044225848 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c840b2950 0x7f6c841554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:34.766 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c895cd700 1 -- 172.21.15.6:0/2044225848 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c840b2950 msgr2=0x7f6c841554f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:34.766 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c895cd700 1 --2- 172.21.15.6:0/2044225848 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c840b2950 0x7f6c841554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.766 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c895cd700 1 -- 172.21.15.6:0/2044225848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c840b5a60 msgr2=0x7f6c8415b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:34.767 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c895cd700 1 --2- 172.21.15.6:0/2044225848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c840b5a60 0x7f6c8415b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.767 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c895cd700 1 -- 172.21.15.6:0/2044225848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c009b30 con 0x7f6c840cd2a0 2022-11-27T16:34:34.767 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c83fff700 1 --2- 172.21.15.6:0/2044225848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c840b5a60 0x7f6c8415b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-11-27T16:34:34.767 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c895cd700 1 --2- 172.21.15.6:0/2044225848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c840cd2a0 0x7f6c8406aa00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c015040 tx=0x7f6c7c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:34.767 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c817fa700 1 -- 172.21.15.6:0/2044225848 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c004440 con 0x7f6c840cd2a0 2022-11-27T16:34:34.768 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c817fa700 1 -- 172.21.15.6:0/2044225848 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7c0045a0 con 0x7f6c840cd2a0 2022-11-27T16:34:34.768 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c8b030700 1 -- 172.21.15.6:0/2044225848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c8415ace0 con 0x7f6c840cd2a0 2022-11-27T16:34:34.768 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c817fa700 1 -- 172.21.15.6:0/2044225848 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c004950 con 0x7f6c840cd2a0 2022-11-27T16:34:34.768 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.753+0000 7f6c8b030700 1 -- 172.21.15.6:0/2044225848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8415b2a0 con 0x7f6c840cd2a0 2022-11-27T16:34:34.769 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.754+0000 7f6c8b030700 1 -- 172.21.15.6:0/2044225848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c84068b70 con 0x7f6c840cd2a0 2022-11-27T16:34:34.769 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.755+0000 7f6c817fa700 1 -- 172.21.15.6:0/2044225848 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7f6c7c022030 con 0x7f6c840cd2a0 2022-11-27T16:34:34.769 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.755+0000 7f6c817fa700 1 --2- 172.21.15.6:0/2044225848 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f6c6c0665c0 0x7f6c6c068a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:34.769 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.755+0000 7f6c817fa700 1 -- 172.21.15.6:0/2044225848 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6c7c084920 con 0x7f6c840cd2a0 2022-11-27T16:34:34.769 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.755+0000 7f6c88dcc700 1 --2- 172.21.15.6:0/2044225848 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f6c6c0665c0 0x7f6c6c068a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:34.770 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.756+0000 7f6c88dcc700 1 --2- 172.21.15.6:0/2044225848 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f6c6c0665c0 0x7f6c6c068a70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6c78003e60 tx=0x7f6c78009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:34.770 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.759+0000 7f6c817fa700 1 -- 172.21.15.6:0/2044225848 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170936 (secure 0 0 0) 0x7f6c7c052300 con 0x7f6c840cd2a0 2022-11-27T16:34:34.948 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.946+0000 7f6c8b030700 1 -- 172.21.15.6:0/2044225848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6c840726c0 con 0x7f6c840cd2a0 2022-11-27T16:34:34.949 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.946+0000 7f6c817fa700 1 -- 172.21.15.6:0/2044225848 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6c7c055920 con 0x7f6c840cd2a0 2022-11-27T16:34:34.949 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 8 2022-11-27T16:34:34.951 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.948+0000 7f6c8b030700 1 -- 172.21.15.6:0/2044225848 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f6c6c0665c0 msgr2=0x7f6c6c068a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:34.951 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.948+0000 7f6c8b030700 1 --2- 172.21.15.6:0/2044225848 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f6c6c0665c0 0x7f6c6c068a70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6c78003e60 tx=0x7f6c78009040 comp rx=0 tx=0).stop 2022-11-27T16:34:34.951 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.948+0000 7f6c8b030700 1 -- 172.21.15.6:0/2044225848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c840cd2a0 msgr2=0x7f6c8406aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:34.952 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.948+0000 7f6c8b030700 1 --2- 172.21.15.6:0/2044225848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c840cd2a0 0x7f6c8406aa00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c015040 tx=0x7f6c7c004ad0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.952 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.948+0000 7f6c8b030700 1 -- 172.21.15.6:0/2044225848 shutdown_connections 2022-11-27T16:34:34.952 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.948+0000 7f6c8b030700 1 --2- 172.21.15.6:0/2044225848 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f6c6c0665c0 0x7f6c6c068a70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.952 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.948+0000 7f6c8b030700 1 --2- 172.21.15.6:0/2044225848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c840cd2a0 0x7f6c8406aa00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.953 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.948+0000 7f6c8b030700 1 --2- 172.21.15.6:0/2044225848 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6c840b2950 0x7f6c841554f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.953 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.948+0000 7f6c8b030700 1 --2- 172.21.15.6:0/2044225848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c840b5a60 0x7f6c8415b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:34.953 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.948+0000 7f6c8b030700 1 -- 172.21.15.6:0/2044225848 >> 172.21.15.6:0/2044225848 conn(0x7f6c84064ec0 msgr2=0x7f6c84158410 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:34.953 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.948+0000 7f6c8b030700 1 -- 172.21.15.6:0/2044225848 shutdown_connections 2022-11-27T16:34:34.954 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:34.948+0000 7f6c8b030700 1 -- 172.21.15.6:0/2044225848 wait complete. 2022-11-27T16:34:34.963 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-11-27T16:34:35.087 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.084+0000 7f5c34727700 1 Processor -- start 2022-11-27T16:34:35.087 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.084+0000 7f5c34727700 1 -- start start 2022-11-27T16:34:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.085+0000 7f5c34727700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5c2c15be90 0x7f5c2c0cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.085+0000 7f5c34727700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c2c0ccde0 0x7f5c2c0cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.085+0000 7f5c34727700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c2c0cf530 con 0x7f5c2c15bac0 2022-11-27T16:34:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.085+0000 7f5c34727700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c2c0cd1f0 con 0x7f5c2c0ccde0 2022-11-27T16:34:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.085+0000 7f5c34727700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c2c06b910 con 0x7f5c2c15be90 2022-11-27T16:34:35.091 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.085+0000 7f5c32cc4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c2c0ccde0 0x7f5c2c0cfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:35.091 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.085+0000 7f5c32cc4700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7f5c2c0ccde0 0x7f5c2c0cfcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58962/0 (socket says 172.21.15.6:58962) 2022-11-27T16:34:35.091 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.085+0000 7f5c32cc4700 1 -- 172.21.15.6:0/80933447 learned_addr learned my addr 172.21.15.6:0/80933447 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:35.091 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.085+0000 7f5c31cc2700 1 --2- 172.21.15.6:0/80933447 >> v2:172.21.15.55:3300/0 conn(0x7f5c2c15be90 0x7f5c2c0cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:35.092 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.086+0000 7f5c32cc4700 1 -- 172.21.15.6:0/80933447 >> v2:172.21.15.55:3300/0 conn(0x7f5c2c15be90 msgr2=0x7f5c2c0cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:35.092 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.086+0000 7f5c32cc4700 1 --2- 172.21.15.6:0/80933447 >> v2:172.21.15.55:3300/0 conn(0x7f5c2c15be90 0x7f5c2c0cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:35.092 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.086+0000 7f5c32cc4700 1 -- 172.21.15.6:0/80933447 >> v1:172.21.15.55:6789/0 conn(0x7f5c2c15bac0 legacy=0x7f5c2c06a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:35.092 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.086+0000 7f5c32cc4700 1 -- 172.21.15.6:0/80933447 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c2c06bbf0 con 0x7f5c2c0ccde0 2022-11-27T16:34:35.093 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.086+0000 7f5c31cc2700 1 --2- 172.21.15.6:0/80933447 >> v2:172.21.15.55:3300/0 conn(0x7f5c2c15be90 0x7f5c2c0cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-11-27T16:34:35.093 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.086+0000 7f5c32cc4700 1 --2- 172.21.15.6:0/80933447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0ccde0 0x7f5c2c0cfcc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c0cdc30 tx=0x7f5c2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a33513d357ed18 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:35.093 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.086+0000 7f5c314c1700 1 -- 172.21.15.6:0/80933447 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2400e070 con 0x7f5c2c0ccde0 2022-11-27T16:34:35.093 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.086+0000 7f5c314c1700 1 -- 172.21.15.6:0/80933447 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2400b9c0 con 0x7f5c2c0ccde0 2022-11-27T16:34:35.093 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.086+0000 7f5c314c1700 1 -- 172.21.15.6:0/80933447 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2400bd70 con 0x7f5c2c0ccde0 2022-11-27T16:34:35.094 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.086+0000 7f5c34727700 1 -- 172.21.15.6:0/80933447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0ccde0 msgr2=0x7f5c2c0cfcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:35.094 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.086+0000 7f5c34727700 1 --2- 172.21.15.6:0/80933447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0ccde0 0x7f5c2c0cfcc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c0cdc30 tx=0x7f5c2400b330 comp rx=0 tx=0).stop 2022-11-27T16:34:35.094 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.087+0000 7f5c34727700 1 -- 172.21.15.6:0/80933447 shutdown_connections 2022-11-27T16:34:35.094 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.087+0000 7f5c34727700 1 --2- 172.21.15.6:0/80933447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0ccde0 0x7f5c2c0cfcc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:35.095 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.087+0000 7f5c34727700 1 --2- 172.21.15.6:0/80933447 >> v2:172.21.15.55:3300/0 conn(0x7f5c2c15be90 0x7f5c2c0cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:35.095 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.087+0000 7f5c34727700 1 -- 172.21.15.6:0/80933447 >> 172.21.15.6:0/80933447 conn(0x7f5c2c064ec0 msgr2=0x7f5c2c065290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:35.095 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.087+0000 7f5c34727700 1 -- 172.21.15.6:0/80933447 shutdown_connections 2022-11-27T16:34:35.095 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.087+0000 7f5c34727700 1 -- 172.21.15.6:0/80933447 wait complete. 2022-11-27T16:34:35.099 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.088+0000 7f5c34727700 1 Processor -- start 2022-11-27T16:34:35.099 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.088+0000 7f5c34727700 1 -- start start 2022-11-27T16:34:35.099 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c34727700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0ccde0 0x7f5c2c1568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:35.099 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c34727700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c2c15bac0 0x7f5c2c0c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:35.100 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c34727700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c2c15be90 0x7f5c2c1e4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:35.100 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c34727700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c0c5590 con 0x7f5c2c0ccde0 2022-11-27T16:34:35.100 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c34727700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c0c5870 con 0x7f5c2c15bac0 2022-11-27T16:34:35.100 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c34727700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c0c5b50 con 0x7f5c2c15be90 2022-11-27T16:34:35.101 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c324c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0ccde0 0x7f5c2c1568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:35.101 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c324c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0ccde0 0x7f5c2c1568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58966/0 (socket says 172.21.15.6:58966) 2022-11-27T16:34:35.101 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c324c3700 1 -- 172.21.15.6:0/3786352361 learned_addr learned my addr 172.21.15.6:0/3786352361 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:35.101 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c31cc2700 1 --2- 172.21.15.6:0/3786352361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c2c15bac0 0x7f5c2c0c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:35.102 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c32cc4700 1 --2- 172.21.15.6:0/3786352361 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c2c15be90 0x7f5c2c1e4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:35.102 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c324c3700 1 -- 172.21.15.6:0/3786352361 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c2c15be90 msgr2=0x7f5c2c1e4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:35.102 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c324c3700 1 --2- 172.21.15.6:0/3786352361 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c2c15be90 0x7f5c2c1e4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:35.102 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c324c3700 1 -- 172.21.15.6:0/3786352361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c2c15bac0 msgr2=0x7f5c2c0c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:35.102 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c324c3700 1 --2- 172.21.15.6:0/3786352361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c2c15bac0 0x7f5c2c0c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c324c3700 1 -- 172.21.15.6:0/3786352361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c24009b30 con 0x7f5c2c0ccde0 2022-11-27T16:34:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c324c3700 1 --2- 172.21.15.6:0/3786352361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0ccde0 0x7f5c2c1568e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00c4e0 tx=0x7f5c1c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c1affd700 1 -- 172.21.15.6:0/3786352361 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c0052d0 con 0x7f5c2c0ccde0 2022-11-27T16:34:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c1affd700 1 -- 172.21.15.6:0/3786352361 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1c005430 con 0x7f5c2c0ccde0 2022-11-27T16:34:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c1affd700 1 -- 172.21.15.6:0/3786352361 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1c0038c0 con 0x7f5c2c0ccde0 2022-11-27T16:34:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c34727700 1 -- 172.21.15.6:0/3786352361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c2c0c5e30 con 0x7f5c2c0ccde0 2022-11-27T16:34:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.089+0000 7f5c34727700 1 -- 172.21.15.6:0/3786352361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2c156e20 con 0x7f5c2c0ccde0 2022-11-27T16:34:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.090+0000 7f5c34727700 1 -- 172.21.15.6:0/3786352361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c2c068b70 con 0x7f5c2c0ccde0 2022-11-27T16:34:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.091+0000 7f5c1affd700 1 -- 172.21.15.6:0/3786352361 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7f5c1c019030 con 0x7f5c2c0ccde0 2022-11-27T16:34:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.091+0000 7f5c1affd700 1 --2- 172.21.15.6:0/3786352361 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f5c0c066590 0x7f5c0c068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.091+0000 7f5c1affd700 1 -- 172.21.15.6:0/3786352361 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5c1c0826c0 con 0x7f5c2c0ccde0 2022-11-27T16:34:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.091+0000 7f5c31cc2700 1 --2- 172.21.15.6:0/3786352361 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f5c0c066590 0x7f5c0c068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:35.105 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.092+0000 7f5c31cc2700 1 --2- 172.21.15.6:0/3786352361 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f5c0c066590 0x7f5c0c068a40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c1e4ff0 tx=0x7f5c28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:35.106 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.095+0000 7f5c1affd700 1 -- 172.21.15.6:0/3786352361 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170936 (secure 0 0 0) 0x7f5c1c0500c0 con 0x7f5c2c0ccde0 2022-11-27T16:34:35.290 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.288+0000 7f5c34727700 1 -- 172.21.15.6:0/3786352361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5c2c0cf7a0 con 0x7f5c2c0ccde0 2022-11-27T16:34:35.291 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.288+0000 7f5c1affd700 1 -- 172.21.15.6:0/3786352361 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5c1c017090 con 0x7f5c2c0ccde0 2022-11-27T16:34:35.291 INFO:teuthology.orchestra.run.smithi006.stdout: 2022-11-27T16:34:35.292 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2022-11-27T16:34:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: { 2022-11-27T16:34:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2022-11-27T16:34:35.292 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2022-11-27T16:34:35.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2022-11-27T16:34:35.293 INFO:teuthology.orchestra.run.smithi006.stdout: { 2022-11-27T16:34:35.293 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 2, 2022-11-27T16:34:35.293 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": "rbd" 2022-11-27T16:34:35.293 INFO:teuthology.orchestra.run.smithi006.stdout: } 2022-11-27T16:34:35.294 INFO:teuthology.orchestra.run.smithi006.stdout:] 2022-11-27T16:34:35.295 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.290+0000 7f5c34727700 1 -- 172.21.15.6:0/3786352361 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f5c0c066590 msgr2=0x7f5c0c068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:35.295 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.290+0000 7f5c34727700 1 --2- 172.21.15.6:0/3786352361 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f5c0c066590 0x7f5c0c068a40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5c2c1e4ff0 tx=0x7f5c28008040 comp rx=0 tx=0).stop 2022-11-27T16:34:35.295 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.290+0000 7f5c34727700 1 -- 172.21.15.6:0/3786352361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0ccde0 msgr2=0x7f5c2c1568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:35.296 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.290+0000 7f5c34727700 1 --2- 172.21.15.6:0/3786352361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0ccde0 0x7f5c2c1568e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c00c4e0 tx=0x7f5c1c00c7f0 comp rx=0 tx=0).stop 2022-11-27T16:34:35.296 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.290+0000 7f5c34727700 1 -- 172.21.15.6:0/3786352361 shutdown_connections 2022-11-27T16:34:35.296 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.290+0000 7f5c34727700 1 --2- 172.21.15.6:0/3786352361 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f5c0c066590 0x7f5c0c068a40 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:35.296 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.290+0000 7f5c34727700 1 --2- 172.21.15.6:0/3786352361 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5c2c15be90 0x7f5c2c1e4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:35.297 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.290+0000 7f5c34727700 1 --2- 172.21.15.6:0/3786352361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0ccde0 0x7f5c2c1568e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:35.297 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.290+0000 7f5c34727700 1 --2- 172.21.15.6:0/3786352361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5c2c15bac0 0x7f5c2c0c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:35.297 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.290+0000 7f5c34727700 1 -- 172.21.15.6:0/3786352361 >> 172.21.15.6:0/3786352361 conn(0x7f5c2c064ec0 msgr2=0x7f5c2c0b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:35.297 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.290+0000 7f5c34727700 1 -- 172.21.15.6:0/3786352361 shutdown_connections 2022-11-27T16:34:35.297 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.290+0000 7f5c34727700 1 -- 172.21.15.6:0/3786352361 wait complete. 2022-11-27T16:34:35.305 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-11-27T16:34:35.305 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2022-11-27T16:34:35.433 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.431+0000 7f17ab052700 1 Processor -- start 2022-11-27T16:34:35.434 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.431+0000 7f17ab052700 1 -- start start 2022-11-27T16:34:35.442 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.432+0000 7f17ab052700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f17a406f9a0 0x7f17a406fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:35.442 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.432+0000 7f17ab052700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17a415bcb0 0x7f17a4068e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:35.442 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.432+0000 7f17ab052700 1 -- --> v1:172.21.15.6:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a40702b0 con 0x7f17a40ce370 2022-11-27T16:34:35.442 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.432+0000 7f17ab052700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a415c140 con 0x7f17a406f9a0 2022-11-27T16:34:35.443 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.432+0000 7f17ab052700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a415c420 con 0x7f17a415bcb0 2022-11-27T16:34:35.443 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.432+0000 7f17a95ef700 1 --1- >> v1:172.21.15.6:6789/0 conn(0x7f17a40ce370 0x7f17a40693a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.6:6789/0 says I am v1:172.21.15.6:58518/0 (socket says 172.21.15.6:58518) 2022-11-27T16:34:35.443 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.432+0000 7f17a95ef700 1 -- 172.21.15.6:0/1063241295 learned_addr learned my addr 172.21.15.6:0/1063241295 (peer_addr_for_me v1:172.21.15.6:0/0) 2022-11-27T16:34:35.443 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.432+0000 7f17a3fff700 1 --2- 172.21.15.6:0/1063241295 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17a415bcb0 0x7f17a4068e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:35.443 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.432+0000 7f17a8dee700 1 --2- 172.21.15.6:0/1063241295 >> v2:172.21.15.55:3300/0 conn(0x7f17a406f9a0 0x7f17a406fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.432+0000 7f17a37fe700 1 -- 172.21.15.6:0/1063241295 <== mon.0 v1:172.21.15.6:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1598265167 0 0) 0x7f17a40702b0 con 0x7f17a40ce370 2022-11-27T16:34:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.432+0000 7f17a37fe700 1 -- 172.21.15.6:0/1063241295 --> v1:172.21.15.6:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17880035b0 con 0x7f17a40ce370 2022-11-27T16:34:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.432+0000 7f17a37fe700 1 -- 172.21.15.6:0/1063241295 <== mon.0 v1:172.21.15.6:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 924765702 0 0) 0x7f17880035b0 con 0x7f17a40ce370 2022-11-27T16:34:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.432+0000 7f17a3fff700 1 -- 172.21.15.6:0/1063241295 >> v2:172.21.15.55:3300/0 conn(0x7f17a406f9a0 msgr2=0x7f17a406fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:35.445 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.432+0000 7f17a3fff700 1 --2- 172.21.15.6:0/1063241295 >> v2:172.21.15.55:3300/0 conn(0x7f17a406f9a0 0x7f17a406fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:35.445 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.432+0000 7f17a3fff700 1 -- 172.21.15.6:0/1063241295 >> v1:172.21.15.6:6789/0 conn(0x7f17a40ce370 legacy=0x7f17a40693a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:35.445 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.432+0000 7f17a3fff700 1 -- 172.21.15.6:0/1063241295 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a415c700 con 0x7f17a415bcb0 2022-11-27T16:34:35.445 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.433+0000 7f17a3fff700 1 --2- 172.21.15.6:0/1063241295 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17a415bcb0 0x7f17a4068e60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1790009840 tx=0x7f1790009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6c39b2c4cf61d8f server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:35.445 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.433+0000 7f17a37fe700 1 -- 172.21.15.6:0/1063241295 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179c0019f0 con 0x7f17a415bcb0 2022-11-27T16:34:35.446 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.433+0000 7f17a37fe700 1 -- 172.21.15.6:0/1063241295 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1790004030 con 0x7f17a415bcb0 2022-11-27T16:34:35.446 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.433+0000 7f17a37fe700 1 -- 172.21.15.6:0/1063241295 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17900043c0 con 0x7f17a415bcb0 2022-11-27T16:34:35.446 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.433+0000 7f17ab052700 1 -- 172.21.15.6:0/1063241295 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17a415bcb0 msgr2=0x7f17a4068e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:35.446 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.433+0000 7f17ab052700 1 --2- 172.21.15.6:0/1063241295 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17a415bcb0 0x7f17a4068e60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1790009840 tx=0x7f1790009b50 comp rx=0 tx=0).stop 2022-11-27T16:34:35.447 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.433+0000 7f17ab052700 1 -- 172.21.15.6:0/1063241295 shutdown_connections 2022-11-27T16:34:35.447 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.433+0000 7f17ab052700 1 --2- 172.21.15.6:0/1063241295 >> v2:172.21.15.55:3300/0 conn(0x7f17a406f9a0 0x7f17a406fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:35.447 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.433+0000 7f17ab052700 1 --2- 172.21.15.6:0/1063241295 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17a415bcb0 0x7f17a4068e60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:35.447 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.433+0000 7f17ab052700 1 -- 172.21.15.6:0/1063241295 >> 172.21.15.6:0/1063241295 conn(0x7f17a40ce880 msgr2=0x7f17a40cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:35.448 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.433+0000 7f17ab052700 1 -- 172.21.15.6:0/1063241295 shutdown_connections 2022-11-27T16:34:35.448 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.433+0000 7f17ab052700 1 -- 172.21.15.6:0/1063241295 wait complete. 2022-11-27T16:34:35.448 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.435+0000 7f17ab052700 1 Processor -- start 2022-11-27T16:34:35.448 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.435+0000 7f17ab052700 1 -- start start 2022-11-27T16:34:35.448 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.436+0000 7f17ab052700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a406f9a0 0x7f17a414afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:35.449 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.436+0000 7f17ab052700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17a40ce370 0x7f17a4144220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:35.449 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.436+0000 7f17ab052700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17a415bcb0 0x7f17a40c2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:35.449 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.436+0000 7f17ab052700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a414b4f0 con 0x7f17a406f9a0 2022-11-27T16:34:35.449 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.436+0000 7f17ab052700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a4149cc0 con 0x7f17a40ce370 2022-11-27T16:34:35.450 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.436+0000 7f17ab052700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a41490b0 con 0x7f17a415bcb0 2022-11-27T16:34:35.450 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.436+0000 7f17a8dee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a406f9a0 0x7f17a414afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:35.450 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.436+0000 7f17a8dee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a406f9a0 0x7f17a414afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58980/0 (socket says 172.21.15.6:58980) 2022-11-27T16:34:35.450 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.436+0000 7f17a8dee700 1 -- 172.21.15.6:0/3653008973 learned_addr learned my addr 172.21.15.6:0/3653008973 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:35.450 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.436+0000 7f17a3fff700 1 --2- 172.21.15.6:0/3653008973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17a40ce370 0x7f17a4144220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:35.451 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.436+0000 7f17a95ef700 1 --2- 172.21.15.6:0/3653008973 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17a415bcb0 0x7f17a40c2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:35.451 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.436+0000 7f17a8dee700 1 -- 172.21.15.6:0/3653008973 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17a415bcb0 msgr2=0x7f17a40c2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:35.451 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.436+0000 7f17a8dee700 1 --2- 172.21.15.6:0/3653008973 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17a415bcb0 0x7f17a40c2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:35.452 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.436+0000 7f17a8dee700 1 -- 172.21.15.6:0/3653008973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17a40ce370 msgr2=0x7f17a4144220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:35.452 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.436+0000 7f17a8dee700 1 --2- 172.21.15.6:0/3653008973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17a40ce370 0x7f17a4144220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:35.452 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.437+0000 7f17a8dee700 1 -- 172.21.15.6:0/3653008973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17900094a0 con 0x7f17a406f9a0 2022-11-27T16:34:35.453 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.437+0000 7f17a8dee700 1 --2- 172.21.15.6:0/3653008973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a406f9a0 0x7f17a414afb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f179800e9b0 tx=0x7f179800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:35.453 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.437+0000 7f17a17fa700 1 -- 172.21.15.6:0/3653008973 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798009710 con 0x7f17a406f9a0 2022-11-27T16:34:35.453 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.437+0000 7f17a17fa700 1 -- 172.21.15.6:0/3653008973 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179800ee50 con 0x7f17a406f9a0 2022-11-27T16:34:35.454 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.437+0000 7f17ab052700 1 -- 172.21.15.6:0/3653008973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a4149390 con 0x7f17a406f9a0 2022-11-27T16:34:35.454 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.437+0000 7f17a17fa700 1 -- 172.21.15.6:0/3653008973 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179800ca50 con 0x7f17a406f9a0 2022-11-27T16:34:35.454 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.437+0000 7f17ab052700 1 -- 172.21.15.6:0/3653008973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a4149950 con 0x7f17a406f9a0 2022-11-27T16:34:35.455 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.438+0000 7f17ab052700 1 -- 172.21.15.6:0/3653008973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a404e190 con 0x7f17a406f9a0 2022-11-27T16:34:35.455 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.438+0000 7f17a17fa700 1 -- 172.21.15.6:0/3653008973 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7f1798019030 con 0x7f17a406f9a0 2022-11-27T16:34:35.455 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.438+0000 7f17a17fa700 1 --2- 172.21.15.6:0/3653008973 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f178c066590 0x7f178c068a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:35.456 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.439+0000 7f17a17fa700 1 -- 172.21.15.6:0/3653008973 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1798083310 con 0x7f17a406f9a0 2022-11-27T16:34:35.456 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.439+0000 7f17a3fff700 1 --2- 172.21.15.6:0/3653008973 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f178c066590 0x7f178c068a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:35.456 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.439+0000 7f17a3fff700 1 --2- 172.21.15.6:0/3653008973 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f178c066590 0x7f178c068a40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17a4071260 tx=0x7f1790008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:35.457 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.443+0000 7f17a17fa700 1 -- 172.21.15.6:0/3653008973 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170936 (secure 0 0 0) 0x7f1798050d10 con 0x7f17a406f9a0 2022-11-27T16:34:35.635 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:35.633+0000 7f17ab052700 1 -- 172.21.15.6:0/3653008973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f17a4149fa0 con 0x7f17a406f9a0 2022-11-27T16:34:36.605 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.602+0000 7f17a17fa700 1 -- 172.21.15.6:0/3653008973 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1798054330 con 0x7f17a406f9a0 2022-11-27T16:34:36.609 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.606+0000 7f17ab052700 1 -- 172.21.15.6:0/3653008973 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f178c066590 msgr2=0x7f178c068a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:36.609 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.606+0000 7f17ab052700 1 --2- 172.21.15.6:0/3653008973 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f178c066590 0x7f178c068a40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17a4071260 tx=0x7f1790008030 comp rx=0 tx=0).stop 2022-11-27T16:34:36.610 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.606+0000 7f17ab052700 1 -- 172.21.15.6:0/3653008973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a406f9a0 msgr2=0x7f17a414afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:36.610 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.606+0000 7f17ab052700 1 --2- 172.21.15.6:0/3653008973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a406f9a0 0x7f17a414afb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f179800e9b0 tx=0x7f179800ecc0 comp rx=0 tx=0).stop 2022-11-27T16:34:36.610 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.607+0000 7f17ab052700 1 -- 172.21.15.6:0/3653008973 shutdown_connections 2022-11-27T16:34:36.611 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.607+0000 7f17ab052700 1 --2- 172.21.15.6:0/3653008973 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7f178c066590 0x7f178c068a40 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f17a4071260 tx=0x7f1790008030 comp rx=0 tx=0).stop 2022-11-27T16:34:36.611 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.607+0000 7f17ab052700 1 --2- 172.21.15.6:0/3653008973 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f17a415bcb0 0x7f17a40c2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:36.611 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.607+0000 7f17ab052700 1 --2- 172.21.15.6:0/3653008973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17a406f9a0 0x7f17a414afb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:36.611 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.607+0000 7f17ab052700 1 --2- 172.21.15.6:0/3653008973 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17a40ce370 0x7f17a4144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:36.612 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.607+0000 7f17ab052700 1 -- 172.21.15.6:0/3653008973 >> 172.21.15.6:0/3653008973 conn(0x7f17a40ce880 msgr2=0x7f17a40cec50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:36.612 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.609+0000 7f17ab052700 1 -- 172.21.15.6:0/3653008973 shutdown_connections 2022-11-27T16:34:36.613 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.610+0000 7f17ab052700 1 -- 172.21.15.6:0/3653008973 wait complete. 2022-11-27T16:34:36.614 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2022-11-27T16:34:36.627 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2022-11-27T16:34:36.765 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.763+0000 7fc371033700 1 Processor -- start 2022-11-27T16:34:36.766 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.763+0000 7fc371033700 1 -- start start 2022-11-27T16:34:36.772 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.763+0000 7fc371033700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc36c15bd30 0x7fc36c0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:36.772 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.763+0000 7fc371033700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc36c06fae0 0x7fc36c06ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:36.773 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.764+0000 7fc371033700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc36c0c9c40 con 0x7fc36c0cdc80 2022-11-27T16:34:36.773 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.764+0000 7fc371033700 1 -- --> v2:172.21.15.6:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36c070490 con 0x7fc36c06fae0 2022-11-27T16:34:36.773 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.764+0000 7fc371033700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc36c15c100 con 0x7fc36c15bd30 2022-11-27T16:34:36.773 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.764+0000 7fc36a59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc36c06fae0 0x7fc36c06ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.764+0000 7fc36a59c700 1 --2- >> v2:172.21.15.6:3300/0 conn(0x7fc36c06fae0 0x7fc36c06ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58990/0 (socket says 172.21.15.6:58990) 2022-11-27T16:34:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.764+0000 7fc36a59c700 1 -- 172.21.15.6:0/311084185 learned_addr learned my addr 172.21.15.6:0/311084185 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.764+0000 7fc36ad9d700 1 --2- 172.21.15.6:0/311084185 >> v2:172.21.15.55:3300/0 conn(0x7fc36c15bd30 0x7fc36c0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.764+0000 7fc36a59c700 1 -- 172.21.15.6:0/311084185 >> v2:172.21.15.55:3300/0 conn(0x7fc36c15bd30 msgr2=0x7fc36c0ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-11-27T16:34:36.775 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.764+0000 7fc36a59c700 1 --2- 172.21.15.6:0/311084185 >> v2:172.21.15.55:3300/0 conn(0x7fc36c15bd30 0x7fc36c0ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:36.775 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.764+0000 7fc36a59c700 1 -- 172.21.15.6:0/311084185 >> v1:172.21.15.55:6789/0 conn(0x7fc36c0cdc80 legacy=0x7fc36c0ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:36.775 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.764+0000 7fc36a59c700 1 -- 172.21.15.6:0/311084185 --> v2:172.21.15.6:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc36c0c9070 con 0x7fc36c06fae0 2022-11-27T16:34:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.764+0000 7fc36ad9d700 1 --2- 172.21.15.6:0/311084185 >> v2:172.21.15.55:3300/0 conn(0x7fc36c15bd30 0x7fc36c0ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-11-27T16:34:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.764+0000 7fc36a59c700 1 --2- 172.21.15.6:0/311084185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc36c06fae0 0x7fc36c06ff50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0cf3f0 tx=0x7fc360009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f2c06e10a64f26 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.764+0000 7fc369d9b700 1 -- 172.21.15.6:0/311084185 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36000b870 con 0x7fc36c06fae0 2022-11-27T16:34:36.776 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.764+0000 7fc369d9b700 1 -- 172.21.15.6:0/311084185 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc36000b9d0 con 0x7fc36c06fae0 2022-11-27T16:34:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.764+0000 7fc369d9b700 1 -- 172.21.15.6:0/311084185 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36000bd60 con 0x7fc36c06fae0 2022-11-27T16:34:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.765+0000 7fc371033700 1 -- 172.21.15.6:0/311084185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc36c06fae0 msgr2=0x7fc36c06ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.765+0000 7fc371033700 1 --2- 172.21.15.6:0/311084185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc36c06fae0 0x7fc36c06ff50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0cf3f0 tx=0x7fc360009bd0 comp rx=0 tx=0).stop 2022-11-27T16:34:36.777 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.765+0000 7fc371033700 1 -- 172.21.15.6:0/311084185 shutdown_connections 2022-11-27T16:34:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.765+0000 7fc371033700 1 --2- 172.21.15.6:0/311084185 >> v2:172.21.15.55:3300/0 conn(0x7fc36c15bd30 0x7fc36c0ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.765+0000 7fc371033700 1 --2- 172.21.15.6:0/311084185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc36c06fae0 0x7fc36c06ff50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.765+0000 7fc371033700 1 -- 172.21.15.6:0/311084185 >> 172.21.15.6:0/311084185 conn(0x7fc36c0ce8f0 msgr2=0x7fc36c0cecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:36.778 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.765+0000 7fc371033700 1 -- 172.21.15.6:0/311084185 shutdown_connections 2022-11-27T16:34:36.779 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.765+0000 7fc371033700 1 -- 172.21.15.6:0/311084185 wait complete. 2022-11-27T16:34:36.779 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.766+0000 7fc371033700 1 Processor -- start 2022-11-27T16:34:36.779 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.766+0000 7fc371033700 1 -- start start 2022-11-27T16:34:36.779 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.767+0000 7fc371033700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc36c06fae0 0x7fc36c151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:36.779 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.767+0000 7fc371033700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc36c0cdc80 0x7fc36c15cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:36.780 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.767+0000 7fc371033700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc36c15bd30 0x7fc36c0ae370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:36.780 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.767+0000 7fc371033700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c15e3f0 con 0x7fc36c15bd30 2022-11-27T16:34:36.780 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.767+0000 7fc371033700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c15e6d0 con 0x7fc36c0cdc80 2022-11-27T16:34:36.780 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.767+0000 7fc371033700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c15e9b0 con 0x7fc36c06fae0 2022-11-27T16:34:36.781 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.767+0000 7fc36b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc36c15bd30 0x7fc36c0ae370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:36.781 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.767+0000 7fc36b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc36c15bd30 0x7fc36c0ae370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58998/0 (socket says 172.21.15.6:58998) 2022-11-27T16:34:36.781 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.767+0000 7fc36b59e700 1 -- 172.21.15.6:0/77860080 learned_addr learned my addr 172.21.15.6:0/77860080 (peer_addr_for_me v2:172.21.15.6:0/0) 2022-11-27T16:34:36.781 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.767+0000 7fc36a59c700 1 --2- 172.21.15.6:0/77860080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc36c0cdc80 0x7fc36c15cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:36.782 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.767+0000 7fc36ad9d700 1 --2- 172.21.15.6:0/77860080 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc36c06fae0 0x7fc36c151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:36.782 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.768+0000 7fc36b59e700 1 -- 172.21.15.6:0/77860080 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc36c06fae0 msgr2=0x7fc36c151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:36.782 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.768+0000 7fc36b59e700 1 --2- 172.21.15.6:0/77860080 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc36c06fae0 0x7fc36c151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:36.782 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.768+0000 7fc36b59e700 1 -- 172.21.15.6:0/77860080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc36c0cdc80 msgr2=0x7fc36c15cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:36.783 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.768+0000 7fc36b59e700 1 --2- 172.21.15.6:0/77860080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc36c0cdc80 0x7fc36c15cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:36.783 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.768+0000 7fc36b59e700 1 -- 172.21.15.6:0/77860080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc360009550 con 0x7fc36c15bd30 2022-11-27T16:34:36.783 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.768+0000 7fc36b59e700 1 --2- 172.21.15.6:0/77860080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc36c15bd30 0x7fc36c0ae370 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc36400cb50 tx=0x7fc36400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:36.783 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.768+0000 7fc3537fe700 1 -- 172.21.15.6:0/77860080 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc364003c00 con 0x7fc36c15bd30 2022-11-27T16:34:36.784 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.768+0000 7fc3537fe700 1 -- 172.21.15.6:0/77860080 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc364003d60 con 0x7fc36c15bd30 2022-11-27T16:34:36.784 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.768+0000 7fc3537fe700 1 -- 172.21.15.6:0/77860080 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36400aa20 con 0x7fc36c15bd30 2022-11-27T16:34:36.784 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.768+0000 7fc371033700 1 -- 172.21.15.6:0/77860080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36c15c300 con 0x7fc36c15bd30 2022-11-27T16:34:36.784 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.768+0000 7fc371033700 1 -- 172.21.15.6:0/77860080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36c152ee0 con 0x7fc36c15bd30 2022-11-27T16:34:36.784 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.769+0000 7fc371033700 1 -- 172.21.15.6:0/77860080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36c15c820 con 0x7fc36c15bd30 2022-11-27T16:34:36.785 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.769+0000 7fc3537fe700 1 -- 172.21.15.6:0/77860080 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 84497+0+0 (secure 0 0 0) 0x7fc364010050 con 0x7fc36c15bd30 2022-11-27T16:34:36.785 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.770+0000 7fc3537fe700 1 --2- 172.21.15.6:0/77860080 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fc34c0665c0 0x7fc34c068a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:36.786 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.770+0000 7fc3537fe700 1 -- 172.21.15.6:0/77860080 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fc3640834e0 con 0x7fc36c15bd30 2022-11-27T16:34:36.786 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.770+0000 7fc36ad9d700 1 --2- 172.21.15.6:0/77860080 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fc34c0665c0 0x7fc34c068a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-11-27T16:34:36.787 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.770+0000 7fc36ad9d700 1 --2- 172.21.15.6:0/77860080 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fc34c0665c0 0x7fc34c068a70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0099d0 tx=0x7fc35c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-11-27T16:34:36.787 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.774+0000 7fc3537fe700 1 -- 172.21.15.6:0/77860080 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170936 (secure 0 0 0) 0x7fc36c15c820 con 0x7fc36c15bd30 2022-11-27T16:34:36.968 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:36.966+0000 7fc371033700 1 -- 172.21.15.6:0/77860080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc36c15c820 con 0x7fc36c15bd30 2022-11-27T16:34:37.613 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.611+0000 7fc3537fe700 1 -- 172.21.15.6:0/77860080 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc36c15c820 con 0x7fc36c15bd30 2022-11-27T16:34:37.619 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.616+0000 7fc371033700 1 -- 172.21.15.6:0/77860080 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fc34c0665c0 msgr2=0x7fc34c068a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.616+0000 7fc371033700 1 --2- 172.21.15.6:0/77860080 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fc34c0665c0 0x7fc34c068a70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc35c0099d0 tx=0x7fc35c008040 comp rx=0 tx=0).stop 2022-11-27T16:34:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.617+0000 7fc371033700 1 -- 172.21.15.6:0/77860080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc36c15bd30 msgr2=0x7fc36c0ae370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-11-27T16:34:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.617+0000 7fc371033700 1 --2- 172.21.15.6:0/77860080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc36c15bd30 0x7fc36c0ae370 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc36400cb50 tx=0x7fc36400ce60 comp rx=0 tx=0).stop 2022-11-27T16:34:37.621 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.617+0000 7fc371033700 1 -- 172.21.15.6:0/77860080 shutdown_connections 2022-11-27T16:34:37.621 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.617+0000 7fc371033700 1 --2- 172.21.15.6:0/77860080 >> [v2:172.21.15.55:6832/100913,v1:172.21.15.55:6833/100913] conn(0x7fc34c0665c0 0x7fc34c068a70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:37.621 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.617+0000 7fc371033700 1 --2- 172.21.15.6:0/77860080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc36c15bd30 0x7fc36c0ae370 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.617+0000 7fc371033700 1 --2- 172.21.15.6:0/77860080 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc36c06fae0 0x7fc36c151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.617+0000 7fc371033700 1 --2- 172.21.15.6:0/77860080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc36c0cdc80 0x7fc36c15cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-11-27T16:34:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.617+0000 7fc371033700 1 -- 172.21.15.6:0/77860080 >> 172.21.15.6:0/77860080 conn(0x7fc36c0ce8f0 msgr2=0x7fc36c0705d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-11-27T16:34:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.618+0000 7fc371033700 1 -- 172.21.15.6:0/77860080 shutdown_connections 2022-11-27T16:34:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.619+0000 7fc371033700 1 -- 172.21.15.6:0/77860080 wait complete. 2022-11-27T16:34:37.626 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2022-11-27T16:34:37.647 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2022-11-27T16:34:37.779 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.777+0000 7f2a82f09700 1 Processor -- start 2022-11-27T16:34:37.780 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.777+0000 7f2a82f09700 1 -- start start 2022-11-27T16:34:37.783 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.778+0000 7f2a82f09700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2a7c15be90 0x7f2a7c0cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:37.783 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.778+0000 7f2a82f09700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a7c0ccde0 0x7f2a7c0cfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-11-27T16:34:37.783 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.778+0000 7f2a82f09700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a7c0cf530 con 0x7f2a7c15bac0 2022-11-27T16:34:37.784 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.778+0000 7f2a82f09700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a7c0cd260 con 0x7f2a7c0ccde0 2022-11-27T16:34:37.784 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.778+0000 7f2a82f09700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7c06b910 con 0x7f2a7c15be90 2022-11-27T16:34:37.784 INFO:teuthology.orchestra.run.smithi006.stderr:2022-11-27T16:34:37.778+0000 7f2a814a6700 1 --2- >> v2:172.21.15.55:33