2022-09-20T19:59:14.657 INFO:root:teuthology version: 1.1.1.dev418+gb58f2c18 2022-09-20T19:59:14.660 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name pdonnell-2022-09-20_19:41:25-fs:functional-wip-pdonnell-testing-20220920.151129-distro-default-smithi --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2022-09-20_19:41:25-fs:functional-wip-pdonnell-testing-20220920.151129-distro-default-smithi/7039472 -- /home/teuthworker/archive/pdonnell-2022-09-20_19:41:25-fs:functional-wip-pdonnell-testing-20220920.151129-distro-default-smithi/7039472/orig.config.yaml 2022-09-20T19:59:14.753 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-09-20T19:59:14.825 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2022-09-20_19:41:25-fs:functional-wip-pdonnell-testing-20220920.151129-distro-default-smithi/7039472 branch: wip-pdonnell-testing-20220920.151129 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool} email: pdonnell@redhat.com first_in_suite: false job_id: '7039472' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2022-09-20_19:41:25-fs:functional-wip-pdonnell-testing-20220920.151129-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-pdonnell-testing-20220920.151129 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - bad backtrace - object missing on disk - error reading table object - error reading sessionmap - unmatched fragstat - unmatched rstat - was unreadable, recreating it now - Scrub error on inode - Metadata damage detected - MDS_FAILED - MDS_DAMAGE sha1: ada1013c357729fc3bf91fdc0bbe1d411f5af166 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ada1013c357729fc3bf91fdc0bbe1d411f5af166 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20220920.151129 sha1: 7874f3907d0b2e2027e668918a6854269060504f owner: scheduled_pdonnell@teuthology priority: 50 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: ada1013c357729fc3bf91fdc0bbe1d411f5af166 sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-pdonnell-testing-20220920.151129 suite_path: /home/teuthworker/src/github.com_batrick_ceph_7874f3907d0b2e2027e668918a6854269060504f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: 7874f3907d0b2e2027e668918a6854269060504f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE/F8K8Za/2CRN6wLkYLnpTdbukjQ8j7gkHRHTTxDeHnfd3KeqFsd500IrnLzySnB4/KkMjwg2pcg1ZbyVGR78k= smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHFlxhl2xZ+i+ISK05p/Dpv2xzBni/JcKaTXyhk4D2IYI1oRTFxscU/FtwTQllPmDbUSvhbF0dkje9awkfo9xpo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_recovery_pool teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b58f2c18636eb10faa77ed3614abd00cb85dfc2c timestamp: 2022-09-20_19:41:25 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.14413 2022-09-20T19:59:14.825 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_7874f3907d0b2e2027e668918a6854269060504f/qa; will attempt to use it 2022-09-20T19:59:14.826 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_7874f3907d0b2e2027e668918a6854269060504f/qa/tasks 2022-09-20T19:59:14.827 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-09-20T19:59:14.828 INFO:teuthology.task.internal:Checking packages... 2022-09-20T19:59:14.855 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ada1013c357729fc3bf91fdc0bbe1d411f5af166' 2022-09-20T19:59:14.855 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-09-20T19:59:14.856 INFO:teuthology.packaging:ref: None 2022-09-20T19:59:14.856 INFO:teuthology.packaging:tag: None 2022-09-20T19:59:14.856 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20220920.151129 2022-09-20T19:59:14.857 INFO:teuthology.packaging:sha1: ada1013c357729fc3bf91fdc0bbe1d411f5af166 2022-09-20T19:59:14.857 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20220920.151129 2022-09-20T19:59:15.090 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-15134.gada1013c 2022-09-20T19:59:15.090 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-09-20T19:59:15.102 INFO:teuthology.task.internal:no buildpackages task found 2022-09-20T19:59:15.102 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-09-20T19:59:15.110 INFO:teuthology.task.internal:Saving configuration 2022-09-20T19:59:15.129 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-09-20T19:59:15.136 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-09-20T19:59:15.161 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2022-09-20_19:41:25-fs:functional-wip-pdonnell-testing-20220920.151129-distro-default-smithi/7039472', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-09-20 19:53:59.576778', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE/F8K8Za/2CRN6wLkYLnpTdbukjQ8j7gkHRHTTxDeHnfd3KeqFsd500IrnLzySnB4/KkMjwg2pcg1ZbyVGR78k='} 2022-09-20T19:59:15.184 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2022-09-20_19:41:25-fs:functional-wip-pdonnell-testing-20220920.151129-distro-default-smithi/7039472', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-09-20 19:53:59.575344', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHFlxhl2xZ+i+ISK05p/Dpv2xzBni/JcKaTXyhk4D2IYI1oRTFxscU/FtwTQllPmDbUSvhbF0dkje9awkfo9xpo='} 2022-09-20T19:59:15.184 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-09-20T19:59:15.191 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2022-09-20T19:59:15.191 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2022-09-20T19:59:15.192 INFO:teuthology.run_tasks:Running task console_log... 2022-09-20T19:59:15.270 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f88d9936ea0>, signals=[15]) 2022-09-20T19:59:15.273 INFO:teuthology.run_tasks:Running task internal.connect... 2022-09-20T19:59:15.281 INFO:teuthology.task.internal:Opening connections... 2022-09-20T19:59:15.282 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2022-09-20T19:59:15.284 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-20T19:59:15.364 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2022-09-20T19:59:15.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-20T19:59:15.436 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-09-20T19:59:15.443 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2022-09-20T19:59:15.465 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2022-09-20T19:59:15.466 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2022-09-20T19:59:15.526 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2022-09-20T19:59:15.526 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="8" 2022-09-20T19:59:15.527 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2022-09-20T19:59:15.527 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2022-09-20T19:59:15.527 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="8" 2022-09-20T19:59:15.527 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el8" 2022-09-20T19:59:15.528 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 8" 2022-09-20T19:59:15.528 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2022-09-20T19:59:15.528 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-09-20T19:59:15.528 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2022-09-20T19:59:15.529 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-20T19:59:15.529 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-20T19:59:15.529 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-09-20T19:59:15.530 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2022-09-20T19:59:15.549 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2022-09-20T19:59:15.569 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2022-09-20T19:59:15.570 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2022-09-20T19:59:15.629 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream" 2022-09-20T19:59:15.629 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="8" 2022-09-20T19:59:15.630 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos" 2022-09-20T19:59:15.630 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora" 2022-09-20T19:59:15.630 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="8" 2022-09-20T19:59:15.630 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el8" 2022-09-20T19:59:15.631 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 8" 2022-09-20T19:59:15.631 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2022-09-20T19:59:15.631 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-09-20T19:59:15.631 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/" 2022-09-20T19:59:15.631 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-09-20T19:59:15.632 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-09-20T19:59:15.632 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-09-20T19:59:15.632 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2022-09-20T19:59:15.651 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-09-20T19:59:15.661 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-09-20T19:59:15.667 INFO:teuthology.task.internal:Checking for old test directory... 2022-09-20T19:59:15.667 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2022-09-20T19:59:15.670 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2022-09-20T19:59:15.689 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-09-20T19:59:15.695 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-09-20T19:59:15.696 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2022-09-20T19:59:15.729 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2022-09-20T19:59:15.762 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-09-20T19:59:15.816 INFO:teuthology.run_tasks:Running task kernel... 2022-09-20T19:59:15.833 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2022-09-20T19:59:15.833 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2022-09-20T19:59:15.834 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2022-09-20T19:59:15.835 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2022-09-20T19:59:15.853 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-20T19:59:15.854 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2022-09-20T19:59:15.856 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-20T19:59:15.857 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2022-09-20T19:59:15.913 INFO:teuthology.orchestra.run.smithi152.stdout:4.18.0-408.el8.x86_64 2022-09-20T19:59:15.914 INFO:teuthology.task.kernel:Running kernel on smithi152: 4.18.0-408.el8.x86_64 2022-09-20T19:59:15.914 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum install -y kernel 2022-09-20T19:59:15.916 INFO:teuthology.orchestra.run.smithi171.stdout:4.18.0-408.el8.x86_64 2022-09-20T19:59:15.917 INFO:teuthology.task.kernel:Running kernel on smithi171: 4.18.0-408.el8.x86_64 2022-09-20T19:59:15.917 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum install -y kernel 2022-09-20T19:59:19.015 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS-8 - AppStream 30 MB/s | 25 MB 00:00 2022-09-20T19:59:19.020 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-8 - AppStream 32 MB/s | 25 MB 00:00 2022-09-20T19:59:24.232 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS-8 - BaseOS 33 MB/s | 25 MB 00:00 2022-09-20T19:59:24.454 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-8 - BaseOS 28 MB/s | 25 MB 00:00 2022-09-20T19:59:28.122 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS-8 - Extras 152 kB/s | 18 kB 00:00 2022-09-20T19:59:28.386 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-8 - Extras 128 kB/s | 18 kB 00:00 2022-09-20T19:59:28.616 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS-8 - PowerTools 13 MB/s | 5.0 MB 00:00 2022-09-20T19:59:29.305 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-8 - PowerTools 6.3 MB/s | 5.0 MB 00:00 2022-09-20T19:59:29.724 INFO:teuthology.orchestra.run.smithi171.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2022-09-20T19:59:30.438 INFO:teuthology.orchestra.run.smithi152.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2022-09-20T19:59:31.283 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 9.0 MB/s | 13 MB 00:01 2022-09-20T19:59:31.897 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 9.6 MB/s | 13 MB 00:01 2022-09-20T19:59:34.382 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 607 kB/s | 24 kB 00:00 2022-09-20T19:59:35.097 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 370 kB/s | 24 kB 00:00 2022-09-20T19:59:37.206 INFO:teuthology.orchestra.run.smithi171.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2022-09-20T19:59:37.206 INFO:teuthology.orchestra.run.smithi171.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2022-09-20T19:59:37.333 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2022-09-20T19:59:37.334 INFO:teuthology.orchestra.run.smithi171.stdout:Nothing to do. 2022-09-20T19:59:37.335 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2022-09-20T19:59:37.455 DEBUG:teuthology.orchestra.run.smithi171:> echo no | sudo yum reinstall kernel || true 2022-09-20T19:59:37.936 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2022-09-20T19:59:37.937 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2022-09-20T19:59:38.023 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:00:04 ago on Tue 20 Sep 2022 07:59:34 PM UTC. 2022-09-20T19:59:38.049 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2022-09-20T19:59:38.050 INFO:teuthology.orchestra.run.smithi152.stdout:Nothing to do. 2022-09-20T19:59:38.050 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2022-09-20T19:59:38.157 DEBUG:teuthology.orchestra.run.smithi152:> echo no | sudo yum reinstall kernel || true 2022-09-20T19:59:38.726 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:03 ago on Tue 20 Sep 2022 07:59:35 PM UTC. 2022-09-20T19:59:39.063 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2022-09-20T19:59:39.064 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2022-09-20T19:59:39.064 INFO:teuthology.orchestra.run.smithi171.stdout: Package Architecture Version Repository Size 2022-09-20T19:59:39.064 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2022-09-20T19:59:39.065 INFO:teuthology.orchestra.run.smithi171.stdout:Reinstalling: 2022-09-20T19:59:39.065 INFO:teuthology.orchestra.run.smithi171.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2022-09-20T19:59:39.065 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T19:59:39.065 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2022-09-20T19:59:39.066 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2022-09-20T19:59:39.066 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T19:59:39.066 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 8.5 M 2022-09-20T19:59:39.066 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 0 2022-09-20T19:59:39.067 INFO:teuthology.orchestra.run.smithi171.stderr:Operation aborted. 2022-09-20T19:59:39.134 INFO:teuthology.orchestra.run.smithi171.stdout:Is this ok [y/N]: 2022-09-20T19:59:39.134 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum reinstall -y kernel || true 2022-09-20T19:59:39.699 INFO:teuthology.orchestra.run.smithi171.stdout:Last metadata expiration check: 0:00:05 ago on Tue 20 Sep 2022 07:59:34 PM UTC. 2022-09-20T19:59:39.748 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2022-09-20T19:59:39.749 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2022-09-20T19:59:39.749 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2022-09-20T19:59:39.750 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2022-09-20T19:59:39.750 INFO:teuthology.orchestra.run.smithi152.stdout:Reinstalling: 2022-09-20T19:59:39.750 INFO:teuthology.orchestra.run.smithi152.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2022-09-20T19:59:39.750 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T19:59:39.751 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2022-09-20T19:59:39.751 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2022-09-20T19:59:39.751 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T19:59:39.751 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 8.5 M 2022-09-20T19:59:39.751 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 0 2022-09-20T19:59:39.752 INFO:teuthology.orchestra.run.smithi152.stderr:Operation aborted. 2022-09-20T19:59:39.827 INFO:teuthology.orchestra.run.smithi152.stdout:Is this ok [y/N]: 2022-09-20T19:59:39.828 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum reinstall -y kernel || true 2022-09-20T19:59:40.390 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:00:05 ago on Tue 20 Sep 2022 07:59:35 PM UTC. 2022-09-20T19:59:40.712 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2022-09-20T19:59:40.713 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2022-09-20T19:59:40.713 INFO:teuthology.orchestra.run.smithi171.stdout: Package Architecture Version Repository Size 2022-09-20T19:59:40.714 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2022-09-20T19:59:40.714 INFO:teuthology.orchestra.run.smithi171.stdout:Reinstalling: 2022-09-20T19:59:40.714 INFO:teuthology.orchestra.run.smithi171.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2022-09-20T19:59:40.714 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T19:59:40.714 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2022-09-20T19:59:40.715 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2022-09-20T19:59:40.715 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T19:59:40.716 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 8.5 M 2022-09-20T19:59:40.716 INFO:teuthology.orchestra.run.smithi171.stdout:Installed size: 0 2022-09-20T19:59:40.716 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2022-09-20T19:59:41.009 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-4.18.0-408.el8.x86_64.rpm 29 MB/s | 8.5 MB 00:00 2022-09-20T19:59:41.009 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2022-09-20T19:59:41.010 INFO:teuthology.orchestra.run.smithi171.stdout:Total 29 MB/s | 8.5 MB 00:00 2022-09-20T19:59:41.105 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2022-09-20T19:59:41.423 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2022-09-20T19:59:41.424 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2022-09-20T19:59:41.424 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2022-09-20T19:59:41.425 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2022-09-20T19:59:41.425 INFO:teuthology.orchestra.run.smithi152.stdout:Reinstalling: 2022-09-20T19:59:41.425 INFO:teuthology.orchestra.run.smithi152.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2022-09-20T19:59:41.425 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T19:59:41.426 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2022-09-20T19:59:41.426 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2022-09-20T19:59:41.426 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T19:59:41.426 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 8.5 M 2022-09-20T19:59:41.426 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 0 2022-09-20T19:59:41.427 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2022-09-20T19:59:41.483 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2022-09-20T19:59:41.484 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2022-09-20T19:59:41.633 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2022-09-20T19:59:41.647 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2022-09-20T19:59:41.665 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-4.18.0-408.el8.x86_64.rpm 36 MB/s | 8.5 MB 00:00 2022-09-20T19:59:41.666 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2022-09-20T19:59:41.666 INFO:teuthology.orchestra.run.smithi152.stdout:Total 35 MB/s | 8.5 MB 00:00 2022-09-20T19:59:41.762 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2022-09-20T19:59:41.929 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2022-09-20T19:59:42.120 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2022-09-20T19:59:42.121 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2022-09-20T19:59:42.140 INFO:teuthology.orchestra.run.smithi171.stdout: Reinstalling : kernel-4.18.0-408.el8.x86_64 1/2 2022-09-20T19:59:42.141 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : kernel-4.18.0-408.el8.x86_64 2/2 2022-09-20T19:59:42.277 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2022-09-20T19:59:42.291 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2022-09-20T19:59:42.529 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: kernel-4.18.0-408.el8.x86_64 2/2 2022-09-20T19:59:42.529 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 1/2 2022-09-20T19:59:42.584 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2022-09-20T19:59:42.793 INFO:teuthology.orchestra.run.smithi152.stdout: Reinstalling : kernel-4.18.0-408.el8.x86_64 1/2 2022-09-20T19:59:42.793 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : kernel-4.18.0-408.el8.x86_64 2/2 2022-09-20T19:59:43.055 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 2/2 2022-09-20T19:59:43.056 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T19:59:43.056 INFO:teuthology.orchestra.run.smithi171.stdout:Reinstalled: 2022-09-20T19:59:43.056 INFO:teuthology.orchestra.run.smithi171.stdout: kernel-4.18.0-408.el8.x86_64 2022-09-20T19:59:43.057 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T19:59:43.057 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2022-09-20T19:59:43.133 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q kernel --last | head -n 1 2022-09-20T19:59:43.182 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-4.18.0-408.el8.x86_64 2/2 2022-09-20T19:59:43.182 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 1/2 2022-09-20T19:59:43.259 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-4.18.0-408.el8.x86_64 Tue 20 Sep 2022 07:59:41 PM UTC 2022-09-20T19:59:43.261 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-408.el8.x86_64 2022-09-20T19:59:43.261 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-09-20T19:59:43.262 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2022-09-20T19:59:43.262 DEBUG:teuthology.orchestra.run.smithi171:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-09-20T19:59:43.303 INFO:teuthology.orchestra.run.smithi171.stdout:ttyS1 2022-09-20T19:59:43.316 DEBUG:teuthology.parallel:result is None 2022-09-20T19:59:43.647 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 2/2 2022-09-20T19:59:43.647 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T19:59:43.647 INFO:teuthology.orchestra.run.smithi152.stdout:Reinstalled: 2022-09-20T19:59:43.648 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-4.18.0-408.el8.x86_64 2022-09-20T19:59:43.648 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T19:59:43.648 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2022-09-20T19:59:43.725 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel --last | head -n 1 2022-09-20T19:59:43.851 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-4.18.0-408.el8.x86_64 Tue 20 Sep 2022 07:59:42 PM UTC 2022-09-20T19:59:43.852 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-408.el8.x86_64 2022-09-20T19:59:43.853 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2022-09-20T19:59:43.853 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2022-09-20T19:59:43.854 DEBUG:teuthology.orchestra.run.smithi152:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-09-20T19:59:43.886 INFO:teuthology.orchestra.run.smithi152.stdout:ttyS1 2022-09-20T19:59:43.899 DEBUG:teuthology.parallel:result is None 2022-09-20T19:59:43.900 INFO:teuthology.run_tasks:Running task internal.base... 2022-09-20T19:59:43.908 INFO:teuthology.task.internal:Creating test directory... 2022-09-20T19:59:43.909 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-09-20T19:59:43.942 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-09-20T19:59:43.960 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-09-20T19:59:43.967 INFO:teuthology.run_tasks:Running task internal.archive... 2022-09-20T19:59:43.974 INFO:teuthology.task.internal:Creating archive directory... 2022-09-20T19:59:43.975 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-09-20T19:59:44.000 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-09-20T19:59:44.041 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-09-20T19:59:44.048 INFO:teuthology.task.internal:Enabling coredump saving... 2022-09-20T19:59:44.049 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-09-20T19:59:44.076 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-09-20T19:59:44.104 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-20T19:59:44.113 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-20T19:59:44.114 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-20T19:59:44.123 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-09-20T19:59:44.124 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-09-20T19:59:44.132 INFO:teuthology.task.internal:Configuring sudo... 2022-09-20T19:59:44.132 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-09-20T19:59:44.158 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-09-20T19:59:44.191 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-09-20T19:59:44.201 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-09-20T19:59:44.201 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-09-20T19:59:44.225 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-09-20T19:59:44.249 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-20T19:59:44.322 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-20T19:59:44.383 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-20T19:59:44.425 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-20T19:59:44.469 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T19:59:44.470 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-09-20T19:59:44.536 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-20T19:59:44.578 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-09-20T19:59:44.632 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-20T19:59:44.716 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-09-20T19:59:44.759 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T19:59:44.760 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-09-20T19:59:44.826 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2022-09-20T19:59:44.828 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2022-09-20T19:59:44.888 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-09-20T19:59:44.935 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-09-20T19:59:45.346 INFO:teuthology.run_tasks:Running task internal.timer... 2022-09-20T19:59:45.355 INFO:teuthology.task.internal:Starting timer... 2022-09-20T19:59:45.355 INFO:teuthology.run_tasks:Running task pcp... 2022-09-20T19:59:45.366 INFO:teuthology.run_tasks:Running task selinux... 2022-09-20T19:59:45.375 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2022-09-20T19:59:45.376 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2022-09-20T19:59:45.447 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2022-09-20T19:59:45.449 DEBUG:teuthology.orchestra.run.smithi171:> sudo service auditd rotate 2022-09-20T19:59:45.534 INFO:teuthology.orchestra.run.smithi171.stdout:Rotating logs: 2022-09-20T19:59:45.536 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-09-20T19:59:45.537 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2022-09-20T19:59:45.563 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2022-09-20T19:59:45.564 DEBUG:teuthology.orchestra.run.smithi171:> /usr/sbin/getenforce 2022-09-20T19:59:45.585 INFO:teuthology.orchestra.run.smithi171.stdout:Permissive 2022-09-20T19:59:45.585 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi152.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi171.front.sepia.ceph.com': 'permissive'} 2022-09-20T19:59:45.586 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-09-20T19:59:45.630 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-20T19:59:45.631 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2022-09-20T19:59:45.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-09-20T19:59:45.659 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-09-20T19:59:45.659 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2022-09-20T19:59:45.706 DEBUG:teuthology.orchestra.run.smithi171:> sudo /usr/sbin/setenforce permissive 2022-09-20T19:59:45.740 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-09-20T19:59:45.751 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2022-09-20T19:59:45.777 INFO:teuthology.repo_utils:Fetching main from origin 2022-09-20T19:59:45.834 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main to origin/main 2022-09-20T19:59:45.857 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-09-20T19:59:45.859 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi152.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_main/cephlab.yml 2022-09-20T20:05:33.144 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi152.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2022-09-20T20:05:33.148 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2022-09-20T20:05:33.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-20T20:05:33.234 DEBUG:teuthology.orchestra.run.smithi152:> true 2022-09-20T20:05:33.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2022-09-20T20:05:33.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-09-20T20:05:33.382 DEBUG:teuthology.orchestra.run.smithi171:> true 2022-09-20T20:05:33.454 INFO:teuthology.run_tasks:Running task clock... 2022-09-20T20:05:33.467 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-09-20T20:05:33.468 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-09-20T20:05:33.470 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-09-20T20:05:33.473 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-09-20T20:05:33.473 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-09-20T20:05:33.504 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-09-20T20:05:33.518 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-09-20T20:05:33.529 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-09-20T20:05:33.543 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-09-20T20:05:33.594 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2022-09-20T20:05:33.605 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2022-09-20T20:05:33.610 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: ntpd: command not found 2022-09-20T20:05:33.618 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-09-20T20:05:33.621 INFO:teuthology.orchestra.run.smithi171.stdout:506 Cannot talk to daemon 2022-09-20T20:05:33.632 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-09-20T20:05:33.635 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-09-20T20:05:33.649 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-09-20T20:05:33.703 INFO:teuthology.orchestra.run.smithi152.stderr:bash: ntpq: command not found 2022-09-20T20:05:33.707 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-09-20T20:05:33.708 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2022-09-20T20:05:33.708 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-20T20:05:33.708 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-20T20:05:33.708 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-20T20:05:33.708 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-20T20:05:33.730 INFO:teuthology.orchestra.run.smithi171.stderr:bash: ntpq: command not found 2022-09-20T20:05:33.734 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-09-20T20:05:33.734 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2022-09-20T20:05:33.735 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-20T20:05:33.735 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-20T20:05:33.736 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-20T20:05:33.736 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-09-20T20:05:33.737 INFO:teuthology.run_tasks:Running task install... 2022-09-20T20:05:33.751 DEBUG:teuthology.task.install:project ceph 2022-09-20T20:05:33.752 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ada1013c357729fc3bf91fdc0bbe1d411f5af166'}} 2022-09-20T20:05:33.753 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ada1013c357729fc3bf91fdc0bbe1d411f5af166'} 2022-09-20T20:05:33.753 INFO:teuthology.task.install:Using flavor: default 2022-09-20T20:05:33.763 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-09-20T20:05:33.764 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2022-09-20T20:05:33.764 DEBUG:teuthology.orchestra.run.smithi152:> sudo lsb_release -is 2022-09-20T20:05:33.801 INFO:teuthology.orchestra.run.smithi152.stdout:CentOSStream 2022-09-20T20:05:33.803 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-09-20T20:05:33.803 DEBUG:teuthology.orchestra.run.smithi171:> sudo lsb_release -is 2022-09-20T20:05:33.804 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ada1013c357729fc3bf91fdc0bbe1d411f5af166', 'tag': None, 'wait_for_package': False} 2022-09-20T20:05:33.805 DEBUG:teuthology.orchestra.run.smithi152:> sudo lsb_release -is 2022-09-20T20:05:33.842 INFO:teuthology.orchestra.run.smithi171.stdout:CentOSStream 2022-09-20T20:05:33.843 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-09-20T20:05:33.844 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'ada1013c357729fc3bf91fdc0bbe1d411f5af166', 'tag': None, 'wait_for_package': False} 2022-09-20T20:05:33.844 DEBUG:teuthology.orchestra.run.smithi171:> sudo lsb_release -is 2022-09-20T20:05:33.879 INFO:teuthology.orchestra.run.smithi152.stdout:CentOSStream 2022-09-20T20:05:33.881 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-09-20T20:05:33.882 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ada1013c357729fc3bf91fdc0bbe1d411f5af166 2022-09-20T20:05:33.923 INFO:teuthology.orchestra.run.smithi171.stdout:CentOSStream 2022-09-20T20:05:33.924 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-09-20T20:05:33.925 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ada1013c357729fc3bf91fdc0bbe1d411f5af166 2022-09-20T20:05:34.051 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220920.151129/ada1013c357729fc3bf91fdc0bbe1d411f5af166/centos/8/flavors/default/ 2022-09-20T20:05:34.051 INFO:teuthology.task.install.rpm:Package version is 17.0.0-15134.gada1013c 2022-09-20T20:05:34.088 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220920.151129/ada1013c357729fc3bf91fdc0bbe1d411f5af166/centos/8/flavors/default/ 2022-09-20T20:05:34.089 INFO:teuthology.task.install.rpm:Package version is 17.0.0-15134.gada1013c 2022-09-20T20:05:34.189 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220920.151129/ada1013c357729fc3bf91fdc0bbe1d411f5af166/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220920.151129/ada1013c357729fc3bf91fdc0bbe1d411f5af166/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220920.151129/ada1013c357729fc3bf91fdc0bbe1d411f5af166/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-09-20T20:05:34.189 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:05:34.190 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-09-20T20:05:34.216 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220920.151129/ada1013c357729fc3bf91fdc0bbe1d411f5af166/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220920.151129/ada1013c357729fc3bf91fdc0bbe1d411f5af166/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20220920.151129/ada1013c357729fc3bf91fdc0bbe1d411f5af166/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-09-20T20:05:34.217 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:05:34.217 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-09-20T20:05:34.219 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2022-09-20T20:05:34.219 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ada1013c357729fc3bf91fdc0bbe1d411f5af166/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-09-20T20:05:34.246 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2022-09-20T20:05:34.247 DEBUG:teuthology.orchestra.run.smithi171:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/ada1013c357729fc3bf91fdc0bbe1d411f5af166/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-09-20T20:05:34.286 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-09-20T20:05:34.315 DEBUG:teuthology.orchestra.run.smithi171:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-09-20T20:05:34.363 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-09-20T20:05:34.392 DEBUG:teuthology.orchestra.run.smithi171:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-09-20T20:05:34.430 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2022-09-20T20:05:34.431 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2022-09-20T20:05:34.458 INFO:teuthology.orchestra.run.smithi171.stdout:check_obsoletes = 1 2022-09-20T20:05:34.460 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum clean all 2022-09-20T20:05:34.678 INFO:teuthology.orchestra.run.smithi152.stdout:55 files removed 2022-09-20T20:05:34.704 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2022-09-20T20:05:34.708 INFO:teuthology.orchestra.run.smithi171.stdout:55 files removed 2022-09-20T20:05:34.733 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2022-09-20T20:05:35.326 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 301 kB/s | 81 kB 00:00 2022-09-20T20:05:35.371 INFO:teuthology.orchestra.run.smithi171.stdout:ceph packages for x86_64 280 kB/s | 81 kB 00:00 2022-09-20T20:05:35.602 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 39 kB/s | 9.4 kB 00:00 2022-09-20T20:05:35.655 INFO:teuthology.orchestra.run.smithi171.stdout:ceph noarch packages 38 kB/s | 9.4 kB 00:00 2022-09-20T20:05:35.869 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 6.3 kB/s | 1.5 kB 00:00 2022-09-20T20:05:35.948 INFO:teuthology.orchestra.run.smithi171.stdout:ceph source packages 5.7 kB/s | 1.5 kB 00:00 2022-09-20T20:05:36.522 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-8 - AppStream 40 MB/s | 25 MB 00:00 2022-09-20T20:05:36.701 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS-8 - AppStream 34 MB/s | 25 MB 00:00 2022-09-20T20:05:41.672 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-8 - BaseOS 38 MB/s | 25 MB 00:00 2022-09-20T20:05:41.785 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS-8 - BaseOS 42 MB/s | 25 MB 00:00 2022-09-20T20:05:45.562 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-8 - Extras 179 kB/s | 18 kB 00:00 2022-09-20T20:05:45.750 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS-8 - Extras 176 kB/s | 18 kB 00:00 2022-09-20T20:05:45.923 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-8 - PowerTools 21 MB/s | 5.0 MB 00:00 2022-09-20T20:05:46.120 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS-8 - PowerTools 20 MB/s | 5.0 MB 00:00 2022-09-20T20:05:47.030 INFO:teuthology.orchestra.run.smithi152.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2022-09-20T20:05:47.210 INFO:teuthology.orchestra.run.smithi171.stdout:Copr repo for python3-asyncssh owned by ceph 29 kB/s | 3.5 kB 00:00 2022-09-20T20:05:48.131 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 13 MB/s | 13 MB 00:00 2022-09-20T20:05:48.270 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 14 MB/s | 13 MB 00:00 2022-09-20T20:05:51.206 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 352 kB/s | 24 kB 00:00 2022-09-20T20:05:51.370 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 335 kB/s | 24 kB 00:00 2022-09-20T20:05:54.248 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-20T20:05:54.249 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-20T20:05:54.260 INFO:teuthology.orchestra.run.smithi152.stdout:Package NetworkManager-1:1.40.0-1.el8.x86_64 is already installed. 2022-09-20T20:05:54.260 INFO:teuthology.orchestra.run.smithi152.stdout:Package NetworkManager-initscripts-updown-1:1.40.0-1.el8.noarch is already installed. 2022-09-20T20:05:54.261 INFO:teuthology.orchestra.run.smithi152.stdout:Package iproute-5.18.0-1.el8.x86_64 is already installed. 2022-09-20T20:05:54.261 INFO:teuthology.orchestra.run.smithi152.stdout:Package util-linux-2.32.1-38.el8.x86_64 is already installed. 2022-09-20T20:05:54.262 INFO:teuthology.orchestra.run.smithi152.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-09-20T20:05:54.264 INFO:teuthology.orchestra.run.smithi152.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-09-20T20:05:54.266 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2022-09-20T20:05:54.267 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-09-20T20:05:54.368 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2022-09-20T20:05:54.380 INFO:teuthology.orchestra.run.smithi152.stdout:====================================================================================================== 2022-09-20T20:05:54.380 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2022-09-20T20:05:54.381 INFO:teuthology.orchestra.run.smithi152.stdout:====================================================================================================== 2022-09-20T20:05:54.381 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2022-09-20T20:05:54.381 INFO:teuthology.orchestra.run.smithi152.stdout: bison x86_64 3.0.4-10.el8 CentOS-AppStream 688 k 2022-09-20T20:05:54.382 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:17.0.0-15134.gada1013c.el8 ceph 6.4 k 2022-09-20T20:05:54.382 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:17.0.0-15134.gada1013c.el8 ceph 5.2 M 2022-09-20T20:05:54.382 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:17.0.0-15134.gada1013c.el8 ceph 843 k 2022-09-20T20:05:54.382 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-15134.gada1013c.el8 ceph 165 k 2022-09-20T20:05:54.383 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:17.0.0-15134.gada1013c.el8 ceph 1.5 M 2022-09-20T20:05:54.383 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 117 k 2022-09-20T20:05:54.383 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 1.6 M 2022-09-20T20:05:54.383 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 7.4 M 2022-09-20T20:05:54.384 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 47 k 2022-09-20T20:05:54.384 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:17.0.0-15134.gada1013c.el8 ceph 18 M 2022-09-20T20:05:54.384 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:17.0.0-15134.gada1013c.el8 ceph 54 M 2022-09-20T20:05:54.384 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 263 k 2022-09-20T20:05:54.385 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 81 k 2022-09-20T20:05:54.385 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror x86_64 2:17.0.0-15134.gada1013c.el8 ceph 257 k 2022-09-20T20:05:54.385 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 15 k 2022-09-20T20:05:54.385 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel x86_64 0.187-4.el8 CentOS-BaseOS 61 k 2022-09-20T20:05:54.386 INFO:teuthology.orchestra.run.smithi152.stdout: flex x86_64 2.6.1-9.el8 CentOS-AppStream 320 k 2022-09-20T20:05:54.386 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 19 k 2022-09-20T20:05:54.386 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:17.0.0-15134.gada1013c.el8 ceph 30 k 2022-09-20T20:05:54.386 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 766 k 2022-09-20T20:05:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:17.0.0-15134.gada1013c.el8 ceph 139 k 2022-09-20T20:05:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: libtool x86_64 2.4.6-25.el8 CentOS-AppStream 709 k 2022-09-20T20:05:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel x86_64 2.32.1-38.el8 CentOS-BaseOS 99 k 2022-09-20T20:05:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel x86_64 1:1.1.1k-7.el8 CentOS-BaseOS 2.3 M 2022-09-20T20:05:54.387 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 1.5 M 2022-09-20T20:05:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 807 k 2022-09-20T20:05:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 5.1 M 2022-09-20T20:05:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:17.0.0-15134.gada1013c.el8 ceph 190 k 2022-09-20T20:05:54.388 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:17.0.0-15134.gada1013c.el8 ceph 371 k 2022-09-20T20:05:54.389 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:17.0.0-15134.gada1013c.el8 ceph 358 k 2022-09-20T20:05:54.389 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:17.0.0-15134.gada1013c.el8 ceph 106 k 2022-09-20T20:05:54.389 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:17.0.0-15134.gada1013c.el8 ceph 94 k 2022-09-20T20:05:54.389 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:17.0.0-15134.gada1013c.el8 ceph 3.5 M 2022-09-20T20:05:54.390 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:17.0.0-15134.gada1013c.el8 ceph 175 k 2022-09-20T20:05:54.390 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 CentOS-BaseOS 72 k 2022-09-20T20:05:54.390 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2022-09-20T20:05:54.390 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 3.6 M 2022-09-20T20:05:54.390 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 3.6 M 2022-09-20T20:05:54.391 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2022-09-20T20:05:54.391 INFO:teuthology.orchestra.run.smithi152.stdout: automake noarch 1.16.1-7.el8 CentOS-AppStream 713 k 2022-09-20T20:05:54.392 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:17.0.0-15134.gada1013c.el8 ceph 24 M 2022-09-20T20:05:54.392 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 23 k 2022-09-20T20:05:54.392 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:17.0.0-15134.gada1013c.el8 ceph 2.3 M 2022-09-20T20:05:54.392 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 233 k 2022-09-20T20:05:54.393 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:17.0.0-15134.gada1013c.el8 ceph 3.9 M 2022-09-20T20:05:54.393 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:17.0.0-15134.gada1013c.el8 ceph 17 M 2022-09-20T20:05:54.393 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 14 k 2022-09-20T20:05:54.393 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:17.0.0-15134.gada1013c.el8 ceph 24 k 2022-09-20T20:05:54.394 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2022-09-20T20:05:54.394 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-09-20T20:05:54.395 INFO:teuthology.orchestra.run.smithi152.stdout: jq x86_64 1.6-3.el8 CentOS-AppStream 202 k 2022-09-20T20:05:54.395 INFO:teuthology.orchestra.run.smithi152.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 CentOS-BaseOS 48 k 2022-09-20T20:05:54.395 INFO:teuthology.orchestra.run.smithi152.stdout: krb5-devel x86_64 1.18.2-21.el8 CentOS-BaseOS 560 k 2022-09-20T20:05:54.395 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:17.0.0-15134.gada1013c.el8 ceph 137 k 2022-09-20T20:05:54.396 INFO:teuthology.orchestra.run.smithi152.stdout: libcom_err-devel x86_64 1.45.6-5.el8 CentOS-BaseOS 39 k 2022-09-20T20:05:54.396 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 8.5.0-15.el8 CentOS-BaseOS 644 k 2022-09-20T20:05:54.396 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-09-20T20:05:54.396 INFO:teuthology.orchestra.run.smithi152.stdout: libpq x86_64 13.5-1.el8 CentOS-AppStream 198 k 2022-09-20T20:05:54.396 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 8.5.0-15.el8 CentOS-BaseOS 172 k 2022-09-20T20:05:54.397 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2022-09-20T20:05:54.397 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 473 k 2022-09-20T20:05:54.397 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-09-20T20:05:54.397 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 6.4 M 2022-09-20T20:05:54.398 INFO:teuthology.orchestra.run.smithi152.stdout: libselinux-devel x86_64 2.9-6.el8 CentOS-BaseOS 200 k 2022-09-20T20:05:54.398 INFO:teuthology.orchestra.run.smithi152.stdout: libsepol-devel x86_64 2.9-3.el8 CentOS-BaseOS 87 k 2022-09-20T20:05:54.398 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-09-20T20:05:54.398 INFO:teuthology.orchestra.run.smithi152.stdout: libverto-devel x86_64 0.3.2-2.el8 CentOS-BaseOS 18 k 2022-09-20T20:05:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-09-20T20:05:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-09-20T20:05:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2022-09-20T20:05:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2022-09-20T20:05:54.399 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-devel x86_64 10.32-3.el8 CentOS-BaseOS 605 k 2022-09-20T20:05:54.400 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf16 x86_64 10.32-3.el8 CentOS-BaseOS 229 k 2022-09-20T20:05:54.400 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf32 x86_64 10.32-3.el8 CentOS-BaseOS 220 k 2022-09-20T20:05:54.400 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-09-20T20:05:54.400 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2022-09-20T20:05:54.401 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-09-20T20:05:54.401 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-09-20T20:05:54.401 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-09-20T20:05:54.401 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:17.0.0-15134.gada1013c.el8 ceph 45 k 2022-09-20T20:05:54.402 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:17.0.0-15134.gada1013c.el8 ceph 109 k 2022-09-20T20:05:54.402 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-09-20T20:05:54.402 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2022-09-20T20:05:54.403 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-09-20T20:05:54.403 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-09-20T20:05:54.403 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2022-09-20T20:05:54.403 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-09-20T20:05:54.404 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-09-20T20:05:54.404 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-09-20T20:05:54.404 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2022-09-20T20:05:54.404 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2022-09-20T20:05:54.405 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2022-09-20T20:05:54.405 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2022-09-20T20:05:54.405 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-09-20T20:05:54.405 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-09-20T20:05:54.406 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-09-20T20:05:54.406 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-09-20T20:05:54.406 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-09-20T20:05:54.407 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-09-20T20:05:54.407 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2022-09-20T20:05:54.407 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2022-09-20T20:05:54.408 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2022-09-20T20:05:54.408 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-09-20T20:05:54.408 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-09-20T20:05:54.408 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-09-20T20:05:54.409 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-09-20T20:05:54.409 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2022-09-20T20:05:54.409 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2022-09-20T20:05:54.409 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2022-09-20T20:05:54.409 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-09-20T20:05:54.410 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-09-20T20:05:54.410 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2022-09-20T20:05:54.410 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-09-20T20:05:54.410 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-09-20T20:05:54.411 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2022-09-20T20:05:54.411 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-09-20T20:05:54.411 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-09-20T20:05:54.411 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-09-20T20:05:54.412 INFO:teuthology.orchestra.run.smithi152.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-09-20T20:05:54.412 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-09-20T20:05:54.412 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-09-20T20:05:54.412 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-09-20T20:05:54.412 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-09-20T20:05:54.413 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-09-20T20:05:54.413 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-09-20T20:05:54.413 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-09-20T20:05:54.414 INFO:teuthology.orchestra.run.smithi152.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-09-20T20:05:54.414 INFO:teuthology.orchestra.run.smithi152.stdout: uuid x86_64 1.6.2-43.el8 CentOS-AppStream 64 k 2022-09-20T20:05:54.414 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-PowerTools 71 k 2022-09-20T20:05:54.414 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel x86_64 1.2.11-20.el8 CentOS-BaseOS 58 k 2022-09-20T20:05:54.415 INFO:teuthology.orchestra.run.smithi152.stdout:Enabling module streams: 2022-09-20T20:05:54.415 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql 10 2022-09-20T20:05:54.415 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:05:54.416 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2022-09-20T20:05:54.416 INFO:teuthology.orchestra.run.smithi152.stdout:====================================================================================================== 2022-09-20T20:05:54.416 INFO:teuthology.orchestra.run.smithi152.stdout:Install 127 Packages 2022-09-20T20:05:54.416 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 2 Packages 2022-09-20T20:05:54.417 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:05:54.418 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 215 M 2022-09-20T20:05:54.418 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2022-09-20T20:05:54.419 INFO:teuthology.orchestra.run.smithi171.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-20T20:05:54.420 INFO:teuthology.orchestra.run.smithi171.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2022-09-20T20:05:54.420 INFO:teuthology.orchestra.run.smithi171.stdout:Package NetworkManager-1:1.40.0-1.el8.x86_64 is already installed. 2022-09-20T20:05:54.420 INFO:teuthology.orchestra.run.smithi171.stdout:Package NetworkManager-initscripts-updown-1:1.40.0-1.el8.noarch is already installed. 2022-09-20T20:05:54.420 INFO:teuthology.orchestra.run.smithi171.stdout:Package iproute-5.18.0-1.el8.x86_64 is already installed. 2022-09-20T20:05:54.420 INFO:teuthology.orchestra.run.smithi171.stdout:Package util-linux-2.32.1-38.el8.x86_64 is already installed. 2022-09-20T20:05:54.421 INFO:teuthology.orchestra.run.smithi171.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-09-20T20:05:54.421 INFO:teuthology.orchestra.run.smithi171.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-09-20T20:05:54.421 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2022-09-20T20:05:54.422 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-09-20T20:05:54.509 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2022-09-20T20:05:54.521 INFO:teuthology.orchestra.run.smithi171.stdout:====================================================================================================== 2022-09-20T20:05:54.521 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2022-09-20T20:05:54.522 INFO:teuthology.orchestra.run.smithi171.stdout:====================================================================================================== 2022-09-20T20:05:54.522 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2022-09-20T20:05:54.522 INFO:teuthology.orchestra.run.smithi171.stdout: bison x86_64 3.0.4-10.el8 CentOS-AppStream 688 k 2022-09-20T20:05:54.522 INFO:teuthology.orchestra.run.smithi171.stdout: ceph x86_64 2:17.0.0-15134.gada1013c.el8 ceph 6.4 k 2022-09-20T20:05:54.523 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base x86_64 2:17.0.0-15134.gada1013c.el8 ceph 5.2 M 2022-09-20T20:05:54.523 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse x86_64 2:17.0.0-15134.gada1013c.el8 ceph 843 k 2022-09-20T20:05:54.523 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-15134.gada1013c.el8 ceph 165 k 2022-09-20T20:05:54.523 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr x86_64 2:17.0.0-15134.gada1013c.el8 ceph 1.5 M 2022-09-20T20:05:54.524 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 117 k 2022-09-20T20:05:54.524 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 1.6 M 2022-09-20T20:05:54.524 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 7.4 M 2022-09-20T20:05:54.524 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 47 k 2022-09-20T20:05:54.524 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw x86_64 2:17.0.0-15134.gada1013c.el8 ceph 18 M 2022-09-20T20:05:54.525 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test x86_64 2:17.0.0-15134.gada1013c.el8 ceph 54 M 2022-09-20T20:05:54.525 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 263 k 2022-09-20T20:05:54.525 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 81 k 2022-09-20T20:05:54.525 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror x86_64 2:17.0.0-15134.gada1013c.el8 ceph 257 k 2022-09-20T20:05:54.526 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 15 k 2022-09-20T20:05:54.526 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel x86_64 0.187-4.el8 CentOS-BaseOS 61 k 2022-09-20T20:05:54.526 INFO:teuthology.orchestra.run.smithi171.stdout: flex x86_64 2.6.1-9.el8 CentOS-AppStream 320 k 2022-09-20T20:05:54.526 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 19 k 2022-09-20T20:05:54.527 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel x86_64 2:17.0.0-15134.gada1013c.el8 ceph 30 k 2022-09-20T20:05:54.527 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 766 k 2022-09-20T20:05:54.527 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel x86_64 2:17.0.0-15134.gada1013c.el8 ceph 139 k 2022-09-20T20:05:54.527 INFO:teuthology.orchestra.run.smithi171.stdout: libtool x86_64 2.4.6-25.el8 CentOS-AppStream 709 k 2022-09-20T20:05:54.527 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel x86_64 2.32.1-38.el8 CentOS-BaseOS 99 k 2022-09-20T20:05:54.528 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel x86_64 1:1.1.1k-7.el8 CentOS-BaseOS 2.3 M 2022-09-20T20:05:54.528 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 1.5 M 2022-09-20T20:05:54.528 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-contrib x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 807 k 2022-09-20T20:05:54.528 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-server x86_64 10.19-1.module_el8.6.0+1047+4202cf9a CentOS-AppStream 5.1 M 2022-09-20T20:05:54.529 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs x86_64 2:17.0.0-15134.gada1013c.el8 ceph 190 k 2022-09-20T20:05:54.529 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados x86_64 2:17.0.0-15134.gada1013c.el8 ceph 371 k 2022-09-20T20:05:54.529 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd x86_64 2:17.0.0-15134.gada1013c.el8 ceph 358 k 2022-09-20T20:05:54.529 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw x86_64 2:17.0.0-15134.gada1013c.el8 ceph 106 k 2022-09-20T20:05:54.529 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse x86_64 2:17.0.0-15134.gada1013c.el8 ceph 94 k 2022-09-20T20:05:54.530 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror x86_64 2:17.0.0-15134.gada1013c.el8 ceph 3.5 M 2022-09-20T20:05:54.530 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd x86_64 2:17.0.0-15134.gada1013c.el8 ceph 175 k 2022-09-20T20:05:54.530 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 CentOS-BaseOS 72 k 2022-09-20T20:05:54.530 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading: 2022-09-20T20:05:54.531 INFO:teuthology.orchestra.run.smithi171.stdout: librados2 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 3.6 M 2022-09-20T20:05:54.531 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 3.6 M 2022-09-20T20:05:54.531 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2022-09-20T20:05:54.531 INFO:teuthology.orchestra.run.smithi171.stdout: automake noarch 1.16.1-7.el8 CentOS-AppStream 713 k 2022-09-20T20:05:54.532 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common x86_64 2:17.0.0-15134.gada1013c.el8 ceph 24 M 2022-09-20T20:05:54.532 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 23 k 2022-09-20T20:05:54.532 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds x86_64 2:17.0.0-15134.gada1013c.el8 ceph 2.3 M 2022-09-20T20:05:54.532 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 233 k 2022-09-20T20:05:54.532 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon x86_64 2:17.0.0-15134.gada1013c.el8 ceph 3.9 M 2022-09-20T20:05:54.533 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd x86_64 2:17.0.0-15134.gada1013c.el8 ceph 17 M 2022-09-20T20:05:54.533 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts noarch 2:17.0.0-15134.gada1013c.el8 ceph-noarch 14 k 2022-09-20T20:05:54.533 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux x86_64 2:17.0.0-15134.gada1013c.el8 ceph 24 k 2022-09-20T20:05:54.533 INFO:teuthology.orchestra.run.smithi171.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2022-09-20T20:05:54.534 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-09-20T20:05:54.534 INFO:teuthology.orchestra.run.smithi171.stdout: jq x86_64 1.6-3.el8 CentOS-AppStream 202 k 2022-09-20T20:05:54.534 INFO:teuthology.orchestra.run.smithi171.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 CentOS-BaseOS 48 k 2022-09-20T20:05:54.534 INFO:teuthology.orchestra.run.smithi171.stdout: krb5-devel x86_64 1.18.2-21.el8 CentOS-BaseOS 560 k 2022-09-20T20:05:54.535 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite x86_64 2:17.0.0-15134.gada1013c.el8 ceph 137 k 2022-09-20T20:05:54.535 INFO:teuthology.orchestra.run.smithi171.stdout: libcom_err-devel x86_64 1.45.6-5.el8 CentOS-BaseOS 39 k 2022-09-20T20:05:54.535 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran x86_64 8.5.0-15.el8 CentOS-BaseOS 644 k 2022-09-20T20:05:54.535 INFO:teuthology.orchestra.run.smithi171.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-09-20T20:05:54.535 INFO:teuthology.orchestra.run.smithi171.stdout: libpq x86_64 13.5-1.el8 CentOS-AppStream 198 k 2022-09-20T20:05:54.536 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath x86_64 8.5.0-15.el8 CentOS-BaseOS 172 k 2022-09-20T20:05:54.536 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2022-09-20T20:05:54.536 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 473 k 2022-09-20T20:05:54.536 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-09-20T20:05:54.537 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2 x86_64 2:17.0.0-15134.gada1013c.el8 ceph 6.4 M 2022-09-20T20:05:54.537 INFO:teuthology.orchestra.run.smithi171.stdout: libselinux-devel x86_64 2.9-6.el8 CentOS-BaseOS 200 k 2022-09-20T20:05:54.537 INFO:teuthology.orchestra.run.smithi171.stdout: libsepol-devel x86_64 2.9-3.el8 CentOS-BaseOS 87 k 2022-09-20T20:05:54.537 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-09-20T20:05:54.537 INFO:teuthology.orchestra.run.smithi171.stdout: libverto-devel x86_64 0.3.2-2.el8 CentOS-BaseOS 18 k 2022-09-20T20:05:54.538 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-09-20T20:05:54.538 INFO:teuthology.orchestra.run.smithi171.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-09-20T20:05:54.538 INFO:teuthology.orchestra.run.smithi171.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2022-09-20T20:05:54.538 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2022-09-20T20:05:54.539 INFO:teuthology.orchestra.run.smithi171.stdout: pcre2-devel x86_64 10.32-3.el8 CentOS-BaseOS 605 k 2022-09-20T20:05:54.539 INFO:teuthology.orchestra.run.smithi171.stdout: pcre2-utf16 x86_64 10.32-3.el8 CentOS-BaseOS 229 k 2022-09-20T20:05:54.539 INFO:teuthology.orchestra.run.smithi171.stdout: pcre2-utf32 x86_64 10.32-3.el8 CentOS-BaseOS 220 k 2022-09-20T20:05:54.539 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-09-20T20:05:54.539 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2022-09-20T20:05:54.540 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-09-20T20:05:54.540 INFO:teuthology.orchestra.run.smithi171.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-09-20T20:05:54.540 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-09-20T20:05:54.540 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse x86_64 2:17.0.0-15134.gada1013c.el8 ceph 45 k 2022-09-20T20:05:54.541 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common x86_64 2:17.0.0-15134.gada1013c.el8 ceph 109 k 2022-09-20T20:05:54.541 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-09-20T20:05:54.541 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2022-09-20T20:05:54.541 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-09-20T20:05:54.542 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-09-20T20:05:54.542 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2022-09-20T20:05:54.542 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-09-20T20:05:54.542 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-09-20T20:05:54.543 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-09-20T20:05:54.543 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2022-09-20T20:05:54.543 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2022-09-20T20:05:54.543 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2022-09-20T20:05:54.543 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2022-09-20T20:05:54.544 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-09-20T20:05:54.544 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-09-20T20:05:54.544 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-09-20T20:05:54.544 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-09-20T20:05:54.544 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-09-20T20:05:54.545 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-09-20T20:05:54.545 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2022-09-20T20:05:54.545 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2022-09-20T20:05:54.545 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2022-09-20T20:05:54.546 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-09-20T20:05:54.546 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-09-20T20:05:54.546 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-09-20T20:05:54.546 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-09-20T20:05:54.547 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2022-09-20T20:05:54.547 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2022-09-20T20:05:54.547 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2022-09-20T20:05:54.547 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-09-20T20:05:54.547 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-09-20T20:05:54.548 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2022-09-20T20:05:54.548 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-09-20T20:05:54.548 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-09-20T20:05:54.548 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2022-09-20T20:05:54.549 INFO:teuthology.orchestra.run.smithi171.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-09-20T20:05:54.549 INFO:teuthology.orchestra.run.smithi171.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-09-20T20:05:54.549 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-09-20T20:05:54.549 INFO:teuthology.orchestra.run.smithi171.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-09-20T20:05:54.549 INFO:teuthology.orchestra.run.smithi171.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-09-20T20:05:54.550 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-09-20T20:05:54.550 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-09-20T20:05:54.550 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-09-20T20:05:54.550 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-09-20T20:05:54.551 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-09-20T20:05:54.551 INFO:teuthology.orchestra.run.smithi171.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-09-20T20:05:54.551 INFO:teuthology.orchestra.run.smithi171.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2022-09-20T20:05:54.551 INFO:teuthology.orchestra.run.smithi171.stdout: uuid x86_64 1.6.2-43.el8 CentOS-AppStream 64 k 2022-09-20T20:05:54.551 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-PowerTools 71 k 2022-09-20T20:05:54.552 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel x86_64 1.2.11-20.el8 CentOS-BaseOS 58 k 2022-09-20T20:05:54.552 INFO:teuthology.orchestra.run.smithi171.stdout:Enabling module streams: 2022-09-20T20:05:54.552 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql 10 2022-09-20T20:05:54.552 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:05:54.553 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2022-09-20T20:05:54.553 INFO:teuthology.orchestra.run.smithi171.stdout:====================================================================================================== 2022-09-20T20:05:54.553 INFO:teuthology.orchestra.run.smithi171.stdout:Install 127 Packages 2022-09-20T20:05:54.553 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade 2 Packages 2022-09-20T20:05:54.553 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:05:54.554 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 215 M 2022-09-20T20:05:54.554 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2022-09-20T20:05:54.565 INFO:teuthology.orchestra.run.smithi152.stdout:(1/129): ceph-17.0.0-15134.gada1013c.el8.x86_64 38 kB/s | 6.4 kB 00:00 2022-09-20T20:05:54.722 INFO:teuthology.orchestra.run.smithi171.stdout:(1/129): ceph-17.0.0-15134.gada1013c.el8.x86_64 35 kB/s | 6.4 kB 00:00 2022-09-20T20:05:54.832 INFO:teuthology.orchestra.run.smithi152.stdout:(2/129): ceph-fuse-17.0.0-15134.gada1013c.el8.x 3.1 MB/s | 843 kB 00:00 2022-09-20T20:05:54.891 INFO:teuthology.orchestra.run.smithi152.stdout:(3/129): ceph-immutable-object-cache-17.0.0-151 2.8 MB/s | 165 kB 00:00 2022-09-20T20:05:55.089 INFO:teuthology.orchestra.run.smithi171.stdout:(2/129): ceph-fuse-17.0.0-15134.gada1013c.el8.x 2.2 MB/s | 843 kB 00:00 2022-09-20T20:05:55.189 INFO:teuthology.orchestra.run.smithi171.stdout:(3/129): ceph-immutable-object-cache-17.0.0-151 1.6 MB/s | 165 kB 00:00 2022-09-20T20:05:55.358 INFO:teuthology.orchestra.run.smithi152.stdout:(4/129): ceph-mds-17.0.0-15134.gada1013c.el8.x8 4.9 MB/s | 2.3 MB 00:00 2022-09-20T20:05:55.433 INFO:teuthology.orchestra.run.smithi152.stdout:(5/129): ceph-base-17.0.0-15134.gada1013c.el8.x 5.0 MB/s | 5.2 MB 00:01 2022-09-20T20:05:55.691 INFO:teuthology.orchestra.run.smithi152.stdout:(6/129): ceph-mgr-17.0.0-15134.gada1013c.el8.x8 4.6 MB/s | 1.5 MB 00:00 2022-09-20T20:05:55.890 INFO:teuthology.orchestra.run.smithi171.stdout:(4/129): ceph-mds-17.0.0-15134.gada1013c.el8.x8 3.2 MB/s | 2.3 MB 00:00 2022-09-20T20:05:56.073 INFO:teuthology.orchestra.run.smithi171.stdout:(5/129): ceph-base-17.0.0-15134.gada1013c.el8.x 3.4 MB/s | 5.2 MB 00:01 2022-09-20T20:05:56.142 INFO:teuthology.orchestra.run.smithi152.stdout:(7/129): ceph-mon-17.0.0-15134.gada1013c.el8.x8 5.5 MB/s | 3.9 MB 00:00 2022-09-20T20:05:56.324 INFO:teuthology.orchestra.run.smithi171.stdout:(6/129): ceph-mgr-17.0.0-15134.gada1013c.el8.x8 3.5 MB/s | 1.5 MB 00:00 2022-09-20T20:05:56.782 INFO:teuthology.orchestra.run.smithi171.stdout:(7/129): ceph-mon-17.0.0-15134.gada1013c.el8.x8 5.5 MB/s | 3.9 MB 00:00 2022-09-20T20:05:58.858 INFO:teuthology.orchestra.run.smithi171.stdout:(8/129): ceph-osd-17.0.0-15134.gada1013c.el8.x8 6.6 MB/s | 17 MB 00:02 2022-09-20T20:05:59.058 INFO:teuthology.orchestra.run.smithi171.stdout:(9/129): ceph-radosgw-17.0.0-15134.gada1013c.el 7.9 MB/s | 18 MB 00:02 2022-09-20T20:05:59.075 INFO:teuthology.orchestra.run.smithi171.stdout:(10/129): ceph-selinux-17.0.0-15134.gada1013c.e 112 kB/s | 24 kB 00:00 2022-09-20T20:05:59.142 INFO:teuthology.orchestra.run.smithi171.stdout:(11/129): cephfs-mirror-17.0.0-15134.gada1013c. 3.8 MB/s | 257 kB 00:00 2022-09-20T20:05:59.217 INFO:teuthology.orchestra.run.smithi171.stdout:(12/129): libcephfs-devel-17.0.0-15134.gada1013 407 kB/s | 30 kB 00:00 2022-09-20T20:05:59.384 INFO:teuthology.orchestra.run.smithi171.stdout:(13/129): libcephfs2-17.0.0-15134.gada1013c.el8 4.5 MB/s | 766 kB 00:00 2022-09-20T20:05:59.468 INFO:teuthology.orchestra.run.smithi171.stdout:(14/129): libcephsqlite-17.0.0-15134.gada1013c. 1.6 MB/s | 137 kB 00:00 2022-09-20T20:05:59.535 INFO:teuthology.orchestra.run.smithi171.stdout:(15/129): librados-devel-17.0.0-15134.gada1013c 2.0 MB/s | 139 kB 00:00 2022-09-20T20:05:59.608 INFO:teuthology.orchestra.run.smithi152.stdout:(8/129): ceph-osd-17.0.0-15134.gada1013c.el8.x8 4.3 MB/s | 17 MB 00:03 2022-09-20T20:05:59.641 INFO:teuthology.orchestra.run.smithi171.stdout:(16/129): libradosstriper1-17.0.0-15134.gada101 4.4 MB/s | 473 kB 00:00 2022-09-20T20:05:59.669 INFO:teuthology.orchestra.run.smithi152.stdout:(9/129): ceph-selinux-17.0.0-15134.gada1013c.el 402 kB/s | 24 kB 00:00 2022-09-20T20:06:00.169 INFO:teuthology.orchestra.run.smithi171.stdout:(17/129): ceph-common-17.0.0-15134.gada1013c.el 4.3 MB/s | 24 MB 00:05 2022-09-20T20:06:00.261 INFO:teuthology.orchestra.run.smithi171.stdout:(18/129): python3-ceph-argparse-17.0.0-15134.ga 487 kB/s | 45 kB 00:00 2022-09-20T20:06:00.469 INFO:teuthology.orchestra.run.smithi171.stdout:(19/129): python3-ceph-common-17.0.0-15134.gada 525 kB/s | 109 kB 00:00 2022-09-20T20:06:00.578 INFO:teuthology.orchestra.run.smithi171.stdout:(20/129): librgw2-17.0.0-15134.gada1013c.el8.x8 6.8 MB/s | 6.4 MB 00:00 2022-09-20T20:06:00.612 INFO:teuthology.orchestra.run.smithi171.stdout:(21/129): python3-cephfs-17.0.0-15134.gada1013c 1.3 MB/s | 190 kB 00:00 2022-09-20T20:06:00.671 INFO:teuthology.orchestra.run.smithi171.stdout:(22/129): python3-rados-17.0.0-15134.gada1013c. 3.9 MB/s | 371 kB 00:00 2022-09-20T20:06:00.746 INFO:teuthology.orchestra.run.smithi171.stdout:(23/129): python3-rbd-17.0.0-15134.gada1013c.el 2.6 MB/s | 358 kB 00:00 2022-09-20T20:06:00.763 INFO:teuthology.orchestra.run.smithi171.stdout:(24/129): python3-rgw-17.0.0-15134.gada1013c.el 1.1 MB/s | 106 kB 00:00 2022-09-20T20:06:00.805 INFO:teuthology.orchestra.run.smithi171.stdout:(25/129): rbd-fuse-17.0.0-15134.gada1013c.el8.x 1.6 MB/s | 94 kB 00:00 2022-09-20T20:06:00.889 INFO:teuthology.orchestra.run.smithi171.stdout:(26/129): rbd-nbd-17.0.0-15134.gada1013c.el8.x8 2.1 MB/s | 175 kB 00:00 2022-09-20T20:06:00.944 INFO:teuthology.orchestra.run.smithi152.stdout:(10/129): ceph-common-17.0.0-15134.gada1013c.el 3.7 MB/s | 24 MB 00:06 2022-09-20T20:06:00.973 INFO:teuthology.orchestra.run.smithi171.stdout:(27/129): ceph-grafana-dashboards-17.0.0-15134. 274 kB/s | 23 kB 00:00 2022-09-20T20:06:01.073 INFO:teuthology.orchestra.run.smithi171.stdout:(28/129): ceph-mgr-cephadm-17.0.0-15134.gada101 1.1 MB/s | 117 kB 00:00 2022-09-20T20:06:01.119 INFO:teuthology.orchestra.run.smithi152.stdout:(11/129): cephfs-mirror-17.0.0-15134.gada1013c. 1.4 MB/s | 257 kB 00:00 2022-09-20T20:06:01.203 INFO:teuthology.orchestra.run.smithi152.stdout:(12/129): libcephfs-devel-17.0.0-15134.gada1013 366 kB/s | 30 kB 00:00 2022-09-20T20:06:01.207 INFO:teuthology.orchestra.run.smithi171.stdout:(29/129): rbd-mirror-17.0.0-15134.gada1013c.el8 7.8 MB/s | 3.5 MB 00:00 2022-09-20T20:06:01.519 INFO:teuthology.orchestra.run.smithi152.stdout:(13/129): libcephfs2-17.0.0-15134.gada1013c.el8 2.4 MB/s | 766 kB 00:00 2022-09-20T20:06:01.675 INFO:teuthology.orchestra.run.smithi152.stdout:(14/129): libcephsqlite-17.0.0-15134.gada1013c. 885 kB/s | 137 kB 00:00 2022-09-20T20:06:01.758 INFO:teuthology.orchestra.run.smithi171.stdout:(30/129): ceph-mgr-dashboard-17.0.0-15134.gada1 2.4 MB/s | 1.6 MB 00:00 2022-09-20T20:06:01.811 INFO:teuthology.orchestra.run.smithi152.stdout:(15/129): librados-devel-17.0.0-15134.gada1013c 1.0 MB/s | 139 kB 00:00 2022-09-20T20:06:01.933 INFO:teuthology.orchestra.run.smithi171.stdout:(31/129): ceph-mgr-modules-core-17.0.0-15134.ga 1.3 MB/s | 233 kB 00:00 2022-09-20T20:06:02.058 INFO:teuthology.orchestra.run.smithi171.stdout:(32/129): ceph-mgr-rook-17.0.0-15134.gada1013c. 375 kB/s | 47 kB 00:00 2022-09-20T20:06:02.087 INFO:teuthology.orchestra.run.smithi152.stdout:(16/129): libradosstriper1-17.0.0-15134.gada101 1.7 MB/s | 473 kB 00:00 2022-09-20T20:06:02.192 INFO:teuthology.orchestra.run.smithi171.stdout:(33/129): ceph-mgr-diskprediction-local-17.0.0- 7.5 MB/s | 7.4 MB 00:00 2022-09-20T20:06:02.209 INFO:teuthology.orchestra.run.smithi171.stdout:(34/129): ceph-prometheus-alerts-17.0.0-15134.g 96 kB/s | 14 kB 00:00 2022-09-20T20:06:02.276 INFO:teuthology.orchestra.run.smithi171.stdout:(35/129): ceph-volume-17.0.0-15134.gada1013c.el 3.1 MB/s | 263 kB 00:00 2022-09-20T20:06:02.301 INFO:teuthology.orchestra.run.smithi171.stdout:(36/129): cephadm-17.0.0-15134.gada1013c.el8.no 883 kB/s | 81 kB 00:00 2022-09-20T20:06:02.343 INFO:teuthology.orchestra.run.smithi171.stdout:(37/129): cephfs-top-17.0.0-15134.gada1013c.el8 231 kB/s | 15 kB 00:00 2022-09-20T20:06:02.420 INFO:teuthology.orchestra.run.smithi152.stdout:(17/129): ceph-radosgw-17.0.0-15134.gada1013c.e 2.9 MB/s | 18 MB 00:06 2022-09-20T20:06:02.435 INFO:teuthology.orchestra.run.smithi171.stdout:(38/129): automake-1.16.1-7.el8.noarch.rpm 5.2 MB/s | 713 kB 00:00 2022-09-20T20:06:02.477 INFO:teuthology.orchestra.run.smithi171.stdout:(39/129): bison-3.0.4-10.el8.x86_64.rpm 5.0 MB/s | 688 kB 00:00 2022-09-20T20:06:02.479 INFO:teuthology.orchestra.run.smithi152.stdout:(18/129): python3-ceph-argparse-17.0.0-15134.ga 767 kB/s | 45 kB 00:00 2022-09-20T20:06:02.502 INFO:teuthology.orchestra.run.smithi171.stdout:(40/129): flex-2.6.1-9.el8.x86_64.rpm 4.7 MB/s | 320 kB 00:00 2022-09-20T20:06:02.519 INFO:teuthology.orchestra.run.smithi171.stdout:(41/129): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2022-09-20T20:06:02.553 INFO:teuthology.orchestra.run.smithi171.stdout:(42/129): librdkafka-0.11.4-3.el8.x86_64.rpm 10 MB/s | 354 kB 00:00 2022-09-20T20:06:02.554 INFO:teuthology.orchestra.run.smithi152.stdout:(19/129): python3-ceph-common-17.0.0-15134.gada 1.4 MB/s | 109 kB 00:00 2022-09-20T20:06:02.579 INFO:teuthology.orchestra.run.smithi171.stdout:(43/129): libpq-13.5-1.el8.x86_64.rpm 2.6 MB/s | 198 kB 00:00 2022-09-20T20:06:02.612 INFO:teuthology.orchestra.run.smithi171.stdout:(44/129): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.6 MB/s | 259 kB 00:00 2022-09-20T20:06:02.630 INFO:teuthology.orchestra.run.smithi152.stdout:(20/129): python3-cephfs-17.0.0-15134.gada1013c 2.5 MB/s | 190 kB 00:00 2022-09-20T20:06:02.638 INFO:teuthology.orchestra.run.smithi171.stdout:(45/129): oniguruma-6.8.2-2.el8.x86_64.rpm 7.3 MB/s | 187 kB 00:00 2022-09-20T20:06:02.671 INFO:teuthology.orchestra.run.smithi171.stdout:(46/129): libtool-2.4.6-25.el8.x86_64.rpm 5.9 MB/s | 709 kB 00:00 2022-09-20T20:06:02.738 INFO:teuthology.orchestra.run.smithi152.stdout:(21/129): python3-rados-17.0.0-15134.gada1013c. 3.4 MB/s | 371 kB 00:00 2022-09-20T20:06:02.822 INFO:teuthology.orchestra.run.smithi171.stdout:(47/129): openblas-0.3.15-4.el8.x86_64.rpm 26 MB/s | 4.7 MB 00:00 2022-09-20T20:06:02.863 INFO:teuthology.orchestra.run.smithi152.stdout:(22/129): python3-rbd-17.0.0-15134.gada1013c.el 2.8 MB/s | 358 kB 00:00 2022-09-20T20:06:02.955 INFO:teuthology.orchestra.run.smithi152.stdout:(23/129): python3-rgw-17.0.0-15134.gada1013c.el 1.1 MB/s | 106 kB 00:00 2022-09-20T20:06:02.977 INFO:teuthology.orchestra.run.smithi171.stdout:(48/129): postgresql-10.19-1.module_el8.6.0+104 9.7 MB/s | 1.5 MB 00:00 2022-09-20T20:06:03.022 INFO:teuthology.orchestra.run.smithi152.stdout:(24/129): rbd-fuse-17.0.0-15134.gada1013c.el8.x 1.4 MB/s | 94 kB 00:00 2022-09-20T20:06:03.073 INFO:teuthology.orchestra.run.smithi171.stdout:(49/129): postgresql-contrib-10.19-1.module_el8 8.3 MB/s | 807 kB 00:00 2022-09-20T20:06:03.148 INFO:teuthology.orchestra.run.smithi171.stdout:(50/129): openblas-threads-0.3.15-4.el8.x86_64. 10 MB/s | 4.9 MB 00:00 2022-09-20T20:06:03.439 INFO:teuthology.orchestra.run.smithi152.stdout:(25/129): librgw2-17.0.0-15134.gada1013c.el8.x8 4.7 MB/s | 6.4 MB 00:01 2022-09-20T20:06:03.506 INFO:teuthology.orchestra.run.smithi152.stdout:(26/129): rbd-nbd-17.0.0-15134.gada1013c.el8.x8 2.6 MB/s | 175 kB 00:00 2022-09-20T20:06:03.565 INFO:teuthology.orchestra.run.smithi152.stdout:(27/129): ceph-grafana-dashboards-17.0.0-15134. 394 kB/s | 23 kB 00:00 2022-09-20T20:06:03.640 INFO:teuthology.orchestra.run.smithi152.stdout:(28/129): rbd-mirror-17.0.0-15134.gada1013c.el8 5.6 MB/s | 3.5 MB 00:00 2022-09-20T20:06:03.683 INFO:teuthology.orchestra.run.smithi171.stdout:(51/129): ceph-test-17.0.0-15134.gada1013c.el8. 12 MB/s | 54 MB 00:04 2022-09-20T20:06:03.698 INFO:teuthology.orchestra.run.smithi152.stdout:(29/129): ceph-mgr-cephadm-17.0.0-15134.gada101 875 kB/s | 117 kB 00:00 2022-09-20T20:06:03.796 INFO:teuthology.orchestra.run.smithi171.stdout:(52/129): postgresql-server-10.19-1.module_el8. 7.0 MB/s | 5.1 MB 00:00 2022-09-20T20:06:03.824 INFO:teuthology.orchestra.run.smithi171.stdout:(53/129): python3-jsonpatch-1.21-2.el8.noarch.r 983 kB/s | 27 kB 00:00 2022-09-20T20:06:03.841 INFO:teuthology.orchestra.run.smithi171.stdout:(54/129): python3-jsonpointer-1.10-11.el8.noarc 1.2 MB/s | 20 kB 00:00 2022-09-20T20:06:03.875 INFO:teuthology.orchestra.run.smithi171.stdout:(55/129): python3-jinja2-2.10.1-3.el8.noarch.rp 2.7 MB/s | 538 kB 00:00 2022-09-20T20:06:03.900 INFO:teuthology.orchestra.run.smithi171.stdout:(56/129): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2022-09-20T20:06:03.917 INFO:teuthology.orchestra.run.smithi171.stdout:(57/129): python3-markupsafe-0.23-19.el8.x86_64 924 kB/s | 39 kB 00:00 2022-09-20T20:06:03.924 INFO:teuthology.orchestra.run.smithi152.stdout:(30/129): ceph-mgr-dashboard-17.0.0-15134.gada1 5.8 MB/s | 1.6 MB 00:00 2022-09-20T20:06:03.951 INFO:teuthology.orchestra.run.smithi171.stdout:(58/129): python3-numpy-f2py-1.14.3-10.el8.x86_ 6.6 MB/s | 225 kB 00:00 2022-09-20T20:06:03.968 INFO:teuthology.orchestra.run.smithi171.stdout:(59/129): python3-prettytable-0.7.2-14.el8.noar 2.6 MB/s | 44 kB 00:00 2022-09-20T20:06:03.999 INFO:teuthology.orchestra.run.smithi152.stdout:(31/129): ceph-mgr-modules-core-17.0.0-15134.ga 3.0 MB/s | 233 kB 00:00 2022-09-20T20:06:04.001 INFO:teuthology.orchestra.run.smithi171.stdout:(60/129): python3-pyOpenSSL-19.0.0-1.el8.noarch 3.0 MB/s | 103 kB 00:00 2022-09-20T20:06:04.049 INFO:teuthology.orchestra.run.smithi152.stdout:(32/129): ceph-mgr-rook-17.0.0-15134.gada1013c. 944 kB/s | 47 kB 00:00 2022-09-20T20:06:04.060 INFO:teuthology.orchestra.run.smithi171.stdout:(61/129): python3-babel-2.5.1-7.el8.noarch.rpm 5.3 MB/s | 4.8 MB 00:00 2022-09-20T20:06:04.086 INFO:teuthology.orchestra.run.smithi171.stdout:(62/129): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.5 MB/s | 126 kB 00:00 2022-09-20T20:06:04.091 INFO:teuthology.orchestra.run.smithi152.stdout:(33/129): ceph-prometheus-alerts-17.0.0-15134.g 347 kB/s | 14 kB 00:00 2022-09-20T20:06:04.111 INFO:teuthology.orchestra.run.smithi171.stdout:(63/129): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2022-09-20T20:06:04.136 INFO:teuthology.orchestra.run.smithi171.stdout:(64/129): python3-pytz-2017.2-9.el8.noarch.rpm 1.0 MB/s | 54 kB 00:00 2022-09-20T20:06:04.166 INFO:teuthology.orchestra.run.smithi152.stdout:(34/129): ceph-volume-17.0.0-15134.gada1013c.el 3.4 MB/s | 263 kB 00:00 2022-09-20T20:06:04.212 INFO:teuthology.orchestra.run.smithi171.stdout:(65/129): python3-numpy-1.14.3-10.el8.x86_64.rp 12 MB/s | 3.7 MB 00:00 2022-09-20T20:06:04.217 INFO:teuthology.orchestra.run.smithi152.stdout:(35/129): cephadm-17.0.0-15134.gada1013c.el8.no 1.6 MB/s | 81 kB 00:00 2022-09-20T20:06:04.237 INFO:teuthology.orchestra.run.smithi171.stdout:(66/129): python3-werkzeug-0.12.2-4.el8.noarch. 4.5 MB/s | 457 kB 00:00 2022-09-20T20:06:04.259 INFO:teuthology.orchestra.run.smithi152.stdout:(36/129): cephfs-top-17.0.0-15134.gada1013c.el8 371 kB/s | 15 kB 00:00 2022-09-20T20:06:04.270 INFO:teuthology.orchestra.run.smithi171.stdout:(67/129): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2022-09-20T20:06:04.338 INFO:teuthology.orchestra.run.smithi171.stdout:(68/129): elfutils-libelf-devel-0.187-4.el8.x86 914 kB/s | 61 kB 00:00 2022-09-20T20:06:04.350 INFO:teuthology.orchestra.run.smithi152.stdout:(37/129): automake-1.16.1-7.el8.noarch.rpm 7.6 MB/s | 713 kB 00:00 2022-09-20T20:06:04.363 INFO:teuthology.orchestra.run.smithi171.stdout:(69/129): uuid-1.6.2-43.el8.x86_64.rpm 509 kB/s | 64 kB 00:00 2022-09-20T20:06:04.384 INFO:teuthology.orchestra.run.smithi152.stdout:(38/129): bison-3.0.4-10.el8.x86_64.rpm 20 MB/s | 688 kB 00:00 2022-09-20T20:06:04.388 INFO:teuthology.orchestra.run.smithi171.stdout:(70/129): fuse-2.9.7-16.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2022-09-20T20:06:04.413 INFO:teuthology.orchestra.run.smithi171.stdout:(71/129): keyutils-libs-devel-1.5.10-9.el8.x86_ 953 kB/s | 48 kB 00:00 2022-09-20T20:06:04.418 INFO:teuthology.orchestra.run.smithi152.stdout:(39/129): flex-2.6.1-9.el8.x86_64.rpm 9.3 MB/s | 320 kB 00:00 2022-09-20T20:06:04.477 INFO:teuthology.orchestra.run.smithi152.stdout:(40/129): jq-1.6-3.el8.x86_64.rpm 3.4 MB/s | 202 kB 00:00 2022-09-20T20:06:04.480 INFO:teuthology.orchestra.run.smithi171.stdout:(72/129): krb5-devel-1.18.2-21.el8.x86_64.rpm 6.0 MB/s | 560 kB 00:00 2022-09-20T20:06:04.502 INFO:teuthology.orchestra.run.smithi152.stdout:(41/129): libpq-13.5-1.el8.x86_64.rpm 7.7 MB/s | 198 kB 00:00 2022-09-20T20:06:04.506 INFO:teuthology.orchestra.run.smithi171.stdout:(73/129): libaio-devel-0.3.112-1.el8.x86_64.rpm 202 kB/s | 19 kB 00:00 2022-09-20T20:06:04.532 INFO:teuthology.orchestra.run.smithi171.stdout:(74/129): libcom_err-devel-1.45.6-5.el8.x86_64. 763 kB/s | 39 kB 00:00 2022-09-20T20:06:04.535 INFO:teuthology.orchestra.run.smithi152.stdout:(42/129): librdkafka-0.11.4-3.el8.x86_64.rpm 10 MB/s | 354 kB 00:00 2022-09-20T20:06:04.565 INFO:teuthology.orchestra.run.smithi171.stdout:(75/129): libquadmath-8.5.0-15.el8.x86_64.rpm 5.0 MB/s | 172 kB 00:00 2022-09-20T20:06:04.569 INFO:teuthology.orchestra.run.smithi152.stdout:(43/129): libtool-2.4.6-25.el8.x86_64.rpm 21 MB/s | 709 kB 00:00 2022-09-20T20:06:04.590 INFO:teuthology.orchestra.run.smithi171.stdout:(76/129): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2022-09-20T20:06:04.595 INFO:teuthology.orchestra.run.smithi152.stdout:(44/129): lttng-ust-2.8.1-11.el8.x86_64.rpm 10 MB/s | 259 kB 00:00 2022-09-20T20:06:04.628 INFO:teuthology.orchestra.run.smithi152.stdout:(45/129): oniguruma-6.8.2-2.el8.x86_64.rpm 5.5 MB/s | 187 kB 00:00 2022-09-20T20:06:04.666 INFO:teuthology.orchestra.run.smithi171.stdout:(77/129): libgfortran-8.5.0-15.el8.x86_64.rpm 4.0 MB/s | 644 kB 00:00 2022-09-20T20:06:04.691 INFO:teuthology.orchestra.run.smithi171.stdout:(78/129): libselinux-devel-2.9-6.el8.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2022-09-20T20:06:04.716 INFO:teuthology.orchestra.run.smithi171.stdout:(79/129): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2022-09-20T20:06:04.745 INFO:teuthology.orchestra.run.smithi152.stdout:(46/129): openblas-0.3.15-4.el8.x86_64.rpm 41 MB/s | 4.7 MB 00:00 2022-09-20T20:06:04.759 INFO:teuthology.orchestra.run.smithi171.stdout:(80/129): libverto-devel-0.3.2-2.el8.x86_64.rpm 432 kB/s | 18 kB 00:00 2022-09-20T20:06:04.784 INFO:teuthology.orchestra.run.smithi171.stdout:(81/129): libuuid-devel-2.32.1-38.el8.x86_64.rp 1.0 MB/s | 99 kB 00:00 2022-09-20T20:06:04.896 INFO:teuthology.orchestra.run.smithi152.stdout:(47/129): openblas-threads-0.3.15-4.el8.x86_64. 32 MB/s | 4.9 MB 00:00 2022-09-20T20:06:04.943 INFO:teuthology.orchestra.run.smithi171.stdout:(82/129): python3-scipy-1.0.0-21.module_el8.5.0 16 MB/s | 14 MB 00:00 2022-09-20T20:06:04.946 INFO:teuthology.orchestra.run.smithi152.stdout:(48/129): postgresql-10.19-1.module_el8.6.0+104 30 MB/s | 1.5 MB 00:00 2022-09-20T20:06:04.977 INFO:teuthology.orchestra.run.smithi171.stdout:(83/129): pcre2-devel-10.32-3.el8.x86_64.rpm 3.1 MB/s | 605 kB 00:00 2022-09-20T20:06:04.980 INFO:teuthology.orchestra.run.smithi152.stdout:(49/129): postgresql-contrib-10.19-1.module_el8 24 MB/s | 807 kB 00:00 2022-09-20T20:06:05.002 INFO:teuthology.orchestra.run.smithi171.stdout:(84/129): pcre2-utf16-10.32-3.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2022-09-20T20:06:05.027 INFO:teuthology.orchestra.run.smithi171.stdout:(85/129): pcre2-utf32-10.32-3.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2022-09-20T20:06:05.052 INFO:teuthology.orchestra.run.smithi171.stdout:(86/129): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.6 MB/s | 237 kB 00:00 2022-09-20T20:06:05.069 INFO:teuthology.orchestra.run.smithi171.stdout:(87/129): python3-jwt-1.6.1-2.el8.noarch.rpm 2.5 MB/s | 43 kB 00:00 2022-09-20T20:06:05.071 INFO:teuthology.orchestra.run.smithi152.stdout:(50/129): ceph-mgr-diskprediction-local-17.0.0- 5.4 MB/s | 7.4 MB 00:01 2022-09-20T20:06:05.103 INFO:teuthology.orchestra.run.smithi171.stdout:(88/129): python3-oauthlib-2.1.0-1.el8.noarch.r 4.5 MB/s | 155 kB 00:00 2022-09-20T20:06:05.128 INFO:teuthology.orchestra.run.smithi171.stdout:(89/129): python3-cryptography-3.2.1-5.el8.x86_ 5.4 MB/s | 559 kB 00:00 2022-09-20T20:06:05.145 INFO:teuthology.orchestra.run.smithi171.stdout:(90/129): python3-pycparser-2.14-14.el8.noarch. 2.5 MB/s | 109 kB 00:00 2022-09-20T20:06:05.171 INFO:teuthology.orchestra.run.smithi171.stdout:(91/129): python3-requests-oauthlib-1.0.0-1.el8 1.0 MB/s | 43 kB 00:00 2022-09-20T20:06:05.172 INFO:teuthology.orchestra.run.smithi152.stdout:(51/129): postgresql-server-10.19-1.module_el8. 26 MB/s | 5.1 MB 00:00 2022-09-20T20:06:05.196 INFO:teuthology.orchestra.run.smithi171.stdout:(92/129): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2022-09-20T20:06:05.222 INFO:teuthology.orchestra.run.smithi171.stdout:(93/129): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 71 kB 00:00 2022-09-20T20:06:05.230 INFO:teuthology.orchestra.run.smithi152.stdout:(52/129): python3-jinja2-2.10.1-3.el8.noarch.rp 9.0 MB/s | 538 kB 00:00 2022-09-20T20:06:05.247 INFO:teuthology.orchestra.run.smithi171.stdout:(94/129): zlib-devel-1.2.11-20.el8.x86_64.rpm 763 kB/s | 58 kB 00:00 2022-09-20T20:06:05.255 INFO:teuthology.orchestra.run.smithi152.stdout:(53/129): python3-jsonpatch-1.21-2.el8.noarch.r 1.0 MB/s | 27 kB 00:00 2022-09-20T20:06:05.281 INFO:teuthology.orchestra.run.smithi152.stdout:(54/129): python3-jsonpointer-1.10-11.el8.noarc 799 kB/s | 20 kB 00:00 2022-09-20T20:06:05.297 INFO:teuthology.orchestra.run.smithi171.stdout:(95/129): openssl-devel-1.1.1k-7.el8.x86_64.rpm 4.3 MB/s | 2.3 MB 00:00 2022-09-20T20:06:05.314 INFO:teuthology.orchestra.run.smithi152.stdout:(55/129): python3-mako-1.0.6-13.el8.noarch.rpm 4.6 MB/s | 157 kB 00:00 2022-09-20T20:06:05.340 INFO:teuthology.orchestra.run.smithi152.stdout:(56/129): python3-markupsafe-0.23-19.el8.x86_64 1.5 MB/s | 39 kB 00:00 2022-09-20T20:06:05.398 INFO:teuthology.orchestra.run.smithi171.stdout:(96/129): liboath-2.6.2-3.el8.x86_64.rpm 391 kB/s | 59 kB 00:00 2022-09-20T20:06:05.432 INFO:teuthology.orchestra.run.smithi171.stdout:(97/129): libunwind-1.3.1-3.el8.x86_64.rpm 561 kB/s | 75 kB 00:00 2022-09-20T20:06:05.440 INFO:teuthology.orchestra.run.smithi152.stdout:(57/129): python3-numpy-1.14.3-10.el8.x86_64.rp 37 MB/s | 3.7 MB 00:00 2022-09-20T20:06:05.473 INFO:teuthology.orchestra.run.smithi152.stdout:(58/129): python3-numpy-f2py-1.14.3-10.el8.x86_ 6.6 MB/s | 225 kB 00:00 2022-09-20T20:06:05.482 INFO:teuthology.orchestra.run.smithi171.stdout:(98/129): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2022-09-20T20:06:05.498 INFO:teuthology.orchestra.run.smithi152.stdout:(59/129): python3-prettytable-0.7.2-14.el8.noar 1.7 MB/s | 44 kB 00:00 2022-09-20T20:06:05.507 INFO:teuthology.orchestra.run.smithi171.stdout:(99/129): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 578 kB/s | 44 kB 00:00 2022-09-20T20:06:05.524 INFO:teuthology.orchestra.run.smithi152.stdout:(60/129): python3-pyOpenSSL-19.0.0-1.el8.noarch 4.0 MB/s | 103 kB 00:00 2022-09-20T20:06:05.524 INFO:teuthology.orchestra.run.smithi171.stdout:(100/129): python3-beautifulsoup4-4.6.3-2.el8.1 4.3 MB/s | 185 kB 00:00 2022-09-20T20:06:05.549 INFO:teuthology.orchestra.run.smithi152.stdout:(61/129): python3-pyasn1-0.3.7-6.el8.noarch.rpm 4.9 MB/s | 126 kB 00:00 2022-09-20T20:06:05.558 INFO:teuthology.orchestra.run.smithi171.stdout:(101/129): python3-asyncssh-2.7.0-2.el8.noarch. 2.9 MB/s | 476 kB 00:00 2022-09-20T20:06:05.584 INFO:teuthology.orchestra.run.smithi171.stdout:(102/129): python3-cachetools-3.1.1-4.el8.noarc 434 kB/s | 33 kB 00:00 2022-09-20T20:06:05.608 INFO:teuthology.orchestra.run.smithi171.stdout:(103/129): python3-certifi-2018.10.15-7.el8.noa 194 kB/s | 16 kB 00:00 2022-09-20T20:06:05.616 INFO:teuthology.orchestra.run.smithi152.stdout:(62/129): python3-babel-2.5.1-7.el8.noarch.rpm 8.8 MB/s | 4.8 MB 00:00 2022-09-20T20:06:05.626 INFO:teuthology.orchestra.run.smithi171.stdout:(104/129): python3-cheroot-8.5.2-1.el8.noarch.r 2.5 MB/s | 173 kB 00:00 2022-09-20T20:06:05.641 INFO:teuthology.orchestra.run.smithi152.stdout:(63/129): python3-pyasn1-modules-0.3.7-6.el8.no 1.2 MB/s | 110 kB 00:00 2022-09-20T20:06:05.659 INFO:teuthology.orchestra.run.smithi171.stdout:(105/129): python3-google-auth-1.1.1-10.el8.noa 1.6 MB/s | 81 kB 00:00 2022-09-20T20:06:05.667 INFO:teuthology.orchestra.run.smithi152.stdout:(64/129): python3-pytz-2017.2-9.el8.noarch.rpm 1.0 MB/s | 54 kB 00:00 2022-09-20T20:06:05.684 INFO:teuthology.orchestra.run.smithi171.stdout:(106/129): python3-jaraco-6.2-6.el8.noarch.rpm 189 kB/s | 11 kB 00:00 2022-09-20T20:06:05.710 INFO:teuthology.orchestra.run.smithi171.stdout:(107/129): python3-cherrypy-18.4.0-1.el8.noarch 3.7 MB/s | 384 kB 00:00 2022-09-20T20:06:05.717 INFO:teuthology.orchestra.run.smithi152.stdout:(65/129): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2022-09-20T20:06:05.735 INFO:teuthology.orchestra.run.smithi171.stdout:(108/129): python3-jaraco-functools-2.0-4.el8.n 232 kB/s | 18 kB 00:00 2022-09-20T20:06:05.761 INFO:teuthology.orchestra.run.smithi171.stdout:(109/129): python3-logutils-0.3.5-11.el8.noarch 967 kB/s | 49 kB 00:00 2022-09-20T20:06:05.767 INFO:teuthology.orchestra.run.smithi152.stdout:(66/129): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2022-09-20T20:06:05.786 INFO:teuthology.orchestra.run.smithi171.stdout:(110/129): python3-more-itertools-7.2.0-3.el8.n 1.1 MB/s | 59 kB 00:00 2022-09-20T20:06:05.793 INFO:teuthology.orchestra.run.smithi152.stdout:(67/129): uuid-1.6.2-43.el8.x86_64.rpm 2.5 MB/s | 64 kB 00:00 2022-09-20T20:06:05.811 INFO:teuthology.orchestra.run.smithi171.stdout:(111/129): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2022-09-20T20:06:05.818 INFO:teuthology.orchestra.run.smithi152.stdout:(68/129): elfutils-libelf-devel-0.187-4.el8.x86 2.4 MB/s | 61 kB 00:00 2022-09-20T20:06:05.837 INFO:teuthology.orchestra.run.smithi171.stdout:(112/129): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2022-09-20T20:06:05.843 INFO:teuthology.orchestra.run.smithi152.stdout:(69/129): fuse-2.9.7-16.el8.x86_64.rpm 3.3 MB/s | 83 kB 00:00 2022-09-20T20:06:05.862 INFO:teuthology.orchestra.run.smithi171.stdout:(113/129): python3-portend-2.6-1.el8.noarch.rpm 308 kB/s | 16 kB 00:00 2022-09-20T20:06:05.868 INFO:teuthology.orchestra.run.smithi152.stdout:(70/129): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.9 MB/s | 48 kB 00:00 2022-09-20T20:06:05.896 INFO:teuthology.orchestra.run.smithi171.stdout:(114/129): python3-kubernetes-11.0.0-6.el8.noar 5.5 MB/s | 1.2 MB 00:00 2022-09-20T20:06:05.921 INFO:teuthology.orchestra.run.smithi171.stdout:(115/129): python3-repoze-lru-0.7-6.el8.noarch. 400 kB/s | 34 kB 00:00 2022-09-20T20:06:05.927 INFO:teuthology.orchestra.run.smithi152.stdout:(71/129): krb5-devel-1.18.2-21.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2022-09-20T20:06:05.946 INFO:teuthology.orchestra.run.smithi171.stdout:(116/129): python3-routes-2.4.1-12.el8.noarch.r 2.3 MB/s | 196 kB 00:00 2022-09-20T20:06:05.964 INFO:teuthology.orchestra.run.smithi171.stdout:(117/129): python3-rsa-4.8-1.el8.noarch.rpm 913 kB/s | 61 kB 00:00 2022-09-20T20:06:05.980 INFO:teuthology.orchestra.run.smithi171.stdout:(118/129): python3-simplegeneric-0.8.1-17.el8.n 317 kB/s | 19 kB 00:00 2022-09-20T20:06:06.006 INFO:teuthology.orchestra.run.smithi171.stdout:(119/129): python3-singledispatch-3.4.0.3-18.el 404 kB/s | 24 kB 00:00 2022-09-20T20:06:06.031 INFO:teuthology.orchestra.run.smithi171.stdout:(120/129): python3-tempora-1.14.1-5.el8.noarch. 432 kB/s | 29 kB 00:00 2022-09-20T20:06:06.056 INFO:teuthology.orchestra.run.smithi171.stdout:(121/129): python3-trustme-0.6.0-4.el8.noarch.r 362 kB/s | 27 kB 00:00 2022-09-20T20:06:06.082 INFO:teuthology.orchestra.run.smithi171.stdout:(122/129): python3-waitress-1.2.1-2.el8.1.noarc 3.1 MB/s | 241 kB 00:00 2022-09-20T20:06:06.136 INFO:teuthology.orchestra.run.smithi171.stdout:(123/129): python3-webob-1.8.5-1.el8.1.noarch.r 3.2 MB/s | 251 kB 00:00 2022-09-20T20:06:06.136 INFO:teuthology.orchestra.run.smithi171.stdout:(124/129): python3-websocket-client-0.56.0-5.el 807 kB/s | 61 kB 00:00 2022-09-20T20:06:06.137 INFO:teuthology.orchestra.run.smithi152.stdout:(72/129): python3-scipy-1.0.0-21.module_el8.5.0 31 MB/s | 14 MB 00:00 2022-09-20T20:06:06.137 INFO:teuthology.orchestra.run.smithi152.stdout:(73/129): libaio-devel-0.3.112-1.el8.x86_64.rpm 106 kB/s | 19 kB 00:00 2022-09-20T20:06:06.137 INFO:teuthology.orchestra.run.smithi152.stdout:(74/129): libcom_err-devel-1.45.6-5.el8.x86_64. 1.1 MB/s | 39 kB 00:00 2022-09-20T20:06:06.145 INFO:teuthology.orchestra.run.smithi152.stdout:(75/129): libquadmath-8.5.0-15.el8.x86_64.rpm 6.7 MB/s | 172 kB 00:00 2022-09-20T20:06:06.158 INFO:teuthology.orchestra.run.smithi171.stdout:(125/129): python3-webtest-2.0.33-1.el8.noarch. 1.1 MB/s | 85 kB 00:00 2022-09-20T20:06:06.162 INFO:teuthology.orchestra.run.smithi152.stdout:(76/129): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.7 MB/s | 47 kB 00:00 2022-09-20T20:06:06.183 INFO:teuthology.orchestra.run.smithi171.stdout:(126/129): python3-zc-lockfile-2.0-2.el8.noarch 303 kB/s | 23 kB 00:00 2022-09-20T20:06:06.187 INFO:teuthology.orchestra.run.smithi152.stdout:(77/129): libselinux-devel-2.9-6.el8.x86_64.rpm 7.8 MB/s | 200 kB 00:00 2022-09-20T20:06:06.213 INFO:teuthology.orchestra.run.smithi152.stdout:(78/129): libgfortran-8.5.0-15.el8.x86_64.rpm 5.8 MB/s | 644 kB 00:00 2022-09-20T20:06:06.238 INFO:teuthology.orchestra.run.smithi152.stdout:(79/129): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2022-09-20T20:06:06.263 INFO:teuthology.orchestra.run.smithi152.stdout:(80/129): libuuid-devel-2.32.1-38.el8.x86_64.rp 1.9 MB/s | 99 kB 00:00 2022-09-20T20:06:06.288 INFO:teuthology.orchestra.run.smithi152.stdout:(81/129): libverto-devel-0.3.2-2.el8.x86_64.rpm 360 kB/s | 18 kB 00:00 2022-09-20T20:06:06.330 INFO:teuthology.orchestra.run.smithi152.stdout:(82/129): pcre2-devel-10.32-3.el8.x86_64.rpm 14 MB/s | 605 kB 00:00 2022-09-20T20:06:06.355 INFO:teuthology.orchestra.run.smithi152.stdout:(83/129): pcre2-utf16-10.32-3.el8.x86_64.rpm 9.0 MB/s | 229 kB 00:00 2022-09-20T20:06:06.372 INFO:teuthology.orchestra.run.smithi152.stdout:(84/129): pcre2-utf32-10.32-3.el8.x86_64.rpm 13 MB/s | 220 kB 00:00 2022-09-20T20:06:06.398 INFO:teuthology.orchestra.run.smithi152.stdout:(85/129): python3-cffi-1.11.5-5.el8.x86_64.rpm 9.3 MB/s | 237 kB 00:00 2022-09-20T20:06:06.425 INFO:teuthology.orchestra.run.smithi171.stdout:(127/129): thrift-0.13.0-2.el8.x86_64.rpm 5.9 MB/s | 1.7 MB 00:00 2022-09-20T20:06:06.431 INFO:teuthology.orchestra.run.smithi152.stdout:(86/129): python3-cryptography-3.2.1-5.el8.x86_ 16 MB/s | 559 kB 00:00 2022-09-20T20:06:06.457 INFO:teuthology.orchestra.run.smithi152.stdout:(87/129): python3-jwt-1.6.1-2.el8.noarch.rpm 1.7 MB/s | 43 kB 00:00 2022-09-20T20:06:06.473 INFO:teuthology.orchestra.run.smithi152.stdout:(88/129): python3-oauthlib-2.1.0-1.el8.noarch.r 9.2 MB/s | 155 kB 00:00 2022-09-20T20:06:06.490 INFO:teuthology.orchestra.run.smithi152.stdout:(89/129): python3-pycparser-2.14-14.el8.noarch. 6.3 MB/s | 109 kB 00:00 2022-09-20T20:06:06.516 INFO:teuthology.orchestra.run.smithi152.stdout:(90/129): python3-requests-oauthlib-1.0.0-1.el8 1.7 MB/s | 43 kB 00:00 2022-09-20T20:06:06.541 INFO:teuthology.orchestra.run.smithi152.stdout:(91/129): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 2.8 MB/s | 72 kB 00:00 2022-09-20T20:06:06.583 INFO:teuthology.orchestra.run.smithi152.stdout:(92/129): openssl-devel-1.1.1k-7.el8.x86_64.rpm 7.3 MB/s | 2.3 MB 00:00 2022-09-20T20:06:06.608 INFO:teuthology.orchestra.run.smithi152.stdout:(93/129): zlib-devel-1.2.11-20.el8.x86_64.rpm 864 kB/s | 58 kB 00:00 2022-09-20T20:06:06.626 INFO:teuthology.orchestra.run.smithi171.stdout:(128/129): librbd1-17.0.0-15134.gada1013c.el8.x 8.1 MB/s | 3.6 MB 00:00 2022-09-20T20:06:06.633 INFO:teuthology.orchestra.run.smithi152.stdout:(94/129): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2022-09-20T20:06:06.676 INFO:teuthology.orchestra.run.smithi171.stdout:(129/129): librados2-17.0.0-15134.gada1013c.el8 7.0 MB/s | 3.6 MB 00:00 2022-09-20T20:06:06.679 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2022-09-20T20:06:06.680 INFO:teuthology.orchestra.run.smithi171.stdout:Total 18 MB/s | 215 MB 00:12 2022-09-20T20:06:06.851 INFO:teuthology.orchestra.run.smithi152.stdout:(95/129): liboath-2.6.2-3.el8.x86_64.rpm 271 kB/s | 59 kB 00:00 2022-09-20T20:06:06.876 INFO:teuthology.orchestra.run.smithi152.stdout:(96/129): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2022-09-20T20:06:06.935 INFO:teuthology.orchestra.run.smithi152.stdout:(97/129): libunwind-1.3.1-3.el8.x86_64.rpm 898 kB/s | 75 kB 00:00 2022-09-20T20:06:06.985 INFO:teuthology.orchestra.run.smithi152.stdout:(98/129): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 872 kB/s | 44 kB 00:00 2022-09-20T20:06:07.019 INFO:teuthology.orchestra.run.smithi152.stdout:(99/129): python3-asyncssh-2.7.0-2.el8.noarch.r 3.3 MB/s | 476 kB 00:00 2022-09-20T20:06:07.069 INFO:teuthology.orchestra.run.smithi152.stdout:(100/129): python3-cachetools-3.1.1-4.el8.noarc 660 kB/s | 33 kB 00:00 2022-09-20T20:06:07.094 INFO:teuthology.orchestra.run.smithi152.stdout:(101/129): python3-beautifulsoup4-4.6.3-2.el8.1 1.7 MB/s | 185 kB 00:00 2022-09-20T20:06:07.119 INFO:teuthology.orchestra.run.smithi152.stdout:(102/129): python3-certifi-2018.10.15-7.el8.noa 324 kB/s | 16 kB 00:00 2022-09-20T20:06:07.170 INFO:teuthology.orchestra.run.smithi152.stdout:(103/129): python3-cheroot-8.5.2-1.el8.noarch.r 2.2 MB/s | 173 kB 00:00 2022-09-20T20:06:07.220 INFO:teuthology.orchestra.run.smithi152.stdout:(104/129): python3-google-auth-1.1.1-10.el8.noa 1.6 MB/s | 81 kB 00:00 2022-09-20T20:06:07.245 INFO:teuthology.orchestra.run.smithi152.stdout:(105/129): python3-cherrypy-18.4.0-1.el8.noarch 3.0 MB/s | 384 kB 00:00 2022-09-20T20:06:07.262 INFO:teuthology.orchestra.run.smithi152.stdout:(106/129): python3-jaraco-6.2-6.el8.noarch.rpm 266 kB/s | 11 kB 00:00 2022-09-20T20:06:07.288 INFO:teuthology.orchestra.run.smithi152.stdout:(107/129): python3-jaraco-functools-2.0-4.el8.n 419 kB/s | 18 kB 00:00 2022-09-20T20:06:07.330 INFO:teuthology.orchestra.run.smithi152.stdout:(108/129): python3-logutils-0.3.5-11.el8.noarch 1.1 MB/s | 49 kB 00:00 2022-09-20T20:06:07.371 INFO:teuthology.orchestra.run.smithi152.stdout:(109/129): python3-more-itertools-7.2.0-3.el8.n 1.4 MB/s | 59 kB 00:00 2022-09-20T20:06:07.422 INFO:teuthology.orchestra.run.smithi152.stdout:(110/129): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2022-09-20T20:06:07.437 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2022-09-20T20:06:07.497 INFO:teuthology.orchestra.run.smithi152.stdout:(111/129): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2022-09-20T20:06:07.548 INFO:teuthology.orchestra.run.smithi152.stdout:(112/129): python3-portend-2.6-1.el8.noarch.rpm 312 kB/s | 16 kB 00:00 2022-09-20T20:06:07.562 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2022-09-20T20:06:07.563 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2022-09-20T20:06:07.589 INFO:teuthology.orchestra.run.smithi152.stdout:(113/129): python3-repoze-lru-0.7-6.el8.noarch. 812 kB/s | 34 kB 00:00 2022-09-20T20:06:07.664 INFO:teuthology.orchestra.run.smithi152.stdout:(114/129): python3-routes-2.4.1-12.el8.noarch.r 2.6 MB/s | 196 kB 00:00 2022-09-20T20:06:07.690 INFO:teuthology.orchestra.run.smithi152.stdout:(115/129): python3-kubernetes-11.0.0-6.el8.noar 2.7 MB/s | 1.2 MB 00:00 2022-09-20T20:06:07.706 INFO:teuthology.orchestra.run.smithi152.stdout:(116/129): python3-rsa-4.8-1.el8.noarch.rpm 1.4 MB/s | 61 kB 00:00 2022-09-20T20:06:08.207 INFO:teuthology.orchestra.run.smithi152.stdout:(117/129): ceph-test-17.0.0-15134.gada1013c.el8 6.4 MB/s | 54 MB 00:08 2022-09-20T20:06:08.224 INFO:teuthology.orchestra.run.smithi152.stdout:(118/129): python3-simplegeneric-0.8.1-17.el8.n 35 kB/s | 19 kB 00:00 2022-09-20T20:06:08.241 INFO:teuthology.orchestra.run.smithi152.stdout:(119/129): python3-singledispatch-3.4.0.3-18.el 45 kB/s | 24 kB 00:00 2022-09-20T20:06:08.308 INFO:teuthology.orchestra.run.smithi152.stdout:(120/129): python3-trustme-0.6.0-4.el8.noarch.r 414 kB/s | 27 kB 00:00 2022-09-20T20:06:08.333 INFO:teuthology.orchestra.run.smithi152.stdout:(121/129): python3-tempora-1.14.1-5.el8.noarch. 234 kB/s | 29 kB 00:00 2022-09-20T20:06:08.383 INFO:teuthology.orchestra.run.smithi152.stdout:(122/129): python3-waitress-1.2.1-2.el8.1.noarc 1.7 MB/s | 241 kB 00:00 2022-09-20T20:06:08.409 INFO:teuthology.orchestra.run.smithi152.stdout:(123/129): python3-websocket-client-0.56.0-5.el 813 kB/s | 61 kB 00:00 2022-09-20T20:06:08.434 INFO:teuthology.orchestra.run.smithi152.stdout:(124/129): python3-webob-1.8.5-1.el8.1.noarch.r 2.0 MB/s | 251 kB 00:00 2022-09-20T20:06:08.459 INFO:teuthology.orchestra.run.smithi152.stdout:(125/129): python3-webtest-2.0.33-1.el8.noarch. 1.1 MB/s | 85 kB 00:00 2022-09-20T20:06:08.484 INFO:teuthology.orchestra.run.smithi152.stdout:(126/129): python3-zc-lockfile-2.0-2.el8.noarch 305 kB/s | 23 kB 00:00 2022-09-20T20:06:08.810 INFO:teuthology.orchestra.run.smithi152.stdout:(127/129): librados2-17.0.0-15134.gada1013c.el8 10 MB/s | 3.6 MB 00:00 2022-09-20T20:06:08.859 INFO:teuthology.orchestra.run.smithi152.stdout:(128/129): thrift-0.13.0-2.el8.x86_64.rpm 4.1 MB/s | 1.7 MB 00:00 2022-09-20T20:06:09.087 INFO:teuthology.orchestra.run.smithi152.stdout:(129/129): librbd1-17.0.0-15134.gada1013c.el8.x 5.9 MB/s | 3.6 MB 00:00 2022-09-20T20:06:09.092 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2022-09-20T20:06:09.092 INFO:teuthology.orchestra.run.smithi152.stdout:Total 15 MB/s | 215 MB 00:14 2022-09-20T20:06:09.192 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2022-09-20T20:06:09.195 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2022-09-20T20:06:09.862 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2022-09-20T20:06:09.988 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2022-09-20T20:06:09.989 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2022-09-20T20:06:11.516 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2022-09-20T20:06:11.519 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2022-09-20T20:06:14.325 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2022-09-20T20:06:14.517 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/131 2022-09-20T20:06:14.773 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/131 2022-09-20T20:06:14.971 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/131 2022-09-20T20:06:15.144 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/131 2022-09-20T20:06:15.533 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/131 2022-09-20T20:06:15.736 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librados2-2:17.0.0-15134.gada1013c.el8.x86_64 5/131 2022-09-20T20:06:16.114 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:17.0.0-15134.gada1013c.el8.x86_64 5/131 2022-09-20T20:06:16.294 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librbd1-2:17.0.0-15134.gada1013c.el8.x86_64 6/131 2022-09-20T20:06:16.420 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:17.0.0-15134.gada1013c.el8.x86_64 6/131 2022-09-20T20:06:16.610 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs2-2:17.0.0-15134.gada1013c.el8.x86_64 7/131 2022-09-20T20:06:16.611 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2022-09-20T20:06:16.710 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephfs2-2:17.0.0-15134.gada1013c.el8.x86_64 7/131 2022-09-20T20:06:16.872 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/131 2022-09-20T20:06:16.908 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rados-2:17.0.0-15134.gada1013c.el8.x86_6 8/131 2022-09-20T20:06:17.060 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/131 2022-09-20T20:06:17.124 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/131 2022-09-20T20:06:17.155 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/131 2022-09-20T20:06:17.331 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/131 2022-09-20T20:06:17.372 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 10/131 2022-09-20T20:06:17.642 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/131 2022-09-20T20:06:17.732 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/131 2022-09-20T20:06:18.121 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/131 2022-09-20T20:06:18.140 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libpq-13.5-1.el8.x86_64 12/131 2022-09-20T20:06:18.328 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:17.0.0-15134.gada1013c.el8.x86_64 5/131 2022-09-20T20:06:18.372 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-10.19-1.module_el8.6.0+1047+4202cf9a. 13/131 2022-09-20T20:06:18.518 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephsqlite-2:17.0.0-15134.gada1013c.el8.x86_6 14/131 2022-09-20T20:06:18.619 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephsqlite-2:17.0.0-15134.gada1013c.el8.x86_6 14/131 2022-09-20T20:06:18.733 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:17.0.0-15134.gada1013c.el8.x86_64 5/131 2022-09-20T20:06:18.776 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libradosstriper1-2:17.0.0-15134.gada1013c.el8.x8 15/131 2022-09-20T20:06:18.875 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libradosstriper1-2:17.0.0-15134.gada1013c.el8.x8 15/131 2022-09-20T20:06:18.928 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:17.0.0-15134.gada1013c.el8.x86_64 6/131 2022-09-20T20:06:19.058 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 16/131 2022-09-20T20:06:19.059 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:17.0.0-15134.gada1013c.el8.x86_64 6/131 2022-09-20T20:06:19.227 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : zlib-devel-1.2.11-20.el8.x86_64 17/131 2022-09-20T20:06:19.244 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:17.0.0-15134.gada1013c.el8.x86_64 7/131 2022-09-20T20:06:19.338 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:17.0.0-15134.gada1013c.el8.x86_64 7/131 2022-09-20T20:06:19.377 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libquadmath-8.5.0-15.el8.x86_64 18/131 2022-09-20T20:06:19.510 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libquadmath-8.5.0-15.el8.x86_64 18/131 2022-09-20T20:06:19.551 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:17.0.0-15134.gada1013c.el8.x86_6 8/131 2022-09-20T20:06:19.685 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgfortran-8.5.0-15.el8.x86_64 19/131 2022-09-20T20:06:19.694 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 9/131 2022-09-20T20:06:19.766 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 9/131 2022-09-20T20:06:19.998 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 10/131 2022-09-20T20:06:20.188 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/131 2022-09-20T20:06:20.288 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libgfortran-8.5.0-15.el8.x86_64 19/131 2022-09-20T20:06:20.468 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-0.3.15-4.el8.x86_64 20/131 2022-09-20T20:06:20.593 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libpq-13.5-1.el8.x86_64 12/131 2022-09-20T20:06:20.844 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-10.19-1.module_el8.6.0+1047+4202cf9a. 13/131 2022-09-20T20:06:21.019 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:17.0.0-15134.gada1013c.el8.x86_6 14/131 2022-09-20T20:06:21.084 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 20/131 2022-09-20T20:06:21.120 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:17.0.0-15134.gada1013c.el8.x86_6 14/131 2022-09-20T20:06:21.268 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 21/131 2022-09-20T20:06:21.285 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:17.0.0-15134.gada1013c.el8.x8 15/131 2022-09-20T20:06:21.418 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:17.0.0-15134.gada1013c.el8.x8 15/131 2022-09-20T20:06:21.634 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 16/131 2022-09-20T20:06:21.802 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : zlib-devel-1.2.11-20.el8.x86_64 17/131 2022-09-20T20:06:21.944 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-8.5.0-15.el8.x86_64 18/131 2022-09-20T20:06:21.956 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 21/131 2022-09-20T20:06:22.078 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libquadmath-8.5.0-15.el8.x86_64 18/131 2022-09-20T20:06:22.269 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-8.5.0-15.el8.x86_64 19/131 2022-09-20T20:06:22.326 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 22/131 2022-09-20T20:06:22.515 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/131 2022-09-20T20:06:22.853 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libgfortran-8.5.0-15.el8.x86_64 19/131 2022-09-20T20:06:22.905 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/131 2022-09-20T20:06:23.052 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.15-4.el8.x86_64 20/131 2022-09-20T20:06:23.145 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 25/131 2022-09-20T20:06:23.316 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-common-2:17.0.0-15134.gada1013c.el8 26/131 2022-09-20T20:06:23.462 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-argparse-2:17.0.0-15134.gada1013c.e 27/131 2022-09-20T20:06:23.657 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 20/131 2022-09-20T20:06:23.697 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cephfs-2:17.0.0-15134.gada1013c.el8.x86_ 28/131 2022-09-20T20:06:23.827 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 21/131 2022-09-20T20:06:24.516 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 21/131 2022-09-20T20:06:24.659 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/131 2022-09-20T20:06:24.853 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 22/131 2022-09-20T20:06:24.997 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 30/131 2022-09-20T20:06:25.032 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/131 2022-09-20T20:06:25.229 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/131 2022-09-20T20:06:25.254 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 31/131 2022-09-20T20:06:25.427 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 25/131 2022-09-20T20:06:25.475 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/131 2022-09-20T20:06:25.650 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:17.0.0-15134.gada1013c.el8 26/131 2022-09-20T20:06:25.805 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:17.0.0-15134.gada1013c.e 27/131 2022-09-20T20:06:26.056 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:17.0.0-15134.gada1013c.el8.x86_ 28/131 2022-09-20T20:06:27.003 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/131 2022-09-20T20:06:27.259 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/131 2022-09-20T20:06:27.340 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 30/131 2022-09-20T20:06:27.579 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 33/131 2022-09-20T20:06:27.605 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 31/131 2022-09-20T20:06:27.768 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 34/131 2022-09-20T20:06:27.793 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/131 2022-09-20T20:06:28.009 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rsa-4.8-1.el8.noarch 35/131 2022-09-20T20:06:28.165 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rbd-2:17.0.0-15134.gada1013c.el8.x86_64 36/131 2022-09-20T20:06:28.521 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librados-devel-2:17.0.0-15134.gada1013c.el8.x86_ 37/131 2022-09-20T20:06:28.861 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 38/131 2022-09-20T20:06:29.089 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 39/131 2022-09-20T20:06:29.273 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 40/131 2022-09-20T20:06:29.420 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 41/131 2022-09-20T20:06:29.589 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/131 2022-09-20T20:06:29.609 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 42/131 2022-09-20T20:06:29.790 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 43/131 2022-09-20T20:06:29.921 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 33/131 2022-09-20T20:06:29.994 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 44/131 2022-09-20T20:06:30.110 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 34/131 2022-09-20T20:06:30.159 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 45/131 2022-09-20T20:06:30.327 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 46/131 2022-09-20T20:06:30.335 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.8-1.el8.noarch 35/131 2022-09-20T20:06:30.491 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:17.0.0-15134.gada1013c.el8.x86_64 36/131 2022-09-20T20:06:30.497 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 47/131 2022-09-20T20:06:30.667 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:17.0.0-15134.gada1013c.el8.x86_ 37/131 2022-09-20T20:06:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 48/131 2022-09-20T20:06:30.813 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 49/131 2022-09-20T20:06:30.903 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 38/131 2022-09-20T20:06:30.973 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-portend-2.6-1.el8.noarch 50/131 2022-09-20T20:06:31.138 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 51/131 2022-09-20T20:06:31.155 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 39/131 2022-09-20T20:06:31.354 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 52/131 2022-09-20T20:06:31.374 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 40/131 2022-09-20T20:06:31.513 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 41/131 2022-09-20T20:06:31.587 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 53/131 2022-09-20T20:06:31.677 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 42/131 2022-09-20T20:06:31.767 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 54/131 2022-09-20T20:06:31.849 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 43/131 2022-09-20T20:06:32.053 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 44/131 2022-09-20T20:06:32.057 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 55/131 2022-09-20T20:06:32.226 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 45/131 2022-09-20T20:06:32.266 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 56/131 2022-09-20T20:06:32.387 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 46/131 2022-09-20T20:06:32.476 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/131 2022-09-20T20:06:32.539 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 47/131 2022-09-20T20:06:32.720 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 48/131 2022-09-20T20:06:32.931 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 49/131 2022-09-20T20:06:33.132 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-2.6-1.el8.noarch 50/131 2022-09-20T20:06:33.245 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/131 2022-09-20T20:06:33.298 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 51/131 2022-09-20T20:06:33.416 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librgw2-2:17.0.0-15134.gada1013c.el8.x86_64 59/131 2022-09-20T20:06:33.492 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librgw2-2:17.0.0-15134.gada1013c.el8.x86_64 59/131 2022-09-20T20:06:33.659 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rgw-2:17.0.0-15134.gada1013c.el8.x86_64 60/131 2022-09-20T20:06:33.806 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 52/131 2022-09-20T20:06:33.886 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 61/131 2022-09-20T20:06:34.055 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 53/131 2022-09-20T20:06:34.094 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 62/131 2022-09-20T20:06:34.268 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 54/131 2022-09-20T20:06:34.432 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 63/131 2022-09-20T20:06:34.553 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 55/131 2022-09-20T20:06:34.694 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 64/131 2022-09-20T20:06:34.767 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 56/131 2022-09-20T20:06:34.859 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 65/131 2022-09-20T20:06:34.983 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 57/131 2022-09-20T20:06:35.077 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 66/131 2022-09-20T20:06:35.253 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 67/131 2022-09-20T20:06:35.761 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 58/131 2022-09-20T20:06:35.950 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:17.0.0-15134.gada1013c.el8.x86_64 59/131 2022-09-20T20:06:36.034 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:17.0.0-15134.gada1013c.el8.x86_64 59/131 2022-09-20T20:06:36.218 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:17.0.0-15134.gada1013c.el8.x86_64 60/131 2022-09-20T20:06:36.307 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 68/131 2022-09-20T20:06:36.445 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 61/131 2022-09-20T20:06:36.639 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 69/131 2022-09-20T20:06:36.652 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 62/131 2022-09-20T20:06:36.898 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 70/131 2022-09-20T20:06:37.066 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 63/131 2022-09-20T20:06:37.130 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 71/131 2022-09-20T20:06:37.303 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 64/131 2022-09-20T20:06:37.422 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/131 2022-09-20T20:06:37.468 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 65/131 2022-09-20T20:06:37.633 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 73/131 2022-09-20T20:06:37.721 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 66/131 2022-09-20T20:06:37.834 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/131 2022-09-20T20:06:37.929 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 67/131 2022-09-20T20:06:38.043 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 75/131 2022-09-20T20:06:38.342 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 76/131 2022-09-20T20:06:38.567 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 77/131 2022-09-20T20:06:38.763 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 78/131 2022-09-20T20:06:38.894 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libuuid-devel-2.32.1-38.el8.x86_64 79/131 2022-09-20T20:06:38.979 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 68/131 2022-09-20T20:06:39.170 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 80/131 2022-09-20T20:06:39.358 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 69/131 2022-09-20T20:06:39.367 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libselinux-devel-2.9-6.el8.x86_64 81/131 2022-09-20T20:06:39.485 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 82/131 2022-09-20T20:06:39.641 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 70/131 2022-09-20T20:06:39.678 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 83/131 2022-09-20T20:06:39.841 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 71/131 2022-09-20T20:06:39.883 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : krb5-devel-1.18.2-21.el8.x86_64 84/131 2022-09-20T20:06:40.082 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : fuse-2.9.7-16.el8.x86_64 85/131 2022-09-20T20:06:40.146 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/131 2022-09-20T20:06:40.214 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : uuid-1.6.2-43.el8.x86_64 86/131 2022-09-20T20:06:40.326 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 86/131 2022-09-20T20:06:40.383 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 73/131 2022-09-20T20:06:40.522 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 87/131 2022-09-20T20:06:40.610 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 74/131 2022-09-20T20:06:40.657 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 88/131 2022-09-20T20:06:40.835 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 75/131 2022-09-20T20:06:41.134 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 76/131 2022-09-20T20:06:41.393 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 77/131 2022-09-20T20:06:41.573 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 78/131 2022-09-20T20:06:41.719 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libuuid-devel-2.32.1-38.el8.x86_64 79/131 2022-09-20T20:06:41.979 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 80/131 2022-09-20T20:06:42.204 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libselinux-devel-2.9-6.el8.x86_64 81/131 2022-09-20T20:06:42.352 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 82/131 2022-09-20T20:06:42.542 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 83/131 2022-09-20T20:06:42.745 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : krb5-devel-1.18.2-21.el8.x86_64 84/131 2022-09-20T20:06:42.983 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.7-16.el8.x86_64 85/131 2022-09-20T20:06:43.140 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : uuid-1.6.2-43.el8.x86_64 86/131 2022-09-20T20:06:43.246 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 86/131 2022-09-20T20:06:43.423 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 87/131 2022-09-20T20:06:43.557 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 88/131 2022-09-20T20:06:44.422 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 89/131 2022-09-20T20:06:44.623 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 89/131 2022-09-20T20:06:45.206 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 89/131 2022-09-20T20:06:45.510 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-base-2:17.0.0-15134.gada1013c.el8.x86_64 90/131 2022-09-20T20:06:45.602 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-base-2:17.0.0-15134.gada1013c.el8.x86_64 90/131 2022-09-20T20:06:45.747 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-selinux-2:17.0.0-15134.gada1013c.el8.x86_64 91/131 2022-09-20T20:06:47.248 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 89/131 2022-09-20T20:06:47.465 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 89/131 2022-09-20T20:06:48.033 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 89/131 2022-09-20T20:06:48.321 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:17.0.0-15134.gada1013c.el8.x86_64 90/131 2022-09-20T20:06:48.413 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:17.0.0-15134.gada1013c.el8.x86_64 90/131 2022-09-20T20:06:48.564 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:17.0.0-15134.gada1013c.el8.x86_64 91/131 2022-09-20T20:07:05.224 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-selinux-2:17.0.0-15134.gada1013c.el8.x86_64 91/131 2022-09-20T20:07:05.225 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /sys 2022-09-20T20:07:05.226 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /proc 2022-09-20T20:07:05.226 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /dev 2022-09-20T20:07:05.226 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /run 2022-09-20T20:07:05.227 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /mnt 2022-09-20T20:07:05.227 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /var/tmp 2022-09-20T20:07:05.227 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /home 2022-09-20T20:07:05.228 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /tmp 2022-09-20T20:07:05.228 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /dev 2022-09-20T20:07:05.228 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:05.619 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-volume-2:17.0.0-15134.gada1013c.el8.noarch 92/131 2022-09-20T20:07:07.123 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-volume-2:17.0.0-15134.gada1013c.el8.noarch 92/131 2022-09-20T20:07:07.306 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-osd-2:17.0.0-15134.gada1013c.el8.x86_64 93/131 2022-09-20T20:07:07.523 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-osd-2:17.0.0-15134.gada1013c.el8.x86_64 93/131 2022-09-20T20:07:07.694 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mds-2:17.0.0-15134.gada1013c.el8.x86_64 94/131 2022-09-20T20:07:08.079 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mds-2:17.0.0-15134.gada1013c.el8.x86_64 94/131 2022-09-20T20:07:08.235 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mon-2:17.0.0-15134.gada1013c.el8.x86_64 95/131 2022-09-20T20:07:08.258 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mon-2:17.0.0-15134.gada1013c.el8.x86_64 95/131 2022-09-20T20:07:08.433 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 96/131 2022-09-20T20:07:08.605 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 97/131 2022-09-20T20:07:08.710 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:17.0.0-15134.gada1013c.el8.x86_64 91/131 2022-09-20T20:07:08.711 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2022-09-20T20:07:08.711 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2022-09-20T20:07:08.712 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /dev 2022-09-20T20:07:08.712 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /run 2022-09-20T20:07:08.712 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2022-09-20T20:07:08.712 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2022-09-20T20:07:08.713 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2022-09-20T20:07:08.713 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2022-09-20T20:07:08.713 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /dev 2022-09-20T20:07:08.713 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:08.768 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 98/131 2022-09-20T20:07:08.850 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 98/131 2022-09-20T20:07:09.053 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-volume-2:17.0.0-15134.gada1013c.el8.noarch 92/131 2022-09-20T20:07:09.078 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : jq-1.6-3.el8.x86_64 99/131 2022-09-20T20:07:09.268 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : automake-1.16.1-7.el8.noarch 100/131 2022-09-20T20:07:10.554 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-volume-2:17.0.0-15134.gada1013c.el8.noarch 92/131 2022-09-20T20:07:10.751 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:17.0.0-15134.gada1013c.el8.x86_64 93/131 2022-09-20T20:07:10.759 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephadm-2:17.0.0-15134.gada1013c.el8.noarch 101/131 2022-09-20T20:07:10.917 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephadm-2:17.0.0-15134.gada1013c.el8.noarch 101/131 2022-09-20T20:07:10.968 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:17.0.0-15134.gada1013c.el8.x86_64 93/131 2022-09-20T20:07:11.049 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-15134.gada1013c. 102/131 2022-09-20T20:07:11.145 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:17.0.0-15134.gada1013c.el8.x86_64 94/131 2022-09-20T20:07:11.221 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-15134.gada1013c 103/131 2022-09-20T20:07:11.418 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-15134.gada1013c.el8.no 104/131 2022-09-20T20:07:11.535 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:17.0.0-15134.gada1013c.el8.x86_64 94/131 2022-09-20T20:07:11.623 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-15134.gada1013c.el8.no 104/131 2022-09-20T20:07:11.744 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:17.0.0-15134.gada1013c.el8.x86_64 95/131 2022-09-20T20:07:11.768 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:17.0.0-15134.gada1013c.el8.x86_64 95/131 2022-09-20T20:07:11.930 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-15134.gada1013c.el8. 105/131 2022-09-20T20:07:11.984 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 96/131 2022-09-20T20:07:12.163 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 97/131 2022-09-20T20:07:12.327 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 98/131 2022-09-20T20:07:12.405 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 98/131 2022-09-20T20:07:12.670 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jq-1.6-3.el8.x86_64 99/131 2022-09-20T20:07:12.895 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-15134.gada1013c.el8. 105/131 2022-09-20T20:07:12.986 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : automake-1.16.1-7.el8.noarch 100/131 2022-09-20T20:07:13.067 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-15134.gad 106/131 2022-09-20T20:07:13.175 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-15134.gad 106/131 2022-09-20T20:07:13.514 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-15134.gada1013c.e 107/131 2022-09-20T20:07:13.705 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-2:17.0.0-15134.gada1013c.el8.x86_64 108/131 2022-09-20T20:07:13.740 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-2:17.0.0-15134.gada1013c.el8.x86_64 108/131 2022-09-20T20:07:13.909 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-rook-2:17.0.0-15134.gada1013c.el8.noarc 109/131 2022-09-20T20:07:13.920 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-15134.gada1013c.el8.noarc 109/131 2022-09-20T20:07:14.098 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-2:17.0.0-15134.gada1013c.el8.x86_64 110/131 2022-09-20T20:07:14.234 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtool-2.4.6-25.el8.x86_64 111/131 2022-09-20T20:07:14.501 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:17.0.0-15134.gada1013c.el8.noarch 101/131 2022-09-20T20:07:14.678 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:17.0.0-15134.gada1013c.el8.noarch 101/131 2022-09-20T20:07:14.841 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-15134.gada1013c. 102/131 2022-09-20T20:07:15.022 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-15134.gada1013c 103/131 2022-09-20T20:07:15.193 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-15134.gada1013c.el8.no 104/131 2022-09-20T20:07:15.399 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-15134.gada1013c.el8.no 104/131 2022-09-20T20:07:15.742 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-15134.gada1013c.el8. 105/131 2022-09-20T20:07:16.708 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-15134.gada1013c.el8. 105/131 2022-09-20T20:07:16.885 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-15134.gad 106/131 2022-09-20T20:07:16.979 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-15134.gad 106/131 2022-09-20T20:07:17.359 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-15134.gada1013c.e 107/131 2022-09-20T20:07:17.558 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:17.0.0-15134.gada1013c.el8.x86_64 108/131 2022-09-20T20:07:17.593 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:17.0.0-15134.gada1013c.el8.x86_64 108/131 2022-09-20T20:07:17.768 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:17.0.0-15134.gada1013c.el8.noarc 109/131 2022-09-20T20:07:17.779 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-15134.gada1013c.el8.noarc 109/131 2022-09-20T20:07:18.005 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:17.0.0-15134.gada1013c.el8.x86_64 110/131 2022-09-20T20:07:18.160 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtool-2.4.6-25.el8.x86_64 111/131 2022-09-20T20:07:19.357 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 111/131 2022-09-20T20:07:21.214 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-test-2:17.0.0-15134.gada1013c.el8.x86_64 112/131 2022-09-20T20:07:21.446 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-radosgw-2:17.0.0-15134.gada1013c.el8.x86_64 113/131 2022-09-20T20:07:21.479 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-15134.gada1013c.el8.x86_64 113/131 2022-09-20T20:07:21.625 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-15134.gada1 114/131 2022-09-20T20:07:21.666 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-15134.gada1 114/131 2022-09-20T20:07:21.850 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-mirror-2:17.0.0-15134.gada1013c.el8.x86_6 115/131 2022-09-20T20:07:22.204 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-15134.gada1013c.el8.x86_6 115/131 2022-09-20T20:07:22.383 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 116/131 2022-09-20T20:07:22.585 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rbd-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 116/131 2022-09-20T20:07:22.847 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-contrib-10.19-1.module_el8.6.0+1047+4 117/131 2022-09-20T20:07:23.285 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 111/131 2022-09-20T20:07:23.733 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 118/131 2022-09-20T20:07:23.975 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openssl-devel-1:1.1.1k-7.el8.x86_64 119/131 2022-09-20T20:07:24.103 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/131 2022-09-20T20:07:24.253 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs-devel-2:17.0.0-15134.gada1013c.el8.x86 121/131 2022-09-20T20:07:24.400 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : elfutils-libelf-devel-0.187-4.el8.x86_64 122/131 2022-09-20T20:07:25.109 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:17.0.0-15134.gada1013c.el8.x86_64 112/131 2022-09-20T20:07:25.324 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:17.0.0-15134.gada1013c.el8.x86_64 113/131 2022-09-20T20:07:25.359 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-15134.gada1013c.el8.x86_64 113/131 2022-09-20T20:07:25.575 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-15134.gada1 114/131 2022-09-20T20:07:25.616 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-15134.gada1 114/131 2022-09-20T20:07:25.817 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-mirror-2:17.0.0-15134.gada1013c.el8.x86_6 115/131 2022-09-20T20:07:26.164 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-15134.gada1013c.el8.x86_6 115/131 2022-09-20T20:07:26.375 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 116/131 2022-09-20T20:07:26.427 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: postgresql-server-10.19-1.module_el8.6.0+1047+42 123/131 2022-09-20T20:07:26.577 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 116/131 2022-09-20T20:07:26.650 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-server-10.19-1.module_el8.6.0+1047+42 123/131 2022-09-20T20:07:26.666 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: postgresql-server-10.19-1.module_el8.6.0+1047+42 123/131 2022-09-20T20:07:26.832 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-top-2:17.0.0-15134.gada1013c.el8.noarch 124/131 2022-09-20T20:07:26.856 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-contrib-10.19-1.module_el8.6.0+1047+4 117/131 2022-09-20T20:07:27.123 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 125/131 2022-09-20T20:07:27.316 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-nbd-2:17.0.0-15134.gada1013c.el8.x86_64 126/131 2022-09-20T20:07:27.502 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 127/131 2022-09-20T20:07:27.665 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/131 2022-09-20T20:07:27.750 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 118/131 2022-09-20T20:07:27.753 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/131 2022-09-20T20:07:28.007 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/131 2022-09-20T20:07:28.018 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openssl-devel-1:1.1.1k-7.el8.x86_64 119/131 2022-09-20T20:07:28.020 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/131 2022-09-20T20:07:28.020 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 130/131 2022-09-20T20:07:28.146 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/131 2022-09-20T20:07:28.210 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 130/131 2022-09-20T20:07:28.210 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 131/131 2022-09-20T20:07:28.288 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:17.0.0-15134.gada1013c.el8.x86 121/131 2022-09-20T20:07:28.460 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : elfutils-libelf-devel-0.187-4.el8.x86_64 122/131 2022-09-20T20:07:28.946 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 131/131 2022-09-20T20:07:28.946 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-2:17.0.0-15134.gada1013c.el8.x86_64 1/131 2022-09-20T20:07:28.946 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-base-2:17.0.0-15134.gada1013c.el8.x86_64 2/131 2022-09-20T20:07:28.947 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 3/131 2022-09-20T20:07:28.947 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 4/131 2022-09-20T20:07:28.947 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-15134.gada1 5/131 2022-09-20T20:07:28.948 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mds-2:17.0.0-15134.gada1013c.el8.x86_64 6/131 2022-09-20T20:07:28.948 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-2:17.0.0-15134.gada1013c.el8.x86_64 7/131 2022-09-20T20:07:28.948 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mon-2:17.0.0-15134.gada1013c.el8.x86_64 8/131 2022-09-20T20:07:28.948 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-osd-2:17.0.0-15134.gada1013c.el8.x86_64 9/131 2022-09-20T20:07:28.948 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-radosgw-2:17.0.0-15134.gada1013c.el8.x86_64 10/131 2022-09-20T20:07:28.949 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-selinux-2:17.0.0-15134.gada1013c.el8.x86_64 11/131 2022-09-20T20:07:28.949 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-test-2:17.0.0-15134.gada1013c.el8.x86_64 12/131 2022-09-20T20:07:28.949 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-mirror-2:17.0.0-15134.gada1013c.el8.x86_6 13/131 2022-09-20T20:07:28.949 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs-devel-2:17.0.0-15134.gada1013c.el8.x86 14/131 2022-09-20T20:07:28.950 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs2-2:17.0.0-15134.gada1013c.el8.x86_64 15/131 2022-09-20T20:07:28.950 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephsqlite-2:17.0.0-15134.gada1013c.el8.x86_6 16/131 2022-09-20T20:07:28.950 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados-devel-2:17.0.0-15134.gada1013c.el8.x86_ 17/131 2022-09-20T20:07:28.950 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libradosstriper1-2:17.0.0-15134.gada1013c.el8.x8 18/131 2022-09-20T20:07:28.951 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librgw2-2:17.0.0-15134.gada1013c.el8.x86_64 19/131 2022-09-20T20:07:28.951 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-argparse-2:17.0.0-15134.gada1013c.e 20/131 2022-09-20T20:07:28.951 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-common-2:17.0.0-15134.gada1013c.el8 21/131 2022-09-20T20:07:28.951 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cephfs-2:17.0.0-15134.gada1013c.el8.x86_ 22/131 2022-09-20T20:07:28.952 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rados-2:17.0.0-15134.gada1013c.el8.x86_6 23/131 2022-09-20T20:07:28.952 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rbd-2:17.0.0-15134.gada1013c.el8.x86_64 24/131 2022-09-20T20:07:28.952 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rgw-2:17.0.0-15134.gada1013c.el8.x86_64 25/131 2022-09-20T20:07:28.952 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 26/131 2022-09-20T20:07:28.953 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 27/131 2022-09-20T20:07:28.953 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-nbd-2:17.0.0-15134.gada1013c.el8.x86_64 28/131 2022-09-20T20:07:28.953 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-15134.gada1013c 29/131 2022-09-20T20:07:28.953 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-15134.gada1013c.el8.no 30/131 2022-09-20T20:07:28.953 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-15134.gada1013c.el8. 31/131 2022-09-20T20:07:28.954 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-15134.gad 32/131 2022-09-20T20:07:28.954 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-15134.gada1013c.e 33/131 2022-09-20T20:07:28.954 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-rook-2:17.0.0-15134.gada1013c.el8.noarc 34/131 2022-09-20T20:07:28.954 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-15134.gada1013c. 35/131 2022-09-20T20:07:28.955 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-volume-2:17.0.0-15134.gada1013c.el8.noarch 36/131 2022-09-20T20:07:28.955 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephadm-2:17.0.0-15134.gada1013c.el8.noarch 37/131 2022-09-20T20:07:28.955 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-top-2:17.0.0-15134.gada1013c.el8.noarch 38/131 2022-09-20T20:07:28.955 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/131 2022-09-20T20:07:28.956 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/131 2022-09-20T20:07:28.956 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/131 2022-09-20T20:07:28.956 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : jq-1.6-3.el8.x86_64 42/131 2022-09-20T20:07:28.956 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/131 2022-09-20T20:07:28.956 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/131 2022-09-20T20:07:28.957 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/131 2022-09-20T20:07:28.957 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/131 2022-09-20T20:07:28.957 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/131 2022-09-20T20:07:28.957 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/131 2022-09-20T20:07:28.958 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/131 2022-09-20T20:07:28.958 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-10.19-1.module_el8.6.0+1047+4202cf9a. 50/131 2022-09-20T20:07:28.958 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-contrib-10.19-1.module_el8.6.0+1047+4 51/131 2022-09-20T20:07:28.958 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-server-10.19-1.module_el8.6.0+1047+42 52/131 2022-09-20T20:07:28.959 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/131 2022-09-20T20:07:28.959 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/131 2022-09-20T20:07:28.959 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/131 2022-09-20T20:07:28.959 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/131 2022-09-20T20:07:28.959 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 57/131 2022-09-20T20:07:28.960 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/131 2022-09-20T20:07:28.960 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/131 2022-09-20T20:07:28.960 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/131 2022-09-20T20:07:28.961 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/131 2022-09-20T20:07:28.961 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/131 2022-09-20T20:07:28.961 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/131 2022-09-20T20:07:28.961 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/131 2022-09-20T20:07:28.961 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/131 2022-09-20T20:07:28.962 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/131 2022-09-20T20:07:28.962 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/131 2022-09-20T20:07:28.962 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/131 2022-09-20T20:07:28.962 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/131 2022-09-20T20:07:28.963 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-devel-0.187-4.el8.x86_64 70/131 2022-09-20T20:07:28.963 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 71/131 2022-09-20T20:07:28.963 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 72/131 2022-09-20T20:07:28.963 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : krb5-devel-1.18.2-21.el8.x86_64 73/131 2022-09-20T20:07:28.964 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 74/131 2022-09-20T20:07:28.964 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 75/131 2022-09-20T20:07:28.964 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgfortran-8.5.0-15.el8.x86_64 76/131 2022-09-20T20:07:28.964 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libquadmath-8.5.0-15.el8.x86_64 77/131 2022-09-20T20:07:28.965 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 78/131 2022-09-20T20:07:28.965 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libselinux-devel-2.9-6.el8.x86_64 79/131 2022-09-20T20:07:28.965 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 80/131 2022-09-20T20:07:28.965 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libuuid-devel-2.32.1-38.el8.x86_64 81/131 2022-09-20T20:07:28.966 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 82/131 2022-09-20T20:07:28.966 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8.x86_64 83/131 2022-09-20T20:07:28.966 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 84/131 2022-09-20T20:07:28.966 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 85/131 2022-09-20T20:07:28.967 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 86/131 2022-09-20T20:07:28.967 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/131 2022-09-20T20:07:28.967 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 88/131 2022-09-20T20:07:28.967 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 89/131 2022-09-20T20:07:28.968 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 90/131 2022-09-20T20:07:28.968 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 91/131 2022-09-20T20:07:28.968 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 92/131 2022-09-20T20:07:28.969 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 93/131 2022-09-20T20:07:28.969 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : zlib-devel-1.2.11-20.el8.x86_64 94/131 2022-09-20T20:07:28.969 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 95/131 2022-09-20T20:07:28.969 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 96/131 2022-09-20T20:07:28.970 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 97/131 2022-09-20T20:07:28.970 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 98/131 2022-09-20T20:07:28.970 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 99/131 2022-09-20T20:07:28.970 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 100/131 2022-09-20T20:07:28.970 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 101/131 2022-09-20T20:07:28.971 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 102/131 2022-09-20T20:07:28.971 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 103/131 2022-09-20T20:07:28.971 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 104/131 2022-09-20T20:07:28.971 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 105/131 2022-09-20T20:07:28.972 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 106/131 2022-09-20T20:07:28.972 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 107/131 2022-09-20T20:07:28.972 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 108/131 2022-09-20T20:07:28.972 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 109/131 2022-09-20T20:07:28.973 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 110/131 2022-09-20T20:07:28.973 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 111/131 2022-09-20T20:07:28.973 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 112/131 2022-09-20T20:07:28.973 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 113/131 2022-09-20T20:07:28.974 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-portend-2.6-1.el8.noarch 114/131 2022-09-20T20:07:28.974 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 115/131 2022-09-20T20:07:28.974 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 116/131 2022-09-20T20:07:28.974 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 117/131 2022-09-20T20:07:28.974 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 118/131 2022-09-20T20:07:28.975 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 119/131 2022-09-20T20:07:28.975 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 120/131 2022-09-20T20:07:28.975 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 121/131 2022-09-20T20:07:28.975 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 122/131 2022-09-20T20:07:28.976 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 123/131 2022-09-20T20:07:28.976 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 124/131 2022-09-20T20:07:28.976 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 125/131 2022-09-20T20:07:28.976 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 126/131 2022-09-20T20:07:28.977 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 127/131 2022-09-20T20:07:28.977 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:17.0.0-15134.gada1013c.el8.x86_64 128/131 2022-09-20T20:07:28.977 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/131 2022-09-20T20:07:28.978 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:17.0.0-15134.gada1013c.el8.x86_64 130/131 2022-09-20T20:07:30.467 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-10.19-1.module_el8.6.0+1047+42 123/131 2022-09-20T20:07:30.649 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/131 2022-09-20T20:07:30.650 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:30.650 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded: 2022-09-20T20:07:30.650 INFO:teuthology.orchestra.run.smithi171.stdout: librados2-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.651 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.651 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2022-09-20T20:07:30.651 INFO:teuthology.orchestra.run.smithi171.stdout: automake-1.16.1-7.el8.noarch 2022-09-20T20:07:30.651 INFO:teuthology.orchestra.run.smithi171.stdout: bison-3.0.4-10.el8.x86_64 2022-09-20T20:07:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:30.653 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.653 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.653 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.653 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:30.654 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:30.654 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:30.654 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:30.654 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:30.655 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.655 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.655 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:30.655 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel-0.187-4.el8.x86_64 2022-09-20T20:07:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: flex-2.6.1-9.el8.x86_64 2022-09-20T20:07:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: fuse-2.9.7-16.el8.x86_64 2022-09-20T20:07:30.658 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-09-20T20:07:30.658 INFO:teuthology.orchestra.run.smithi171.stdout: jq-1.6-3.el8.x86_64 2022-09-20T20:07:30.658 INFO:teuthology.orchestra.run.smithi171.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-09-20T20:07:30.658 INFO:teuthology.orchestra.run.smithi171.stdout: krb5-devel-1.18.2-21.el8.x86_64 2022-09-20T20:07:30.659 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-09-20T20:07:30.659 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.659 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.659 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.659 INFO:teuthology.orchestra.run.smithi171.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2022-09-20T20:07:30.660 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran-8.5.0-15.el8.x86_64 2022-09-20T20:07:30.660 INFO:teuthology.orchestra.run.smithi171.stdout: liboath-2.6.2-3.el8.x86_64 2022-09-20T20:07:30.660 INFO:teuthology.orchestra.run.smithi171.stdout: libpq-13.5-1.el8.x86_64 2022-09-20T20:07:30.660 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath-8.5.0-15.el8.x86_64 2022-09-20T20:07:30.661 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-09-20T20:07:30.661 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.661 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.661 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-09-20T20:07:30.661 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.662 INFO:teuthology.orchestra.run.smithi171.stdout: libselinux-devel-2.9-6.el8.x86_64 2022-09-20T20:07:30.662 INFO:teuthology.orchestra.run.smithi171.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-09-20T20:07:30.662 INFO:teuthology.orchestra.run.smithi171.stdout: libtool-2.4.6-25.el8.x86_64 2022-09-20T20:07:30.662 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind-1.3.1-3.el8.x86_64 2022-09-20T20:07:30.663 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel-2.32.1-38.el8.x86_64 2022-09-20T20:07:30.663 INFO:teuthology.orchestra.run.smithi171.stdout: libverto-devel-0.3.2-2.el8.x86_64 2022-09-20T20:07:30.663 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-09-20T20:07:30.663 INFO:teuthology.orchestra.run.smithi171.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-09-20T20:07:30.664 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-0.3.15-4.el8.x86_64 2022-09-20T20:07:30.664 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-threads-0.3.15-4.el8.x86_64 2022-09-20T20:07:30.664 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel-1:1.1.1k-7.el8.x86_64 2022-09-20T20:07:30.664 INFO:teuthology.orchestra.run.smithi171.stdout: pcre2-devel-10.32-3.el8.x86_64 2022-09-20T20:07:30.665 INFO:teuthology.orchestra.run.smithi171.stdout: pcre2-utf16-10.32-3.el8.x86_64 2022-09-20T20:07:30.665 INFO:teuthology.orchestra.run.smithi171.stdout: pcre2-utf32-10.32-3.el8.x86_64 2022-09-20T20:07:30.665 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2022-09-20T20:07:30.665 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-contrib-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2022-09-20T20:07:30.665 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-server-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2022-09-20T20:07:30.666 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-09-20T20:07:30.666 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel-2.5.1-7.el8.noarch 2022-09-20T20:07:30.666 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-09-20T20:07:30.666 INFO:teuthology.orchestra.run.smithi171.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-09-20T20:07:30.667 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-09-20T20:07:30.667 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.667 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.667 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-09-20T20:07:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-09-20T20:07:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-09-20T20:07:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-09-20T20:07:30.668 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-09-20T20:07:30.669 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-09-20T20:07:30.669 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-6.2-6.el8.noarch 2022-09-20T20:07:30.669 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-09-20T20:07:30.669 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-09-20T20:07:30.670 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-09-20T20:07:30.670 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-09-20T20:07:30.670 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-09-20T20:07:30.670 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-09-20T20:07:30.671 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-09-20T20:07:30.671 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako-1.0.6-13.el8.noarch 2022-09-20T20:07:30.671 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-09-20T20:07:30.671 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-09-20T20:07:30.671 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-09-20T20:07:30.672 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-09-20T20:07:30.672 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-09-20T20:07:30.672 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-09-20T20:07:30.672 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-09-20T20:07:30.673 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend-2.6-1.el8.noarch 2022-09-20T20:07:30.673 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-09-20T20:07:30.673 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-09-20T20:07:30.673 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-09-20T20:07:30.674 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-09-20T20:07:30.674 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser-2.14-14.el8.noarch 2022-09-20T20:07:30.674 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz-2017.2-9.el8.noarch 2022-09-20T20:07:30.674 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.675 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.675 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-09-20T20:07:30.675 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-09-20T20:07:30.675 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.676 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes-2.4.1-12.el8.noarch 2022-09-20T20:07:30.676 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa-4.8-1.el8.noarch 2022-09-20T20:07:30.676 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2022-09-20T20:07:30.676 INFO:teuthology.orchestra.run.smithi171.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-09-20T20:07:30.676 INFO:teuthology.orchestra.run.smithi171.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-09-20T20:07:30.677 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-09-20T20:07:30.677 INFO:teuthology.orchestra.run.smithi171.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-09-20T20:07:30.677 INFO:teuthology.orchestra.run.smithi171.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-09-20T20:07:30.677 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-09-20T20:07:30.678 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-09-20T20:07:30.678 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-09-20T20:07:30.678 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-09-20T20:07:30.678 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-09-20T20:07:30.679 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.679 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.679 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:30.679 INFO:teuthology.orchestra.run.smithi171.stdout: socat-1.7.4.1-1.el8.x86_64 2022-09-20T20:07:30.680 INFO:teuthology.orchestra.run.smithi171.stdout: thrift-0.13.0-2.el8.x86_64 2022-09-20T20:07:30.680 INFO:teuthology.orchestra.run.smithi171.stdout: uuid-1.6.2-43.el8.x86_64 2022-09-20T20:07:30.680 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-09-20T20:07:30.680 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2022-09-20T20:07:30.686 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-server-10.19-1.module_el8.6.0+1047+42 123/131 2022-09-20T20:07:30.687 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel-1.2.11-20.el8.x86_64 2022-09-20T20:07:30.687 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:30.687 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2022-09-20T20:07:30.691 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-10.19-1.module_el8.6.0+1047+42 123/131 2022-09-20T20:07:30.837 DEBUG:teuthology.parallel:result is None 2022-09-20T20:07:30.908 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-top-2:17.0.0-15134.gada1013c.el8.noarch 124/131 2022-09-20T20:07:31.157 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 125/131 2022-09-20T20:07:31.358 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:17.0.0-15134.gada1013c.el8.x86_64 126/131 2022-09-20T20:07:31.557 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 127/131 2022-09-20T20:07:31.758 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/131 2022-09-20T20:07:31.838 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/131 2022-09-20T20:07:32.049 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/131 2022-09-20T20:07:32.061 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/131 2022-09-20T20:07:32.062 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 130/131 2022-09-20T20:07:32.277 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 130/131 2022-09-20T20:07:32.278 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 131/131 2022-09-20T20:07:33.062 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 131/131 2022-09-20T20:07:33.062 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:17.0.0-15134.gada1013c.el8.x86_64 1/131 2022-09-20T20:07:33.063 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:17.0.0-15134.gada1013c.el8.x86_64 2/131 2022-09-20T20:07:33.064 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 3/131 2022-09-20T20:07:33.064 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 4/131 2022-09-20T20:07:33.065 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-15134.gada1 5/131 2022-09-20T20:07:33.065 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:17.0.0-15134.gada1013c.el8.x86_64 6/131 2022-09-20T20:07:33.066 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:17.0.0-15134.gada1013c.el8.x86_64 7/131 2022-09-20T20:07:33.066 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:17.0.0-15134.gada1013c.el8.x86_64 8/131 2022-09-20T20:07:33.066 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:17.0.0-15134.gada1013c.el8.x86_64 9/131 2022-09-20T20:07:33.067 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:17.0.0-15134.gada1013c.el8.x86_64 10/131 2022-09-20T20:07:33.067 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:17.0.0-15134.gada1013c.el8.x86_64 11/131 2022-09-20T20:07:33.067 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:17.0.0-15134.gada1013c.el8.x86_64 12/131 2022-09-20T20:07:33.068 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-mirror-2:17.0.0-15134.gada1013c.el8.x86_6 13/131 2022-09-20T20:07:33.068 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:17.0.0-15134.gada1013c.el8.x86 14/131 2022-09-20T20:07:33.068 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:17.0.0-15134.gada1013c.el8.x86_64 15/131 2022-09-20T20:07:33.068 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:17.0.0-15134.gada1013c.el8.x86_6 16/131 2022-09-20T20:07:33.068 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:17.0.0-15134.gada1013c.el8.x86_ 17/131 2022-09-20T20:07:33.069 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:17.0.0-15134.gada1013c.el8.x8 18/131 2022-09-20T20:07:33.069 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:17.0.0-15134.gada1013c.el8.x86_64 19/131 2022-09-20T20:07:33.069 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:17.0.0-15134.gada1013c.e 20/131 2022-09-20T20:07:33.070 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:17.0.0-15134.gada1013c.el8 21/131 2022-09-20T20:07:33.070 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:17.0.0-15134.gada1013c.el8.x86_ 22/131 2022-09-20T20:07:33.070 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:17.0.0-15134.gada1013c.el8.x86_6 23/131 2022-09-20T20:07:33.071 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:17.0.0-15134.gada1013c.el8.x86_64 24/131 2022-09-20T20:07:33.071 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:17.0.0-15134.gada1013c.el8.x86_64 25/131 2022-09-20T20:07:33.071 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 26/131 2022-09-20T20:07:33.072 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 27/131 2022-09-20T20:07:33.072 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:17.0.0-15134.gada1013c.el8.x86_64 28/131 2022-09-20T20:07:33.072 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-15134.gada1013c 29/131 2022-09-20T20:07:33.073 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-15134.gada1013c.el8.no 30/131 2022-09-20T20:07:33.073 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-15134.gada1013c.el8. 31/131 2022-09-20T20:07:33.073 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-15134.gad 32/131 2022-09-20T20:07:33.074 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-15134.gada1013c.e 33/131 2022-09-20T20:07:33.074 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:17.0.0-15134.gada1013c.el8.noarc 34/131 2022-09-20T20:07:33.074 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-15134.gada1013c. 35/131 2022-09-20T20:07:33.075 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-volume-2:17.0.0-15134.gada1013c.el8.noarch 36/131 2022-09-20T20:07:33.075 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:17.0.0-15134.gada1013c.el8.noarch 37/131 2022-09-20T20:07:33.075 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-top-2:17.0.0-15134.gada1013c.el8.noarch 38/131 2022-09-20T20:07:33.076 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/131 2022-09-20T20:07:33.076 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/131 2022-09-20T20:07:33.076 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/131 2022-09-20T20:07:33.077 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jq-1.6-3.el8.x86_64 42/131 2022-09-20T20:07:33.077 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/131 2022-09-20T20:07:33.077 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/131 2022-09-20T20:07:33.078 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/131 2022-09-20T20:07:33.078 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/131 2022-09-20T20:07:33.078 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/131 2022-09-20T20:07:33.078 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/131 2022-09-20T20:07:33.079 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/131 2022-09-20T20:07:33.079 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-10.19-1.module_el8.6.0+1047+4202cf9a. 50/131 2022-09-20T20:07:33.079 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-contrib-10.19-1.module_el8.6.0+1047+4 51/131 2022-09-20T20:07:33.079 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-server-10.19-1.module_el8.6.0+1047+42 52/131 2022-09-20T20:07:33.079 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/131 2022-09-20T20:07:33.080 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/131 2022-09-20T20:07:33.080 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/131 2022-09-20T20:07:33.080 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/131 2022-09-20T20:07:33.081 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 57/131 2022-09-20T20:07:33.081 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/131 2022-09-20T20:07:33.081 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/131 2022-09-20T20:07:33.082 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/131 2022-09-20T20:07:33.082 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/131 2022-09-20T20:07:33.083 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/131 2022-09-20T20:07:33.083 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/131 2022-09-20T20:07:33.083 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/131 2022-09-20T20:07:33.084 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/131 2022-09-20T20:07:33.084 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/131 2022-09-20T20:07:33.084 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/131 2022-09-20T20:07:33.085 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/131 2022-09-20T20:07:33.085 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/131 2022-09-20T20:07:33.085 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libelf-devel-0.187-4.el8.x86_64 70/131 2022-09-20T20:07:33.086 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 71/131 2022-09-20T20:07:33.086 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 72/131 2022-09-20T20:07:33.086 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : krb5-devel-1.18.2-21.el8.x86_64 73/131 2022-09-20T20:07:33.087 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 74/131 2022-09-20T20:07:33.087 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 75/131 2022-09-20T20:07:33.087 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-8.5.0-15.el8.x86_64 76/131 2022-09-20T20:07:33.087 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-8.5.0-15.el8.x86_64 77/131 2022-09-20T20:07:33.087 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 78/131 2022-09-20T20:07:33.088 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libselinux-devel-2.9-6.el8.x86_64 79/131 2022-09-20T20:07:33.088 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 80/131 2022-09-20T20:07:33.088 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libuuid-devel-2.32.1-38.el8.x86_64 81/131 2022-09-20T20:07:33.088 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 82/131 2022-09-20T20:07:33.089 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8.x86_64 83/131 2022-09-20T20:07:33.089 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 84/131 2022-09-20T20:07:33.089 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 85/131 2022-09-20T20:07:33.089 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 86/131 2022-09-20T20:07:33.090 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/131 2022-09-20T20:07:33.090 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 88/131 2022-09-20T20:07:33.090 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 89/131 2022-09-20T20:07:33.090 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 90/131 2022-09-20T20:07:33.091 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 91/131 2022-09-20T20:07:33.091 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 92/131 2022-09-20T20:07:33.091 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 93/131 2022-09-20T20:07:33.092 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : zlib-devel-1.2.11-20.el8.x86_64 94/131 2022-09-20T20:07:33.092 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 95/131 2022-09-20T20:07:33.093 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 96/131 2022-09-20T20:07:33.093 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 97/131 2022-09-20T20:07:33.093 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 98/131 2022-09-20T20:07:33.094 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 99/131 2022-09-20T20:07:33.094 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 100/131 2022-09-20T20:07:33.094 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 101/131 2022-09-20T20:07:33.095 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 102/131 2022-09-20T20:07:33.095 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 103/131 2022-09-20T20:07:33.095 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 104/131 2022-09-20T20:07:33.095 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 105/131 2022-09-20T20:07:33.096 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 106/131 2022-09-20T20:07:33.096 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 107/131 2022-09-20T20:07:33.096 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 108/131 2022-09-20T20:07:33.096 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 109/131 2022-09-20T20:07:33.097 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 110/131 2022-09-20T20:07:33.097 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 111/131 2022-09-20T20:07:33.097 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 112/131 2022-09-20T20:07:33.098 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 113/131 2022-09-20T20:07:33.098 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-2.6-1.el8.noarch 114/131 2022-09-20T20:07:33.098 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 115/131 2022-09-20T20:07:33.098 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 116/131 2022-09-20T20:07:33.099 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 117/131 2022-09-20T20:07:33.099 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 118/131 2022-09-20T20:07:33.099 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 119/131 2022-09-20T20:07:33.099 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 120/131 2022-09-20T20:07:33.099 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 121/131 2022-09-20T20:07:33.100 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 122/131 2022-09-20T20:07:33.100 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 123/131 2022-09-20T20:07:33.100 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 124/131 2022-09-20T20:07:33.100 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 125/131 2022-09-20T20:07:33.101 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 126/131 2022-09-20T20:07:33.101 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 127/131 2022-09-20T20:07:33.101 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:17.0.0-15134.gada1013c.el8.x86_64 128/131 2022-09-20T20:07:33.102 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/131 2022-09-20T20:07:33.102 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:17.0.0-15134.gada1013c.el8.x86_64 130/131 2022-09-20T20:07:34.792 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/131 2022-09-20T20:07:34.793 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:34.793 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2022-09-20T20:07:34.793 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.794 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.794 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2022-09-20T20:07:34.794 INFO:teuthology.orchestra.run.smithi152.stdout: automake-1.16.1-7.el8.noarch 2022-09-20T20:07:34.794 INFO:teuthology.orchestra.run.smithi152.stdout: bison-3.0.4-10.el8.x86_64 2022-09-20T20:07:34.795 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.795 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.795 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.795 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.796 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:34.796 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.796 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.796 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.796 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:34.797 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:34.797 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:34.797 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:34.797 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:34.798 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.798 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.798 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:34.798 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.798 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.799 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.799 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:34.799 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:34.799 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.800 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top-2:17.0.0-15134.gada1013c.el8.noarch 2022-09-20T20:07:34.800 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel-0.187-4.el8.x86_64 2022-09-20T20:07:34.800 INFO:teuthology.orchestra.run.smithi152.stdout: flex-2.6.1-9.el8.x86_64 2022-09-20T20:07:34.800 INFO:teuthology.orchestra.run.smithi152.stdout: fuse-2.9.7-16.el8.x86_64 2022-09-20T20:07:34.800 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-09-20T20:07:34.801 INFO:teuthology.orchestra.run.smithi152.stdout: jq-1.6-3.el8.x86_64 2022-09-20T20:07:34.801 INFO:teuthology.orchestra.run.smithi152.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-09-20T20:07:34.801 INFO:teuthology.orchestra.run.smithi152.stdout: krb5-devel-1.18.2-21.el8.x86_64 2022-09-20T20:07:34.801 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-09-20T20:07:34.802 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.802 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.802 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.802 INFO:teuthology.orchestra.run.smithi152.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2022-09-20T20:07:34.803 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-8.5.0-15.el8.x86_64 2022-09-20T20:07:34.803 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.2-3.el8.x86_64 2022-09-20T20:07:34.803 INFO:teuthology.orchestra.run.smithi152.stdout: libpq-13.5-1.el8.x86_64 2022-09-20T20:07:34.803 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-8.5.0-15.el8.x86_64 2022-09-20T20:07:34.804 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-09-20T20:07:34.804 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.804 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.804 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-09-20T20:07:34.805 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.805 INFO:teuthology.orchestra.run.smithi152.stdout: libselinux-devel-2.9-6.el8.x86_64 2022-09-20T20:07:34.805 INFO:teuthology.orchestra.run.smithi152.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-09-20T20:07:34.805 INFO:teuthology.orchestra.run.smithi152.stdout: libtool-2.4.6-25.el8.x86_64 2022-09-20T20:07:34.805 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.3.1-3.el8.x86_64 2022-09-20T20:07:34.806 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel-2.32.1-38.el8.x86_64 2022-09-20T20:07:34.806 INFO:teuthology.orchestra.run.smithi152.stdout: libverto-devel-0.3.2-2.el8.x86_64 2022-09-20T20:07:34.806 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-09-20T20:07:34.806 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-09-20T20:07:34.807 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.15-4.el8.x86_64 2022-09-20T20:07:34.807 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-threads-0.3.15-4.el8.x86_64 2022-09-20T20:07:34.807 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel-1:1.1.1k-7.el8.x86_64 2022-09-20T20:07:34.807 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-devel-10.32-3.el8.x86_64 2022-09-20T20:07:34.807 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf16-10.32-3.el8.x86_64 2022-09-20T20:07:34.808 INFO:teuthology.orchestra.run.smithi152.stdout: pcre2-utf32-10.32-3.el8.x86_64 2022-09-20T20:07:34.808 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2022-09-20T20:07:34.808 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2022-09-20T20:07:34.808 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server-10.19-1.module_el8.6.0+1047+4202cf9a.x86_64 2022-09-20T20:07:34.808 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-09-20T20:07:34.809 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.5.1-7.el8.noarch 2022-09-20T20:07:34.809 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-09-20T20:07:34.809 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-09-20T20:07:34.809 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-09-20T20:07:34.810 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.810 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.810 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.810 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-09-20T20:07:34.811 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-09-20T20:07:34.811 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-09-20T20:07:34.811 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-09-20T20:07:34.812 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-09-20T20:07:34.812 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-09-20T20:07:34.812 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-6.2-6.el8.noarch 2022-09-20T20:07:34.812 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-09-20T20:07:34.813 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-09-20T20:07:34.813 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-09-20T20:07:34.813 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-09-20T20:07:34.813 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-09-20T20:07:34.813 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-09-20T20:07:34.814 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-09-20T20:07:34.814 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.0.6-13.el8.noarch 2022-09-20T20:07:34.814 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-09-20T20:07:34.814 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-09-20T20:07:34.815 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-09-20T20:07:34.815 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-09-20T20:07:34.815 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-09-20T20:07:34.815 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-09-20T20:07:34.815 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-09-20T20:07:34.816 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-2.6-1.el8.noarch 2022-09-20T20:07:34.816 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-09-20T20:07:34.816 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-09-20T20:07:34.816 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-09-20T20:07:34.816 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-09-20T20:07:34.817 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.14-14.el8.noarch 2022-09-20T20:07:34.817 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2017.2-9.el8.noarch 2022-09-20T20:07:34.817 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.817 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.818 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-09-20T20:07:34.818 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-09-20T20:07:34.818 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.819 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.4.1-12.el8.noarch 2022-09-20T20:07:34.819 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.8-1.el8.noarch 2022-09-20T20:07:34.819 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2022-09-20T20:07:34.819 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-09-20T20:07:34.820 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-09-20T20:07:34.820 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-09-20T20:07:34.820 INFO:teuthology.orchestra.run.smithi152.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-09-20T20:07:34.821 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-09-20T20:07:34.821 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-09-20T20:07:34.821 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-09-20T20:07:34.821 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-09-20T20:07:34.821 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-09-20T20:07:34.822 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-09-20T20:07:34.822 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.822 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.822 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:17.0.0-15134.gada1013c.el8.x86_64 2022-09-20T20:07:34.823 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-1.el8.x86_64 2022-09-20T20:07:34.823 INFO:teuthology.orchestra.run.smithi152.stdout: thrift-0.13.0-2.el8.x86_64 2022-09-20T20:07:34.823 INFO:teuthology.orchestra.run.smithi152.stdout: uuid-1.6.2-43.el8.x86_64 2022-09-20T20:07:34.823 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-09-20T20:07:34.823 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2022-09-20T20:07:34.824 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel-1.2.11-20.el8.x86_64 2022-09-20T20:07:34.824 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:34.825 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2022-09-20T20:07:34.973 DEBUG:teuthology.parallel:result is None 2022-09-20T20:07:34.974 DEBUG:teuthology.orchestra.run.smithi152:> sudo lsb_release -is 2022-09-20T20:07:35.017 INFO:teuthology.orchestra.run.smithi152.stdout:CentOSStream 2022-09-20T20:07:35.018 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-09-20T20:07:35.019 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ada1013c357729fc3bf91fdc0bbe1d411f5af166 2022-09-20T20:07:35.234 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-09-20T20:07:35.258 INFO:teuthology.orchestra.run.smithi152.stdout:17.0.0-15134.gada1013c.el8 2022-09-20T20:07:35.260 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-15134.gada1013c.el8 2022-09-20T20:07:35.261 INFO:teuthology.task.install:The correct ceph version 17.0.0-15134.gada1013c is installed. 2022-09-20T20:07:35.261 DEBUG:teuthology.orchestra.run.smithi171:> sudo lsb_release -is 2022-09-20T20:07:35.306 INFO:teuthology.orchestra.run.smithi171.stdout:CentOSStream 2022-09-20T20:07:35.308 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-09-20T20:07:35.309 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=ada1013c357729fc3bf91fdc0bbe1d411f5af166 2022-09-20T20:07:35.529 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-09-20T20:07:35.554 INFO:teuthology.orchestra.run.smithi171.stdout:17.0.0-15134.gada1013c.el8 2022-09-20T20:07:35.555 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-15134.gada1013c.el8 2022-09-20T20:07:35.555 INFO:teuthology.task.install:The correct ceph version 17.0.0-15134.gada1013c is installed. 2022-09-20T20:07:35.556 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-09-20T20:07:35.556 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:07:35.557 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-09-20T20:07:35.585 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:07:35.586 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-09-20T20:07:35.623 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-09-20T20:07:35.624 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:07:35.624 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2022-09-20T20:07:35.653 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-09-20T20:07:35.722 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:07:35.723 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2022-09-20T20:07:35.751 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-09-20T20:07:35.817 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-09-20T20:07:35.818 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:07:35.819 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2022-09-20T20:07:35.845 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-09-20T20:07:35.913 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:07:35.913 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2022-09-20T20:07:35.941 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-09-20T20:07:36.009 INFO:teuthology.run_tasks:Running task ceph... 2022-09-20T20:07:36.089 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2022-09-20T20:07:36.091 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /var/log/ceph 2022-09-20T20:07:36.093 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /var/log/ceph 2022-09-20T20:07:36.120 INFO:tasks.ceph:Disabling ceph logrotate... 2022-09-20T20:07:36.121 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/logrotate.d/ceph 2022-09-20T20:07:36.160 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/logrotate.d/ceph 2022-09-20T20:07:36.187 INFO:tasks.ceph:Creating extra log directories... 2022-09-20T20:07:36.187 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-09-20T20:07:36.228 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-09-20T20:07:36.269 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2022-09-20T20:07:36.270 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2022-09-20T20:07:36.271 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2022-09-20T20:07:36.271 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:07:36.272 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-09-20T20:07:36.312 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-09-20T20:07:36.430 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-09-20T20:07:36.459 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:07:36.460 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-09-20T20:07:36.478 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-09-20T20:07:36.592 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-09-20T20:07:36.626 INFO:tasks.ceph:Creating ceph cluster ceph... 2022-09-20T20:07:36.627 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'MDS_FAILED', 'MDS_DAMAGE'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2022-09-20T20:07:36.628 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2022-09-20_19:41:25-fs:functional-wip-pdonnell-testing-20220920.151129-distro-default-smithi/7039472', 'branch': 'wip-pdonnell-testing-20220920.151129', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/alternate-pool}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7039472', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2022-09-20_19:41:25-fs:functional-wip-pdonnell-testing-20220920.151129-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20220920.151129'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'MDS_FAILED', 'MDS_DAMAGE'], 'sha1': 'ada1013c357729fc3bf91fdc0bbe1d411f5af166'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ada1013c357729fc3bf91fdc0bbe1d411f5af166'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20220920.151129', 'sha1': '7874f3907d0b2e2027e668918a6854269060504f'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 50, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'ada1013c357729fc3bf91fdc0bbe1d411f5af166', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-pdonnell-testing-20220920.151129', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_7874f3907d0b2e2027e668918a6854269060504f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': '7874f3907d0b2e2027e668918a6854269060504f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi152.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE/F8K8Za/2CRN6wLkYLnpTdbukjQ8j7gkHRHTTxDeHnfd3KeqFsd500IrnLzySnB4/KkMjwg2pcg1ZbyVGR78k=', 'smithi171.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHFlxhl2xZ+i+ISK05p/Dpv2xzBni/JcKaTXyhk4D2IYI1oRTFxscU/FtwTQllPmDbUSvhbF0dkje9awkfo9xpo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ada1013c357729fc3bf91fdc0bbe1d411f5af166'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_recovery_pool']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'b58f2c18636eb10faa77ed3614abd00cb85dfc2c', 'timestamp': '2022-09-20_19:41:25', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.14413'} 2022-09-20T20:07:36.629 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-09-20T20:07:36.632 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-09-20T20:07:36.679 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/run/ceph 2022-09-20T20:07:36.690 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/run/ceph 2022-09-20T20:07:36.745 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:07:36.746 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2022-09-20T20:07:36.774 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-09-20T20:07:36.775 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-09-20T20:07:36.832 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-09-20T20:07:36.832 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-20T20:07:36.833 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 363515 Links: 1 2022-09-20T20:07:36.833 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-20T20:07:36.833 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2022-09-20T20:07:36.834 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2022-09-20 20:07:32.739470220 +0000 2022-09-20T20:07:36.834 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2022-09-20 20:05:02.952741895 +0000 2022-09-20T20:07:36.835 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2022-09-20 20:05:02.952741895 +0000 2022-09-20T20:07:36.835 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2022-09-20T20:07:36.841 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2022-09-20T20:07:36.841 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2022-09-20T20:07:36.842 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000261947 s, 2.0 MB/s 2022-09-20T20:07:36.845 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-09-20T20:07:36.903 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-09-20T20:07:36.904 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-20T20:07:36.904 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 367726 Links: 1 2022-09-20T20:07:36.904 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-20T20:07:36.904 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2022-09-20T20:07:36.905 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2022-09-20 20:07:32.739470220 +0000 2022-09-20T20:07:36.905 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2022-09-20 20:05:03.498735533 +0000 2022-09-20T20:07:36.905 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2022-09-20 20:05:03.498735533 +0000 2022-09-20T20:07:36.905 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2022-09-20T20:07:36.912 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2022-09-20T20:07:36.912 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2022-09-20T20:07:36.913 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.00024368 s, 2.1 MB/s 2022-09-20T20:07:36.915 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-09-20T20:07:36.973 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-09-20T20:07:36.974 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-20T20:07:36.974 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 366810 Links: 1 2022-09-20T20:07:36.974 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-20T20:07:36.975 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2022-09-20T20:07:36.975 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2022-09-20 20:07:32.739470220 +0000 2022-09-20T20:07:36.975 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2022-09-20 20:05:04.036729265 +0000 2022-09-20T20:07:36.975 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2022-09-20 20:05:04.036729265 +0000 2022-09-20T20:07:36.976 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2022-09-20T20:07:36.983 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2022-09-20T20:07:36.983 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2022-09-20T20:07:36.984 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000185519 s, 2.8 MB/s 2022-09-20T20:07:36.986 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-09-20T20:07:37.045 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-09-20T20:07:37.045 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-20T20:07:37.046 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 6h/6d Inode: 368991 Links: 1 2022-09-20T20:07:37.046 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-20T20:07:37.047 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2022-09-20T20:07:37.047 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2022-09-20 20:07:32.739470220 +0000 2022-09-20T20:07:37.048 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2022-09-20 20:05:04.585722868 +0000 2022-09-20T20:07:37.048 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2022-09-20 20:05:04.585722868 +0000 2022-09-20T20:07:37.049 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: - 2022-09-20T20:07:37.054 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2022-09-20T20:07:37.054 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2022-09-20T20:07:37.054 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000209955 s, 2.4 MB/s 2022-09-20T20:07:37.057 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-09-20T20:07:37.058 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:07:37.058 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2022-09-20T20:07:37.078 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-09-20T20:07:37.078 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-09-20T20:07:37.135 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-09-20T20:07:37.135 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-20T20:07:37.135 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 361849 Links: 1 2022-09-20T20:07:37.136 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-20T20:07:37.136 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2022-09-20T20:07:37.136 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2022-09-20 20:07:28.638792275 +0000 2022-09-20T20:07:37.136 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2022-09-20 20:05:02.942002024 +0000 2022-09-20T20:07:37.137 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2022-09-20 20:05:02.942002024 +0000 2022-09-20T20:07:37.137 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2022-09-20T20:07:37.144 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2022-09-20T20:07:37.144 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2022-09-20T20:07:37.145 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000257448 s, 2.0 MB/s 2022-09-20T20:07:37.147 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-09-20T20:07:37.205 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-09-20T20:07:37.206 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-20T20:07:37.206 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 359185 Links: 1 2022-09-20T20:07:37.207 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-20T20:07:37.207 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2022-09-20T20:07:37.208 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2022-09-20 20:07:28.638792275 +0000 2022-09-20T20:07:37.208 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2022-09-20 20:05:03.464992185 +0000 2022-09-20T20:07:37.208 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2022-09-20 20:05:03.464992185 +0000 2022-09-20T20:07:37.209 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2022-09-20T20:07:37.214 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2022-09-20T20:07:37.214 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2022-09-20T20:07:37.215 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000223633 s, 2.3 MB/s 2022-09-20T20:07:37.217 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-09-20T20:07:37.275 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-09-20T20:07:37.275 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-20T20:07:37.276 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 367821 Links: 1 2022-09-20T20:07:37.276 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-20T20:07:37.276 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2022-09-20T20:07:37.277 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2022-09-20 20:07:28.638792275 +0000 2022-09-20T20:07:37.277 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2022-09-20 20:05:03.992982252 +0000 2022-09-20T20:07:37.277 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2022-09-20 20:05:03.992982252 +0000 2022-09-20T20:07:37.277 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2022-09-20T20:07:37.284 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2022-09-20T20:07:37.285 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2022-09-20T20:07:37.285 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.00020978 s, 2.4 MB/s 2022-09-20T20:07:37.288 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-09-20T20:07:37.346 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-09-20T20:07:37.346 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-09-20T20:07:37.347 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 362016 Links: 1 2022-09-20T20:07:37.347 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-09-20T20:07:37.347 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2022-09-20T20:07:37.347 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2022-09-20 20:07:28.639792256 +0000 2022-09-20T20:07:37.348 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2022-09-20 20:05:04.516972395 +0000 2022-09-20T20:07:37.348 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2022-09-20 20:05:04.516972395 +0000 2022-09-20T20:07:37.348 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2022-09-20T20:07:37.355 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2022-09-20T20:07:37.355 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2022-09-20T20:07:37.356 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.00030358 s, 1.7 MB/s 2022-09-20T20:07:37.358 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-09-20T20:07:37.358 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-09-20T20:07:37.359 INFO:tasks.ceph:Generating config... 2022-09-20T20:07:37.360 INFO:tasks.ceph:[client] client mount timeout = 600 2022-09-20T20:07:37.361 INFO:tasks.ceph:[client] debug client = 20 2022-09-20T20:07:37.361 INFO:tasks.ceph:[client] debug ms = 1 2022-09-20T20:07:37.361 INFO:tasks.ceph:[client] pid file = 2022-09-20T20:07:37.362 INFO:tasks.ceph:[client] rados mon op timeout = 900 2022-09-20T20:07:37.362 INFO:tasks.ceph:[client] rados osd op timeout = 900 2022-09-20T20:07:37.362 INFO:tasks.ceph:[mds] debug mds = 20 2022-09-20T20:07:37.363 INFO:tasks.ceph:[mds] debug mds balancer = 20 2022-09-20T20:07:37.363 INFO:tasks.ceph:[mds] debug ms = 1 2022-09-20T20:07:37.363 INFO:tasks.ceph:[mds] mds debug frag = True 2022-09-20T20:07:37.364 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2022-09-20T20:07:37.364 INFO:tasks.ceph:[mds] mds op complaint time = 180 2022-09-20T20:07:37.364 INFO:tasks.ceph:[mds] mds verify scatter = True 2022-09-20T20:07:37.365 INFO:tasks.ceph:[mds] osd op complaint time = 180 2022-09-20T20:07:37.365 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2022-09-20T20:07:37.366 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2022-09-20T20:07:37.366 INFO:tasks.ceph:[mgr] debug mgr = 20 2022-09-20T20:07:37.366 INFO:tasks.ceph:[mgr] debug ms = 1 2022-09-20T20:07:37.367 INFO:tasks.ceph:[mon] debug mon = 20 2022-09-20T20:07:37.367 INFO:tasks.ceph:[mon] debug ms = 1 2022-09-20T20:07:37.367 INFO:tasks.ceph:[mon] debug paxos = 20 2022-09-20T20:07:37.368 INFO:tasks.ceph:[mon] mon op complaint time = 120 2022-09-20T20:07:37.368 INFO:tasks.ceph:[osd] bdev async discard = True 2022-09-20T20:07:37.368 INFO:tasks.ceph:[osd] bdev enable discard = True 2022-09-20T20:07:37.369 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2022-09-20T20:07:37.369 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2022-09-20T20:07:37.369 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2022-09-20T20:07:37.370 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2022-09-20T20:07:37.370 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2022-09-20T20:07:37.370 INFO:tasks.ceph:[osd] debug ms = 1 2022-09-20T20:07:37.370 INFO:tasks.ceph:[osd] debug osd = 20 2022-09-20T20:07:37.371 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2022-09-20T20:07:37.371 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2022-09-20T20:07:37.371 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2022-09-20T20:07:37.372 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2022-09-20T20:07:37.372 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2022-09-20T20:07:37.372 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2022-09-20T20:07:37.373 INFO:tasks.ceph:[osd] osd op complaint time = 180 2022-09-20T20:07:37.373 INFO:tasks.ceph:Setting up mon.a... 2022-09-20T20:07:37.373 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2022-09-20T20:07:37.421 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.keyring 2022-09-20T20:07:37.424 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2022-09-20T20:07:37.469 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-09-20T20:07:37.537 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.152'), ('mon.b', '172.21.15.171'), ('mon.c', '[v2:172.21.15.171:3301,v1:172.21.15.171:6790]')] 2022-09-20T20:07:37.537 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.152,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2022-09-20T20:07:37.539 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:07:37.539 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2022-09-20T20:07:37.595 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.152 --add b 172.21.15.171 --addv c '[v2:172.21.15.171:3301,v1:172.21.15.171:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:07:37.683 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:07:37.684 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool: generated fsid 065d03fa-a408-48e8-87c7-c58c779882b2 2022-09-20T20:07:37.684 INFO:teuthology.orchestra.run.smithi152.stdout:setting min_mon_release = octopus 2022-09-20T20:07:37.684 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 0 2022-09-20T20:07:37.684 INFO:teuthology.orchestra.run.smithi152.stdout:fsid 065d03fa-a408-48e8-87c7-c58c779882b2 2022-09-20T20:07:37.685 INFO:teuthology.orchestra.run.smithi152.stdout:last_changed 2022-09-20T20:07:37.682929+0000 2022-09-20T20:07:37.685 INFO:teuthology.orchestra.run.smithi152.stdout:created 2022-09-20T20:07:37.682929+0000 2022-09-20T20:07:37.685 INFO:teuthology.orchestra.run.smithi152.stdout:min_mon_release 15 (octopus) 2022-09-20T20:07:37.686 INFO:teuthology.orchestra.run.smithi152.stdout:election_strategy: 1 2022-09-20T20:07:37.686 INFO:teuthology.orchestra.run.smithi152.stdout:0: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.a 2022-09-20T20:07:37.686 INFO:teuthology.orchestra.run.smithi152.stdout:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2022-09-20T20:07:37.687 INFO:teuthology.orchestra.run.smithi152.stdout:2: [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] mon.c 2022-09-20T20:07:37.687 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2022-09-20T20:07:37.689 DEBUG:teuthology.orchestra.run.smithi152:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2022-09-20T20:07:37.707 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 065d03fa-a408-48e8-87c7-c58c779882b2... 2022-09-20T20:07:37.708 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-09-20T20:07:37.750 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-09-20T20:07:37.792 INFO:teuthology.orchestra.run.smithi152.stdout:[global] 2022-09-20T20:07:37.793 INFO:teuthology.orchestra.run.smithi152.stdout: chdir = "" 2022-09-20T20:07:37.794 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-09-20T20:07:37.794 INFO:teuthology.orchestra.run.smithi152.stdout: auth supported = cephx 2022-09-20T20:07:37.795 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.795 INFO:teuthology.orchestra.run.smithi152.stdout: filestore xattr use omap = true 2022-09-20T20:07:37.796 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.796 INFO:teuthology.orchestra.run.smithi152.stdout: mon clock drift allowed = 1.000 2022-09-20T20:07:37.797 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.797 INFO:teuthology.orchestra.run.smithi152.stdout: osd crush chooseleaf type = 0 2022-09-20T20:07:37.797 INFO:teuthology.orchestra.run.smithi152.stdout: auth debug = true 2022-09-20T20:07:37.798 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.798 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on old message = true 2022-09-20T20:07:37.799 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on bug = true 2022-09-20T20:07:37.799 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.800 INFO:teuthology.orchestra.run.smithi152.stdout: mon max pg per osd = 10000 # >= luminous 2022-09-20T20:07:37.800 INFO:teuthology.orchestra.run.smithi152.stdout: mon pg warn max object skew = 0 2022-09-20T20:07:37.801 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.801 INFO:teuthology.orchestra.run.smithi152.stdout: # disable pg_autoscaler by default for new pools 2022-09-20T20:07:37.802 INFO:teuthology.orchestra.run.smithi152.stdout: osd_pool_default_pg_autoscale_mode = off 2022-09-20T20:07:37.802 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.803 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default size = 2 2022-09-20T20:07:37.803 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.804 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow primary affinity = true 2022-09-20T20:07:37.804 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow pg remap = true 2022-09-20T20:07:37.804 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on legacy crush tunables = false 2022-09-20T20:07:37.805 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on crush straw calc version zero = false 2022-09-20T20:07:37.805 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on no sortbitwise = false 2022-09-20T20:07:37.806 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on osd down out interval zero = false 2022-09-20T20:07:37.806 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on too few osds = false 2022-09-20T20:07:37.807 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-09-20T20:07:37.807 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_no_redundancy = false 2022-09-20T20:07:37.807 INFO:teuthology.orchestra.run.smithi152.stdout: mon_allow_pool_size_one = true 2022-09-20T20:07:37.808 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.808 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-09-20T20:07:37.808 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.808 INFO:teuthology.orchestra.run.smithi152.stdout: osd default data pool replay window = 5 2022-09-20T20:07:37.809 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.809 INFO:teuthology.orchestra.run.smithi152.stdout: mon allow pool delete = true 2022-09-20T20:07:37.809 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.809 INFO:teuthology.orchestra.run.smithi152.stdout: mon cluster log file level = debug 2022-09-20T20:07:37.809 INFO:teuthology.orchestra.run.smithi152.stdout: debug asserts on shutdown = true 2022-09-20T20:07:37.810 INFO:teuthology.orchestra.run.smithi152.stdout: mon health detail to clog = false 2022-09-20T20:07:37.810 INFO:teuthology.orchestra.run.smithi152.stdout: mon host = "172.21.15.152,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2022-09-20T20:07:37.810 INFO:teuthology.orchestra.run.smithi152.stdout: fsid = 065d03fa-a408-48e8-87c7-c58c779882b2 2022-09-20T20:07:37.811 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.811 INFO:teuthology.orchestra.run.smithi152.stdout:[osd] 2022-09-20T20:07:37.811 INFO:teuthology.orchestra.run.smithi152.stdout: osd journal size = 100 2022-09-20T20:07:37.811 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.812 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub load threshold = 5.0 2022-09-20T20:07:37.812 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub max interval = 600 2022-09-20T20:07:37.812 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.812 INFO:teuthology.orchestra.run.smithi152.stdout: osd recover clone overlap = true 2022-09-20T20:07:37.813 INFO:teuthology.orchestra.run.smithi152.stdout: osd recovery max chunk = 1048576 2022-09-20T20:07:37.813 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.813 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug shutdown = true 2022-09-20T20:07:37.813 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug op order = true 2022-09-20T20:07:37.813 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify stray on activate = true 2022-09-20T20:07:37.814 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.814 INFO:teuthology.orchestra.run.smithi152.stdout: osd open classes on start = true 2022-09-20T20:07:37.814 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug pg log writeout = true 2022-09-20T20:07:37.814 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.815 INFO:teuthology.orchestra.run.smithi152.stdout: osd deep scrub update digest min age = 30 2022-09-20T20:07:37.815 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.815 INFO:teuthology.orchestra.run.smithi152.stdout: osd map max advance = 10 2022-09-20T20:07:37.815 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.816 INFO:teuthology.orchestra.run.smithi152.stdout: journal zero on create = true 2022-09-20T20:07:37.816 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.816 INFO:teuthology.orchestra.run.smithi152.stdout: filestore ondisk finisher threads = 3 2022-09-20T20:07:37.816 INFO:teuthology.orchestra.run.smithi152.stdout: filestore apply finisher threads = 3 2022-09-20T20:07:37.816 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.817 INFO:teuthology.orchestra.run.smithi152.stdout: bdev debug aio = true 2022-09-20T20:07:37.817 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug misdirected ops = true 2022-09-20T20:07:37.817 INFO:teuthology.orchestra.run.smithi152.stdout: bdev async discard = True 2022-09-20T20:07:37.817 INFO:teuthology.orchestra.run.smithi152.stdout: bdev enable discard = True 2022-09-20T20:07:37.817 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore allocator = bitmap 2022-09-20T20:07:37.818 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore block size = 96636764160 2022-09-20T20:07:37.818 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore fsck on mount = True 2022-09-20T20:07:37.818 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluefs = 1/20 2022-09-20T20:07:37.818 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluestore = 1/20 2022-09-20T20:07:37.819 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2022-09-20T20:07:37.819 INFO:teuthology.orchestra.run.smithi152.stdout: debug osd = 20 2022-09-20T20:07:37.819 INFO:teuthology.orchestra.run.smithi152.stdout: debug rocksdb = 4/10 2022-09-20T20:07:37.819 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd backfillfull_ratio = 0.85 2022-09-20T20:07:37.820 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd full ratio = 0.9 2022-09-20T20:07:37.820 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd nearfull ratio = 0.8 2022-09-20T20:07:37.820 INFO:teuthology.orchestra.run.smithi152.stdout: osd failsafe full ratio = 0.95 2022-09-20T20:07:37.820 INFO:teuthology.orchestra.run.smithi152.stdout: osd objectstore = bluestore 2022-09-20T20:07:37.821 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2022-09-20T20:07:37.821 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.821 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr] 2022-09-20T20:07:37.821 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2022-09-20T20:07:37.822 INFO:teuthology.orchestra.run.smithi152.stdout: debug mgr = 20 2022-09-20T20:07:37.822 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2022-09-20T20:07:37.822 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2022-09-20T20:07:37.822 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2022-09-20T20:07:37.823 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2022-09-20T20:07:37.823 INFO:teuthology.orchestra.run.smithi152.stdout: mgr/telemetry/nag = false 2022-09-20T20:07:37.823 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.823 INFO:teuthology.orchestra.run.smithi152.stdout:[mon] 2022-09-20T20:07:37.824 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2022-09-20T20:07:37.824 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2022-09-20T20:07:37.824 INFO:teuthology.orchestra.run.smithi152.stdout: debug paxos = 20 2022-09-20T20:07:37.825 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2022-09-20T20:07:37.825 INFO:teuthology.orchestra.run.smithi152.stdout: mon data avail warn = 5 2022-09-20T20:07:37.825 INFO:teuthology.orchestra.run.smithi152.stdout: mon mgr mkfs grace = 240 2022-09-20T20:07:37.826 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2022-09-20T20:07:37.826 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd reporter subtree level = osd 2022-09-20T20:07:37.826 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd prime pg temp = true 2022-09-20T20:07:37.826 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2022-09-20T20:07:37.827 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.827 INFO:teuthology.orchestra.run.smithi152.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-09-20T20:07:37.827 INFO:teuthology.orchestra.run.smithi152.stdout: auth mon ticket ttl = 660 # 11m 2022-09-20T20:07:37.827 INFO:teuthology.orchestra.run.smithi152.stdout: auth service ticket ttl = 240 # 4m 2022-09-20T20:07:37.828 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.828 INFO:teuthology.orchestra.run.smithi152.stdout: # don't complain about insecure global_id in the test suite 2022-09-20T20:07:37.828 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-09-20T20:07:37.828 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-09-20T20:07:37.829 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.829 INFO:teuthology.orchestra.run.smithi152.stdout: # 1m isn't quite enough 2022-09-20T20:07:37.829 INFO:teuthology.orchestra.run.smithi152.stdout: mon_down_mkfs_grace = 2m 2022-09-20T20:07:37.830 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.830 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_filestore_osds = false 2022-09-20T20:07:37.830 INFO:teuthology.orchestra.run.smithi152.stdout: mon op complaint time = 120 2022-09-20T20:07:37.831 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:07:37.831 INFO:teuthology.orchestra.run.smithi152.stdout:[client] 2022-09-20T20:07:37.831 INFO:teuthology.orchestra.run.smithi152.stdout: rgw cache enabled = true 2022-09-20T20:07:37.831 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable ops log = true 2022-09-20T20:07:37.832 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable usage log = true 2022-09-20T20:07:37.832 INFO:teuthology.orchestra.run.smithi152.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-09-20T20:07:37.832 INFO:teuthology.orchestra.run.smithi152.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-09-20T20:07:37.832 INFO:teuthology.orchestra.run.smithi152.stdout: client mount timeout = 600 2022-09-20T20:07:37.832 INFO:teuthology.orchestra.run.smithi152.stdout: debug client = 20 2022-09-20T20:07:37.833 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2022-09-20T20:07:37.833 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = "" 2022-09-20T20:07:37.833 INFO:teuthology.orchestra.run.smithi152.stdout: rados mon op timeout = 900 2022-09-20T20:07:37.833 INFO:teuthology.orchestra.run.smithi152.stdout: rados osd op timeout = 900 2022-09-20T20:07:37.834 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.a] 2022-09-20T20:07:37.834 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.b] 2022-09-20T20:07:37.834 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.c] 2022-09-20T20:07:37.834 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.a] 2022-09-20T20:07:37.834 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.c] 2022-09-20T20:07:37.835 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.b] 2022-09-20T20:07:37.835 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.d] 2022-09-20T20:07:37.835 INFO:teuthology.orchestra.run.smithi152.stdout:[mds] 2022-09-20T20:07:37.835 INFO:teuthology.orchestra.run.smithi152.stdout: debug mds = 20 2022-09-20T20:07:37.836 INFO:teuthology.orchestra.run.smithi152.stdout: debug mds balancer = 20 2022-09-20T20:07:37.836 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2022-09-20T20:07:37.836 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug frag = True 2022-09-20T20:07:37.836 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug scatterstat = True 2022-09-20T20:07:37.836 INFO:teuthology.orchestra.run.smithi152.stdout: mds op complaint time = 180 2022-09-20T20:07:37.837 INFO:teuthology.orchestra.run.smithi152.stdout: mds verify scatter = True 2022-09-20T20:07:37.837 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2022-09-20T20:07:37.837 INFO:teuthology.orchestra.run.smithi152.stdout: rados mon op timeout = 900 2022-09-20T20:07:37.837 INFO:teuthology.orchestra.run.smithi152.stdout: rados osd op timeout = 900 2022-09-20T20:07:37.839 INFO:teuthology.orchestra.run.smithi171.stdout:[global] 2022-09-20T20:07:37.840 INFO:teuthology.orchestra.run.smithi171.stdout: chdir = "" 2022-09-20T20:07:37.840 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-09-20T20:07:37.840 INFO:teuthology.orchestra.run.smithi171.stdout: auth supported = cephx 2022-09-20T20:07:37.840 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.841 INFO:teuthology.orchestra.run.smithi171.stdout: filestore xattr use omap = true 2022-09-20T20:07:37.841 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.841 INFO:teuthology.orchestra.run.smithi171.stdout: mon clock drift allowed = 1.000 2022-09-20T20:07:37.841 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.842 INFO:teuthology.orchestra.run.smithi171.stdout: osd crush chooseleaf type = 0 2022-09-20T20:07:37.842 INFO:teuthology.orchestra.run.smithi171.stdout: auth debug = true 2022-09-20T20:07:37.842 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.842 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on old message = true 2022-09-20T20:07:37.842 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on bug = true 2022-09-20T20:07:37.843 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.843 INFO:teuthology.orchestra.run.smithi171.stdout: mon max pg per osd = 10000 # >= luminous 2022-09-20T20:07:37.843 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn max object skew = 0 2022-09-20T20:07:37.843 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.844 INFO:teuthology.orchestra.run.smithi171.stdout: # disable pg_autoscaler by default for new pools 2022-09-20T20:07:37.844 INFO:teuthology.orchestra.run.smithi171.stdout: osd_pool_default_pg_autoscale_mode = off 2022-09-20T20:07:37.844 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.844 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default size = 2 2022-09-20T20:07:37.845 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.845 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow primary affinity = true 2022-09-20T20:07:37.845 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow pg remap = true 2022-09-20T20:07:37.845 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on legacy crush tunables = false 2022-09-20T20:07:37.845 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on crush straw calc version zero = false 2022-09-20T20:07:37.846 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on no sortbitwise = false 2022-09-20T20:07:37.846 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on osd down out interval zero = false 2022-09-20T20:07:37.846 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on too few osds = false 2022-09-20T20:07:37.847 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-09-20T20:07:37.847 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_no_redundancy = false 2022-09-20T20:07:37.847 INFO:teuthology.orchestra.run.smithi171.stdout: mon_allow_pool_size_one = true 2022-09-20T20:07:37.848 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.848 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-09-20T20:07:37.848 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.848 INFO:teuthology.orchestra.run.smithi171.stdout: osd default data pool replay window = 5 2022-09-20T20:07:37.848 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.849 INFO:teuthology.orchestra.run.smithi171.stdout: mon allow pool delete = true 2022-09-20T20:07:37.849 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.849 INFO:teuthology.orchestra.run.smithi171.stdout: mon cluster log file level = debug 2022-09-20T20:07:37.849 INFO:teuthology.orchestra.run.smithi171.stdout: debug asserts on shutdown = true 2022-09-20T20:07:37.850 INFO:teuthology.orchestra.run.smithi171.stdout: mon health detail to clog = false 2022-09-20T20:07:37.850 INFO:teuthology.orchestra.run.smithi171.stdout: mon host = "172.21.15.152,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2022-09-20T20:07:37.850 INFO:teuthology.orchestra.run.smithi171.stdout: fsid = 065d03fa-a408-48e8-87c7-c58c779882b2 2022-09-20T20:07:37.850 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.851 INFO:teuthology.orchestra.run.smithi171.stdout:[osd] 2022-09-20T20:07:37.851 INFO:teuthology.orchestra.run.smithi171.stdout: osd journal size = 100 2022-09-20T20:07:37.851 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.852 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub load threshold = 5.0 2022-09-20T20:07:37.852 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub max interval = 600 2022-09-20T20:07:37.852 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.852 INFO:teuthology.orchestra.run.smithi171.stdout: osd recover clone overlap = true 2022-09-20T20:07:37.853 INFO:teuthology.orchestra.run.smithi171.stdout: osd recovery max chunk = 1048576 2022-09-20T20:07:37.853 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.853 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug shutdown = true 2022-09-20T20:07:37.854 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug op order = true 2022-09-20T20:07:37.854 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify stray on activate = true 2022-09-20T20:07:37.854 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.854 INFO:teuthology.orchestra.run.smithi171.stdout: osd open classes on start = true 2022-09-20T20:07:37.855 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug pg log writeout = true 2022-09-20T20:07:37.855 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.855 INFO:teuthology.orchestra.run.smithi171.stdout: osd deep scrub update digest min age = 30 2022-09-20T20:07:37.856 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.856 INFO:teuthology.orchestra.run.smithi171.stdout: osd map max advance = 10 2022-09-20T20:07:37.856 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.856 INFO:teuthology.orchestra.run.smithi171.stdout: journal zero on create = true 2022-09-20T20:07:37.857 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.857 INFO:teuthology.orchestra.run.smithi171.stdout: filestore ondisk finisher threads = 3 2022-09-20T20:07:37.857 INFO:teuthology.orchestra.run.smithi171.stdout: filestore apply finisher threads = 3 2022-09-20T20:07:37.857 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.857 INFO:teuthology.orchestra.run.smithi171.stdout: bdev debug aio = true 2022-09-20T20:07:37.858 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug misdirected ops = true 2022-09-20T20:07:37.858 INFO:teuthology.orchestra.run.smithi171.stdout: bdev async discard = True 2022-09-20T20:07:37.858 INFO:teuthology.orchestra.run.smithi171.stdout: bdev enable discard = True 2022-09-20T20:07:37.858 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore allocator = bitmap 2022-09-20T20:07:37.859 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore block size = 96636764160 2022-09-20T20:07:37.859 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore fsck on mount = True 2022-09-20T20:07:37.859 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluefs = 1/20 2022-09-20T20:07:37.859 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluestore = 1/20 2022-09-20T20:07:37.860 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2022-09-20T20:07:37.860 INFO:teuthology.orchestra.run.smithi171.stdout: debug osd = 20 2022-09-20T20:07:37.860 INFO:teuthology.orchestra.run.smithi171.stdout: debug rocksdb = 4/10 2022-09-20T20:07:37.860 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd backfillfull_ratio = 0.85 2022-09-20T20:07:37.860 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd full ratio = 0.9 2022-09-20T20:07:37.861 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd nearfull ratio = 0.8 2022-09-20T20:07:37.861 INFO:teuthology.orchestra.run.smithi171.stdout: osd failsafe full ratio = 0.95 2022-09-20T20:07:37.861 INFO:teuthology.orchestra.run.smithi171.stdout: osd objectstore = bluestore 2022-09-20T20:07:37.861 INFO:teuthology.orchestra.run.smithi171.stdout: osd op complaint time = 180 2022-09-20T20:07:37.862 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.862 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr] 2022-09-20T20:07:37.862 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2022-09-20T20:07:37.862 INFO:teuthology.orchestra.run.smithi171.stdout: debug mgr = 20 2022-09-20T20:07:37.863 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2022-09-20T20:07:37.863 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2022-09-20T20:07:37.863 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2022-09-20T20:07:37.863 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2022-09-20T20:07:37.864 INFO:teuthology.orchestra.run.smithi171.stdout: mgr/telemetry/nag = false 2022-09-20T20:07:37.864 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.864 INFO:teuthology.orchestra.run.smithi171.stdout:[mon] 2022-09-20T20:07:37.865 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2022-09-20T20:07:37.865 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2022-09-20T20:07:37.865 INFO:teuthology.orchestra.run.smithi171.stdout: debug paxos = 20 2022-09-20T20:07:37.865 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2022-09-20T20:07:37.866 INFO:teuthology.orchestra.run.smithi171.stdout: mon data avail warn = 5 2022-09-20T20:07:37.866 INFO:teuthology.orchestra.run.smithi171.stdout: mon mgr mkfs grace = 240 2022-09-20T20:07:37.866 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2022-09-20T20:07:37.866 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd reporter subtree level = osd 2022-09-20T20:07:37.866 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd prime pg temp = true 2022-09-20T20:07:37.867 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2022-09-20T20:07:37.867 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.867 INFO:teuthology.orchestra.run.smithi171.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-09-20T20:07:37.867 INFO:teuthology.orchestra.run.smithi171.stdout: auth mon ticket ttl = 660 # 11m 2022-09-20T20:07:37.868 INFO:teuthology.orchestra.run.smithi171.stdout: auth service ticket ttl = 240 # 4m 2022-09-20T20:07:37.868 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.868 INFO:teuthology.orchestra.run.smithi171.stdout: # don't complain about insecure global_id in the test suite 2022-09-20T20:07:37.868 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-09-20T20:07:37.868 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-09-20T20:07:37.869 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.869 INFO:teuthology.orchestra.run.smithi171.stdout: # 1m isn't quite enough 2022-09-20T20:07:37.869 INFO:teuthology.orchestra.run.smithi171.stdout: mon_down_mkfs_grace = 2m 2022-09-20T20:07:37.869 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.870 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_filestore_osds = false 2022-09-20T20:07:37.870 INFO:teuthology.orchestra.run.smithi171.stdout: mon op complaint time = 120 2022-09-20T20:07:37.870 INFO:teuthology.orchestra.run.smithi171.stdout: 2022-09-20T20:07:37.870 INFO:teuthology.orchestra.run.smithi171.stdout:[client] 2022-09-20T20:07:37.871 INFO:teuthology.orchestra.run.smithi171.stdout: rgw cache enabled = true 2022-09-20T20:07:37.871 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable ops log = true 2022-09-20T20:07:37.871 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable usage log = true 2022-09-20T20:07:37.871 INFO:teuthology.orchestra.run.smithi171.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-09-20T20:07:37.872 INFO:teuthology.orchestra.run.smithi171.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-09-20T20:07:37.872 INFO:teuthology.orchestra.run.smithi171.stdout: client mount timeout = 600 2022-09-20T20:07:37.872 INFO:teuthology.orchestra.run.smithi171.stdout: debug client = 20 2022-09-20T20:07:37.872 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2022-09-20T20:07:37.873 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = "" 2022-09-20T20:07:37.873 INFO:teuthology.orchestra.run.smithi171.stdout: rados mon op timeout = 900 2022-09-20T20:07:37.873 INFO:teuthology.orchestra.run.smithi171.stdout: rados osd op timeout = 900 2022-09-20T20:07:37.873 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a] 2022-09-20T20:07:37.874 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.b] 2022-09-20T20:07:37.874 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.c] 2022-09-20T20:07:37.874 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2022-09-20T20:07:37.874 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.c] 2022-09-20T20:07:37.875 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2022-09-20T20:07:37.875 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.d] 2022-09-20T20:07:37.875 INFO:teuthology.orchestra.run.smithi171.stdout:[mds] 2022-09-20T20:07:37.875 INFO:teuthology.orchestra.run.smithi171.stdout: debug mds = 20 2022-09-20T20:07:37.876 INFO:teuthology.orchestra.run.smithi171.stdout: debug mds balancer = 20 2022-09-20T20:07:37.876 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2022-09-20T20:07:37.876 INFO:teuthology.orchestra.run.smithi171.stdout: mds debug frag = True 2022-09-20T20:07:37.876 INFO:teuthology.orchestra.run.smithi171.stdout: mds debug scatterstat = True 2022-09-20T20:07:37.876 INFO:teuthology.orchestra.run.smithi171.stdout: mds op complaint time = 180 2022-09-20T20:07:37.877 INFO:teuthology.orchestra.run.smithi171.stdout: mds verify scatter = True 2022-09-20T20:07:37.877 INFO:teuthology.orchestra.run.smithi171.stdout: osd op complaint time = 180 2022-09-20T20:07:37.877 INFO:teuthology.orchestra.run.smithi171.stdout: rados mon op timeout = 900 2022-09-20T20:07:37.877 INFO:teuthology.orchestra.run.smithi171.stdout: rados osd op timeout = 900 2022-09-20T20:07:37.878 INFO:tasks.ceph:Creating admin key on mon.a... 2022-09-20T20:07:37.878 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2022-09-20T20:07:37.936 INFO:tasks.ceph:Copying monmap to all nodes... 2022-09-20T20:07:37.937 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:07:37.937 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2022-09-20T20:07:37.955 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:07:37.956 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2022-09-20T20:07:38.013 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi152.front.sepia.ceph.com 2022-09-20T20:07:38.014 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:07:38.014 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.keyring 2022-09-20T20:07:38.014 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-09-20T20:07:38.089 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:07:38.090 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:07:38.148 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi171.front.sepia.ceph.com 2022-09-20T20:07:38.148 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:07:38.149 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.keyring 2022-09-20T20:07:38.149 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-09-20T20:07:38.187 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:07:38.188 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:07:38.245 INFO:tasks.ceph:Setting up mon nodes... 2022-09-20T20:07:38.246 INFO:tasks.ceph:Setting up mgr nodes... 2022-09-20T20:07:38.246 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2022-09-20T20:07:38.300 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2022-09-20T20:07:38.302 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2022-09-20T20:07:38.363 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2022-09-20T20:07:38.366 INFO:tasks.ceph:Setting up mds nodes... 2022-09-20T20:07:38.367 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2022-09-20T20:07:38.420 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2022-09-20T20:07:38.422 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2022-09-20T20:07:38.449 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2022-09-20T20:07:38.541 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2022-09-20T20:07:38.572 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2022-09-20T20:07:38.601 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2022-09-20T20:07:38.654 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2022-09-20T20:07:38.657 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2022-09-20T20:07:38.684 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2022-09-20T20:07:38.776 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2022-09-20T20:07:38.779 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2022-09-20T20:07:38.806 INFO:tasks.ceph_client:Setting up client nodes... 2022-09-20T20:07:38.808 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-09-20T20:07:38.852 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.client.0.keyring 2022-09-20T20:07:38.864 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2022-09-20T20:07:38.948 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.client.2.keyring 2022-09-20T20:07:38.961 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2022-09-20T20:07:39.005 INFO:teuthology.orchestra.run.smithi171.stdout:creating /etc/ceph/ceph.client.1.keyring 2022-09-20T20:07:39.017 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2022-09-20T20:07:39.101 INFO:teuthology.orchestra.run.smithi171.stdout:creating /etc/ceph/ceph.client.3.keyring 2022-09-20T20:07:39.113 INFO:tasks.ceph:Running mkfs on osd nodes... 2022-09-20T20:07:39.114 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-09-20T20:07:39.114 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2022-09-20T20:07:39.142 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-09-20T20:07:39.142 INFO:tasks.ceph:role: osd.0 2022-09-20T20:07:39.143 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com 2022-09-20T20:07:39.143 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-09-20T20:07:39.217 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-09-20T20:07:39.217 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-20T20:07:39.218 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-20T20:07:39.218 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-09-20T20:07:39.218 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-20T20:07:39.218 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2022-09-20T20:07:39.219 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-20T20:07:39.219 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-20T20:07:39.219 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-20T20:07:39.219 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-20T20:07:39.643 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2022-09-20T20:07:39.645 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2022-09-20T20:07:39.645 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2022-09-20T20:07:39.835 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2022-09-20T20:07:39.869 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2022-09-20T20:07:39.936 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-09-20T20:07:39.936 INFO:tasks.ceph:role: osd.1 2022-09-20T20:07:39.937 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com 2022-09-20T20:07:39.937 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-09-20T20:07:40.011 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-09-20T20:07:40.011 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-20T20:07:40.011 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-20T20:07:40.012 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-09-20T20:07:40.012 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-20T20:07:40.012 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2022-09-20T20:07:40.013 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-20T20:07:40.013 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-20T20:07:40.013 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-20T20:07:40.014 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-20T20:07:40.435 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2022-09-20T20:07:40.436 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2022-09-20T20:07:40.437 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2022-09-20T20:07:40.550 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2022-09-20T20:07:40.582 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2022-09-20T20:07:40.649 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-09-20T20:07:40.650 INFO:tasks.ceph:role: osd.2 2022-09-20T20:07:40.650 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com 2022-09-20T20:07:40.651 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-09-20T20:07:40.723 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-09-20T20:07:40.724 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-20T20:07:40.724 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-20T20:07:40.724 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-09-20T20:07:40.725 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-20T20:07:40.725 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2022-09-20T20:07:40.725 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-20T20:07:40.725 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-20T20:07:40.726 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-20T20:07:40.726 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-20T20:07:41.177 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2022-09-20T20:07:41.179 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2022-09-20T20:07:41.180 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2022-09-20T20:07:41.356 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2022-09-20T20:07:41.390 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2022-09-20T20:07:41.457 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-09-20T20:07:41.458 INFO:tasks.ceph:role: osd.3 2022-09-20T20:07:41.458 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com 2022-09-20T20:07:41.458 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-09-20T20:07:41.532 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-09-20T20:07:41.532 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-20T20:07:41.532 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-20T20:07:41.533 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-09-20T20:07:41.533 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-20T20:07:41.533 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2022-09-20T20:07:41.533 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-20T20:07:41.534 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-20T20:07:41.534 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-20T20:07:41.534 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-20T20:07:41.968 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2022-09-20T20:07:41.971 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2022-09-20T20:07:41.971 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2022-09-20T20:07:42.153 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2022-09-20T20:07:42.189 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:07:42.277 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:42.275+0000 7f319b6a95c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2022-09-20T20:07:42.278 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:42.275+0000 7f319b6a95c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2022-09-20T20:07:42.278 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:42.275+0000 7f319b6a95c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-09-20T20:07:42.278 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:42.275+0000 7f319b6a95c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-09-20T20:07:42.279 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:42.275+0000 7f319b6a95c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-09-20T20:07:42.279 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:42.275+0000 7f319b6a95c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2022-09-20T20:07:45.124 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-09-20T20:07:45.157 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:07:45.250 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:45.247+0000 7f58127205c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2022-09-20T20:07:45.250 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:45.248+0000 7f58127205c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2022-09-20T20:07:45.251 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:45.248+0000 7f58127205c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-09-20T20:07:45.251 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:45.248+0000 7f58127205c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-09-20T20:07:45.251 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:45.248+0000 7f58127205c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-09-20T20:07:45.251 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:45.248+0000 7f58127205c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2022-09-20T20:07:48.085 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-09-20T20:07:48.115 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:07:48.203 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:48.201+0000 7f1ed99675c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2022-09-20T20:07:48.203 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:48.202+0000 7f1ed99675c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2022-09-20T20:07:48.204 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:48.202+0000 7f1ed99675c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-09-20T20:07:48.204 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:48.202+0000 7f1ed99675c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-09-20T20:07:48.204 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:48.202+0000 7f1ed99675c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-09-20T20:07:48.204 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:48.202+0000 7f1ed99675c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2022-09-20T20:07:51.055 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-09-20T20:07:51.087 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:07:51.179 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:51.177+0000 7fdd260b45c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2022-09-20T20:07:51.179 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:51.178+0000 7fdd260b45c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2022-09-20T20:07:51.179 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:51.178+0000 7fdd260b45c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-09-20T20:07:51.180 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:51.178+0000 7fdd260b45c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-09-20T20:07:51.180 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:51.178+0000 7fdd260b45c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-09-20T20:07:51.180 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:07:51.178+0000 7fdd260b45c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2022-09-20T20:07:54.016 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-09-20T20:07:54.044 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2022-09-20T20:07:54.075 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-09-20T20:07:54.076 INFO:tasks.ceph:role: osd.4 2022-09-20T20:07:54.076 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com 2022-09-20T20:07:54.076 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-09-20T20:07:54.151 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-09-20T20:07:54.151 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-20T20:07:54.152 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-20T20:07:54.152 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-09-20T20:07:54.152 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-20T20:07:54.152 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2022-09-20T20:07:54.153 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-20T20:07:54.153 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-20T20:07:54.153 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-20T20:07:54.153 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-20T20:07:54.581 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2022-09-20T20:07:54.583 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2022-09-20T20:07:54.583 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2022-09-20T20:07:54.766 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2022-09-20T20:07:54.803 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2022-09-20T20:07:54.833 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-09-20T20:07:54.833 INFO:tasks.ceph:role: osd.5 2022-09-20T20:07:54.834 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com 2022-09-20T20:07:54.834 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-09-20T20:07:54.908 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-09-20T20:07:54.909 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-20T20:07:54.909 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-20T20:07:54.910 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-09-20T20:07:54.910 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-20T20:07:54.910 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2022-09-20T20:07:54.911 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-20T20:07:54.912 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-20T20:07:54.912 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-20T20:07:54.912 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-20T20:07:55.333 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2022-09-20T20:07:55.335 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2022-09-20T20:07:55.336 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2022-09-20T20:07:55.436 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2022-09-20T20:07:55.468 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2022-09-20T20:07:55.535 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-09-20T20:07:55.536 INFO:tasks.ceph:role: osd.6 2022-09-20T20:07:55.536 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com 2022-09-20T20:07:55.536 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-09-20T20:07:55.610 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-09-20T20:07:55.610 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-20T20:07:55.611 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-20T20:07:55.611 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-09-20T20:07:55.611 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-20T20:07:55.611 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2022-09-20T20:07:55.612 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-20T20:07:55.612 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-20T20:07:55.612 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-20T20:07:55.612 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-20T20:07:56.051 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2022-09-20T20:07:56.053 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2022-09-20T20:07:56.053 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2022-09-20T20:07:56.210 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2022-09-20T20:07:56.243 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2022-09-20T20:07:56.310 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-09-20T20:07:56.311 INFO:tasks.ceph:role: osd.7 2022-09-20T20:07:56.311 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com 2022-09-20T20:07:56.312 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-09-20T20:07:56.386 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-09-20T20:07:56.387 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2022-09-20T20:07:56.387 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-09-20T20:07:56.387 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-09-20T20:07:56.388 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-09-20T20:07:56.388 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2022-09-20T20:07:56.388 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-09-20T20:07:56.388 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-09-20T20:07:56.389 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-09-20T20:07:56.389 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-09-20T20:07:56.825 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2022-09-20T20:07:56.827 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2022-09-20T20:07:56.828 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2022-09-20T20:07:56.997 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2022-09-20T20:07:57.031 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:07:57.120 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:07:57.117+0000 7fd5b46da5c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2022-09-20T20:07:57.121 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:07:57.118+0000 7fd5b46da5c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2022-09-20T20:07:57.121 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:07:57.118+0000 7fd5b46da5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-09-20T20:07:57.121 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:07:57.118+0000 7fd5b46da5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-09-20T20:07:57.122 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:07:57.118+0000 7fd5b46da5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-09-20T20:07:57.122 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:07:57.118+0000 7fd5b46da5c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2022-09-20T20:07:59.971 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-09-20T20:08:00.002 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:08:00.093 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:00.091+0000 7fae493b35c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2022-09-20T20:08:00.093 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:00.092+0000 7fae493b35c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2022-09-20T20:08:00.094 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:00.092+0000 7fae493b35c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-09-20T20:08:00.094 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:00.092+0000 7fae493b35c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-09-20T20:08:00.094 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:00.092+0000 7fae493b35c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-09-20T20:08:00.095 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:00.092+0000 7fae493b35c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2022-09-20T20:08:02.938 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-09-20T20:08:02.966 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:08:03.054 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:03.052+0000 7fe66c5765c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2022-09-20T20:08:03.055 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:03.052+0000 7fe66c5765c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2022-09-20T20:08:03.055 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:03.052+0000 7fe66c5765c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-09-20T20:08:03.056 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:03.052+0000 7fe66c5765c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-09-20T20:08:03.056 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:03.052+0000 7fe66c5765c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-09-20T20:08:03.056 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:03.053+0000 7fe66c5765c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2022-09-20T20:08:05.892 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2022-09-20T20:08:05.920 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:08:06.007 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:06.005+0000 7f2c256f95c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2022-09-20T20:08:06.008 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:06.006+0000 7f2c256f95c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2022-09-20T20:08:06.008 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:06.006+0000 7f2c256f95c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-09-20T20:08:06.008 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:06.006+0000 7f2c256f95c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-09-20T20:08:06.008 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:06.006+0000 7f2c256f95c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-09-20T20:08:06.009 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:06.006+0000 7f2c256f95c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2022-09-20T20:08:06.631 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-20T20:08:06.634 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-20T20:08:08.847 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2022-09-20T20:08:08.877 INFO:tasks.ceph:Reading keys from all nodes... 2022-09-20T20:08:08.877 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:08:08.878 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2022-09-20T20:08:08.908 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:08:08.910 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2022-09-20T20:08:08.979 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:08:08.979 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2022-09-20T20:08:09.046 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:08:09.047 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2022-09-20T20:08:09.115 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:08:09.116 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2022-09-20T20:08:09.184 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:08:09.185 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2022-09-20T20:08:09.251 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:08:09.252 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2022-09-20T20:08:09.318 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:08:09.319 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2022-09-20T20:08:09.347 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:08:09.347 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2022-09-20T20:08:09.413 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:08:09.414 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2022-09-20T20:08:09.481 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:08:09.511 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2022-09-20T20:08:09.548 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:08:09.548 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2022-09-20T20:08:09.616 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:08:09.617 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2022-09-20T20:08:09.684 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:08:09.685 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2022-09-20T20:08:09.750 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:08:09.751 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2022-09-20T20:08:09.769 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:08:09.770 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2022-09-20T20:08:09.827 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:08:09.828 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2022-09-20T20:08:09.864 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:08:09.865 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2022-09-20T20:08:09.922 INFO:tasks.ceph:Adding keys to all mons... 2022-09-20T20:08:09.923 DEBUG:teuthology.orchestra.run.smithi152:> sudo tee -a /etc/ceph/ceph.keyring 2022-09-20T20:08:09.925 DEBUG:teuthology.orchestra.run.smithi171:> sudo tee -a /etc/ceph/ceph.keyring 2022-09-20T20:08:09.966 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.y] 2022-09-20T20:08:09.967 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCKHSpjFKffERAA2537w5aQuLa0eMC4QzYN0Q== 2022-09-20T20:08:09.967 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.a] 2022-09-20T20:08:09.967 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCKHSpjlhkGGRAATRCk80t9vVM9F9OgS4zmhw== 2022-09-20T20:08:09.967 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.c] 2022-09-20T20:08:09.968 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCKHSpjE5lEIBAAnaBg9XOCFjrnqpoNneg1Lw== 2022-09-20T20:08:09.968 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.0] 2022-09-20T20:08:09.968 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCOHSpjlyR6EBAAS+bDOKpeHmjKhGBA+XoWWA== 2022-09-20T20:08:09.968 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.1] 2022-09-20T20:08:09.969 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCRHSpjDMLZDhAAJaHuXcXL0v8RMN9CMh+QuQ== 2022-09-20T20:08:09.969 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.2] 2022-09-20T20:08:09.969 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCUHSpjamIODBAAMuLbILrc/9uqXbQeUso8iQ== 2022-09-20T20:08:09.969 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.3] 2022-09-20T20:08:09.970 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCXHSpjm/idChAAn6GZrJJztuP6S6mrznXqMA== 2022-09-20T20:08:09.970 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.x] 2022-09-20T20:08:09.970 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCKHSpjTC+lFRAATqj1A/HYzVgBRzzDzI8K2A== 2022-09-20T20:08:09.970 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.b] 2022-09-20T20:08:09.970 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCKHSpjl/X8JhAATRtcjAwCLIE3vX8d5wryMA== 2022-09-20T20:08:09.971 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.d] 2022-09-20T20:08:09.971 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCKHSpjP3VGLhAA7ZU8rkhBbjRh5j7IogvfDw== 2022-09-20T20:08:09.971 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.4] 2022-09-20T20:08:09.971 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCdHSpjE3YNBxAADKV4jw8mOH53P39Rjj7x6A== 2022-09-20T20:08:09.972 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.5] 2022-09-20T20:08:09.972 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCgHSpj7zp/BRAA3ac2UHrc6WwfyUJLs3EuLg== 2022-09-20T20:08:09.972 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.6] 2022-09-20T20:08:09.972 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCjHSpjaKMjAxAA0dDZNqHf4B+Qf+d+GU2ppw== 2022-09-20T20:08:09.973 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.7] 2022-09-20T20:08:09.973 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCmHSpjvs9fABAAvT+eo0dFpm1mc00OzxiGtw== 2022-09-20T20:08:09.973 INFO:teuthology.orchestra.run.smithi152.stdout:[client.0] 2022-09-20T20:08:09.973 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCKHSpjO4PIMhAAdOlp/+u8RzikGpoaeLk0TA== 2022-09-20T20:08:09.974 INFO:teuthology.orchestra.run.smithi152.stdout:[client.2] 2022-09-20T20:08:09.974 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCKHSpj0sB6OBAA+bPkdxfRaf6o6owZc4POdg== 2022-09-20T20:08:09.974 INFO:teuthology.orchestra.run.smithi152.stdout:[client.1] 2022-09-20T20:08:09.974 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCLHSpj/Z1JABAAOvcpfVwhwtN68yN3Oqez3w== 2022-09-20T20:08:09.975 INFO:teuthology.orchestra.run.smithi152.stdout:[client.3] 2022-09-20T20:08:09.975 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQCLHSpjn0gABhAAFP7pMlDKcfUZDXqrGmPn+g== 2022-09-20T20:08:09.988 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.y] 2022-09-20T20:08:09.989 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCKHSpjFKffERAA2537w5aQuLa0eMC4QzYN0Q== 2022-09-20T20:08:09.989 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2022-09-20T20:08:09.990 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCKHSpjlhkGGRAATRCk80t9vVM9F9OgS4zmhw== 2022-09-20T20:08:09.990 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.c] 2022-09-20T20:08:09.991 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCKHSpjE5lEIBAAnaBg9XOCFjrnqpoNneg1Lw== 2022-09-20T20:08:09.991 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.0] 2022-09-20T20:08:09.992 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCOHSpjlyR6EBAAS+bDOKpeHmjKhGBA+XoWWA== 2022-09-20T20:08:09.992 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.1] 2022-09-20T20:08:09.993 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCRHSpjDMLZDhAAJaHuXcXL0v8RMN9CMh+QuQ== 2022-09-20T20:08:09.993 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.2] 2022-09-20T20:08:09.993 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCUHSpjamIODBAAMuLbILrc/9uqXbQeUso8iQ== 2022-09-20T20:08:09.994 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.3] 2022-09-20T20:08:09.994 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCXHSpjm/idChAAn6GZrJJztuP6S6mrznXqMA== 2022-09-20T20:08:09.995 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.x] 2022-09-20T20:08:09.995 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCKHSpjTC+lFRAATqj1A/HYzVgBRzzDzI8K2A== 2022-09-20T20:08:09.996 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2022-09-20T20:08:09.996 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCKHSpjl/X8JhAATRtcjAwCLIE3vX8d5wryMA== 2022-09-20T20:08:09.997 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.d] 2022-09-20T20:08:09.997 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCKHSpjP3VGLhAA7ZU8rkhBbjRh5j7IogvfDw== 2022-09-20T20:08:09.998 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.4] 2022-09-20T20:08:09.998 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCdHSpjE3YNBxAADKV4jw8mOH53P39Rjj7x6A== 2022-09-20T20:08:09.998 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.5] 2022-09-20T20:08:09.999 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCgHSpj7zp/BRAA3ac2UHrc6WwfyUJLs3EuLg== 2022-09-20T20:08:09.999 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.6] 2022-09-20T20:08:10.000 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCjHSpjaKMjAxAA0dDZNqHf4B+Qf+d+GU2ppw== 2022-09-20T20:08:10.000 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.7] 2022-09-20T20:08:10.000 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCmHSpjvs9fABAAvT+eo0dFpm1mc00OzxiGtw== 2022-09-20T20:08:10.001 INFO:teuthology.orchestra.run.smithi171.stdout:[client.0] 2022-09-20T20:08:10.001 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCKHSpjO4PIMhAAdOlp/+u8RzikGpoaeLk0TA== 2022-09-20T20:08:10.002 INFO:teuthology.orchestra.run.smithi171.stdout:[client.2] 2022-09-20T20:08:10.002 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCKHSpj0sB6OBAA+bPkdxfRaf6o6owZc4POdg== 2022-09-20T20:08:10.002 INFO:teuthology.orchestra.run.smithi171.stdout:[client.1] 2022-09-20T20:08:10.003 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCLHSpj/Z1JABAAOvcpfVwhwtN68yN3Oqez3w== 2022-09-20T20:08:10.003 INFO:teuthology.orchestra.run.smithi171.stdout:[client.3] 2022-09-20T20:08:10.003 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCLHSpjn0gABhAAFP7pMlDKcfUZDXqrGmPn+g== 2022-09-20T20:08:10.004 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-09-20T20:08:10.020 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-09-20T20:08:10.098 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-20T20:08:10.101 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-20T20:08:10.157 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-20T20:08:10.160 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-20T20:08:10.216 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:08:10.219 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:08:10.273 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:08:10.275 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:08:10.328 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:08:10.331 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:08:10.383 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:08:10.387 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:08:10.443 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-09-20T20:08:10.445 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-09-20T20:08:10.500 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-20T20:08:10.502 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-20T20:08:10.558 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-20T20:08:10.561 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-09-20T20:08:10.617 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:08:10.620 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:08:10.674 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:08:10.677 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:08:10.731 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:08:10.734 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:08:10.787 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:08:10.790 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-09-20T20:08:10.843 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-20T20:08:10.846 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-20T20:08:10.902 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-20T20:08:10.905 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-20T20:08:10.961 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-20T20:08:10.964 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-20T20:08:11.020 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-20T20:08:11.022 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-09-20T20:08:11.078 INFO:tasks.ceph:Running mkfs on mon nodes... 2022-09-20T20:08:11.079 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2022-09-20T20:08:11.106 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-09-20T20:08:11.205 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2022-09-20T20:08:11.233 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2022-09-20T20:08:11.262 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-09-20T20:08:11.359 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2022-09-20T20:08:11.387 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2022-09-20T20:08:11.454 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-09-20T20:08:11.551 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2022-09-20T20:08:11.579 DEBUG:teuthology.orchestra.run.smithi152:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:08:11.582 DEBUG:teuthology.orchestra.run.smithi171:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-09-20T20:08:11.637 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2022-09-20T20:08:11.638 INFO:tasks.ceph.mon.a:Restarting daemon 2022-09-20T20:08:11.639 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-09-20T20:08:11.642 INFO:tasks.ceph.mon.a:Started 2022-09-20T20:08:11.643 INFO:tasks.ceph.mon.b:Restarting daemon 2022-09-20T20:08:11.643 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-09-20T20:08:11.679 INFO:tasks.ceph.mon.b:Started 2022-09-20T20:08:11.681 INFO:tasks.ceph.mon.c:Restarting daemon 2022-09-20T20:08:11.681 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-09-20T20:08:11.684 INFO:tasks.ceph.mon.c:Started 2022-09-20T20:08:11.684 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2022-09-20T20:08:11.684 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-09-20T20:08:11.685 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-09-20T20:08:11.687 INFO:tasks.ceph.mgr.y:Started 2022-09-20T20:08:11.688 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-09-20T20:08:11.688 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-09-20T20:08:11.691 INFO:tasks.ceph.mgr.x:Started 2022-09-20T20:08:11.692 INFO:tasks.ceph:Setting crush tunables to default 2022-09-20T20:08:11.692 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd crush tunables default 2022-09-20T20:08:11.815 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.814+0000 7fe854bc8700 1 Processor -- start 2022-09-20T20:08:11.816 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.814+0000 7fe854bc8700 1 -- start start 2022-09-20T20:08:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.815+0000 7fe854bc8700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 0x7fe8500c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.815+0000 7fe854bc8700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 0x7fe8500ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:11.818 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.815+0000 7fe854bc8700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8500cee50 con 0x7fe8500cea10 2022-09-20T20:08:11.819 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.815+0000 7fe854bc8700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8501586e0 con 0x7fe850155af0 2022-09-20T20:08:11.819 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.815+0000 7fe854bc8700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8501589c0 con 0x7fe8500b09c0 2022-09-20T20:08:11.819 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.815+0000 7fe84e59c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 0x7fe8500c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:11.819 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.815+0000 7fe84e59c700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 0x7fe8500c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:45500/0 (socket says 172.21.15.152:45500) 2022-09-20T20:08:11.820 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.815+0000 7fe84e59c700 1 -- 172.21.15.152:0/1147682188 learned_addr learned my addr 172.21.15.152:0/1147682188 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:11.820 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.815+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 0x7fe8500ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:11.820 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.815+0000 7fe84e59c700 1 -- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 msgr2=0x7fe8500c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-09-20T20:08:11.820 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.815+0000 7fe84e59c700 1 -- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 msgr2=0x7fe8500c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:11.821 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.815+0000 7fe84e59c700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 0x7fe8500c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:11.821 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.816+0000 7fe84e59c700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 0x7fe8500c91a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:11.821 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.816+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 msgr2=0x7fe8500ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-20T20:08:11.821 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.816+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 msgr2=0x7fe8500ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:11.821 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.816+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 0x7fe8500ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:11.822 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:11.816+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 0x7fe8500ce4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:12.018 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.017+0000 7fe84e59c700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 0x7fe8500c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:12.019 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.017+0000 7fe84e59c700 1 -- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 msgr2=0x7fe8500c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-09-20T20:08:12.019 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.017+0000 7fe84e59c700 1 -- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 msgr2=0x7fe8500c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:12.019 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.017+0000 7fe84e59c700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 0x7fe8500c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:12.020 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.017+0000 7fe84e59c700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 0x7fe8500c91a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-09-20T20:08:12.020 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.017+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 0x7fe8500ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:12.020 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.017+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 msgr2=0x7fe8500ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-20T20:08:12.020 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.017+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 msgr2=0x7fe8500ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:12.021 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.017+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 0x7fe8500ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:12.021 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.017+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 0x7fe8500ce4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-09-20T20:08:12.420 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.418+0000 7fe84e59c700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 0x7fe8500c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:12.421 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.418+0000 7fe84e59c700 1 -- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 msgr2=0x7fe8500c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-20T20:08:12.421 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.418+0000 7fe84e59c700 1 -- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 msgr2=0x7fe8500c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:12.422 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.418+0000 7fe84e59c700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 0x7fe8500c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:12.422 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.418+0000 7fe84e59c700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 0x7fe8500c91a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-09-20T20:08:12.423 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.418+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 0x7fe8500ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:12.423 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.418+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 msgr2=0x7fe8500ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-09-20T20:08:12.423 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.418+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 msgr2=0x7fe8500ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:12.423 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.418+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 0x7fe8500ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:12.424 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:12.418+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 0x7fe8500ce4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-09-20T20:08:13.220 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:13.218+0000 7fe84e59c700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 0x7fe8500c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:13.221 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:13.218+0000 7fe84e59c700 1 -- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 msgr2=0x7fe8500c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-09-20T20:08:13.221 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:13.218+0000 7fe84e59c700 1 -- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 msgr2=0x7fe8500c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:13.221 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:13.218+0000 7fe84e59c700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 0x7fe8500c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:13.221 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:13.218+0000 7fe84e59c700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 0x7fe8500c91a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-09-20T20:08:13.222 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:13.218+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 0x7fe8500ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:13.222 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:13.218+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 msgr2=0x7fe8500ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-09-20T20:08:13.222 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:13.218+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 msgr2=0x7fe8500ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:13.223 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:13.218+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 0x7fe8500ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:13.223 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:13.218+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 0x7fe8500ce4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-09-20T20:08:14.818 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:14.815+0000 7fe83ffff700 1 -- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 msgr2=0x7fe8500ce4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-09-20T20:08:14.819 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:14.815+0000 7fe83ffff700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe8500b09c0 0x7fe8500ce4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:14.819 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:14.815+0000 7fe83ffff700 1 -- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 msgr2=0x7fe8500c91a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-09-20T20:08:14.820 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:14.815+0000 7fe83ffff700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.152:3300/0 conn(0x7fe850155af0 0x7fe8500c91a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:14.820 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:14.815+0000 7fe83ffff700 1 -- 172.21.15.152:0/1147682188 >> v1:172.21.15.171:6789/0 conn(0x7fe8500cea10 legacy=0x7fe8500cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:14.821 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:14.815+0000 7fe83ffff700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 0x7fe82c00ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:14.821 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:14.815+0000 7fe83ffff700 1 -- 172.21.15.152:0/1147682188 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe850158ca0 con 0x7fe82c005960 2022-09-20T20:08:14.821 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:14.815+0000 7fe83ffff700 1 -- 172.21.15.152:0/1147682188 --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8501586e0 con 0x7fe82c009600 2022-09-20T20:08:14.822 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:14.815+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 0x7fe82c00ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:14.823 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:14.815+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 msgr2=0x7fe82c00ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-20T20:08:14.823 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:14.815+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 msgr2=0x7fe82c00ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:14.824 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:14.815+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 0x7fe82c00ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:14.824 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:14.815+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 0x7fe82c00ba90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:15.018 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:15.016+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 0x7fe82c00ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:15.018 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:15.016+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 msgr2=0x7fe82c00ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-20T20:08:15.019 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:15.016+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 msgr2=0x7fe82c00ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:15.019 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:15.016+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 0x7fe82c00ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:15.019 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:15.016+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 0x7fe82c00ba90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2022-09-20T20:08:15.419 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:15.417+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 0x7fe82c00ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:15.419 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:15.417+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 msgr2=0x7fe82c00ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-20T20:08:15.420 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:15.417+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 msgr2=0x7fe82c00ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:15.420 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:15.417+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 0x7fe82c00ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:15.420 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:15.417+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 0x7fe82c00ba90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2022-09-20T20:08:16.220 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.218+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 0x7fe82c00ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:16.221 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.218+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 msgr2=0x7fe82c00ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-20T20:08:16.221 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.218+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 msgr2=0x7fe82c00ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:16.222 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.218+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 0x7fe82c00ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:16.222 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.218+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 0x7fe82c00ba90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2022-09-20T20:08:16.986 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.981+0000 7fe84d59a700 1 -- 172.21.15.152:0/1147682188 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964366181 0 0) 0x7fe850158ca0 con 0x7fe82c005960 2022-09-20T20:08:16.986 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.981+0000 7fe84d59a700 1 -- 172.21.15.152:0/1147682188 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8340035b0 con 0x7fe82c005960 2022-09-20T20:08:16.987 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84d59a700 1 -- 172.21.15.152:0/1147682188 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2864023310 0 0) 0x7fe8340035b0 con 0x7fe82c005960 2022-09-20T20:08:16.987 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84d59a700 1 -- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 msgr2=0x7fe82c00ba90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-09-20T20:08:16.987 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84d59a700 1 --2- 172.21.15.152:0/1147682188 >> v2:172.21.15.171:3300/0 conn(0x7fe82c009600 0x7fe82c00ba90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:16.987 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84d59a700 1 -- 172.21.15.152:0/1147682188 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82c00d190 con 0x7fe82c005960 2022-09-20T20:08:16.988 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84d59a700 1 -- 172.21.15.152:0/1147682188 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3495984756 0 0) 0x7fe84400c570 con 0x7fe82c005960 2022-09-20T20:08:16.988 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84d59a700 1 -- 172.21.15.152:0/1147682188 >> v1:172.21.15.152:6789/0 conn(0x7fe82c005960 legacy=0x7fe82c007dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:16.988 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84ed9d700 1 -- 172.21.15.152:0/1147682188 reap_dead start 2022-09-20T20:08:16.988 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84d59a700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe834003a00 0x7fe834003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:16.988 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84d59a700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe834004850 0x7fe834004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:16.989 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84d59a700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe834005320 0x7fe83400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:16.989 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84d59a700 1 -- 172.21.15.152:0/1147682188 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8501586e0 con 0x7fe834004850 2022-09-20T20:08:16.989 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84d59a700 1 -- 172.21.15.152:0/1147682188 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83400c250 con 0x7fe834003a00 2022-09-20T20:08:16.989 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84d59a700 1 -- 172.21.15.152:0/1147682188 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83400c410 con 0x7fe834005320 2022-09-20T20:08:16.990 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe834004850 0x7fe834004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:16.990 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84e59c700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe834003a00 0x7fe834003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:16.990 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84ed9d700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe834005320 0x7fe83400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:16.990 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe834005320 msgr2=0x7fe83400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:16.991 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe834005320 0x7fe83400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:16.991 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe834003a00 msgr2=0x7fe834003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:16.991 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.982+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe834003a00 0x7fe834003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:16.991 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.983+0000 7fe84dd9b700 1 -- 172.21.15.152:0/1147682188 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8340035b0 con 0x7fe834004850 2022-09-20T20:08:16.991 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.983+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe834004850 0x7fe834004cc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe840019ac0 tx=0x7fe834005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d59ae940043eb31 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:16.992 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.983+0000 7fe84d59a700 1 -- 172.21.15.152:0/1147682188 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe84001e070 con 0x7fe834004850 2022-09-20T20:08:16.992 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.983+0000 7fe84d59a700 1 -- 172.21.15.152:0/1147682188 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84000c040 con 0x7fe834004850 2022-09-20T20:08:16.992 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.983+0000 7fe84d59a700 1 -- 172.21.15.152:0/1147682188 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe840004270 con 0x7fe834004850 2022-09-20T20:08:16.992 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.984+0000 7fe854bc8700 1 -- 172.21.15.152:0/1147682188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe834004850 msgr2=0x7fe834004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:16.993 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.984+0000 7fe854bc8700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe834004850 0x7fe834004cc0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe840019ac0 tx=0x7fe834005880 comp rx=0 tx=0).stop 2022-09-20T20:08:16.993 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.984+0000 7fe854bc8700 1 -- 172.21.15.152:0/1147682188 shutdown_connections 2022-09-20T20:08:16.993 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.984+0000 7fe854bc8700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe834005320 0x7fe83400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:16.993 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.984+0000 7fe854bc8700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe834004850 0x7fe834004cc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:16.993 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.984+0000 7fe854bc8700 1 --2- 172.21.15.152:0/1147682188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe834003a00 0x7fe834003df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:16.994 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.984+0000 7fe854bc8700 1 -- 172.21.15.152:0/1147682188 >> 172.21.15.152:0/1147682188 conn(0x7fe850069df0 msgr2=0x7fe85006a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:16.994 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.984+0000 7fe854bc8700 1 -- 172.21.15.152:0/1147682188 shutdown_connections 2022-09-20T20:08:16.994 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.984+0000 7fe854bc8700 1 -- 172.21.15.152:0/1147682188 wait complete. 2022-09-20T20:08:16.998 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.986+0000 7fe854bc8700 1 Processor -- start 2022-09-20T20:08:16.998 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.986+0000 7fe854bc8700 1 -- start start 2022-09-20T20:08:16.998 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe854bc8700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe834003a00 0x7fe8500b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:16.998 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe854bc8700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe834004850 0x7fe8500c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:16.999 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe854bc8700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe834005320 0x7fe8500c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:16.999 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe854bc8700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500b35e0 con 0x7fe834003a00 2022-09-20T20:08:16.999 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe854bc8700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe850154b90 con 0x7fe834005320 2022-09-20T20:08:16.999 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe854bc8700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe85015b280 con 0x7fe834004850 2022-09-20T20:08:17.000 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe84e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe834003a00 0x7fe8500b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:17.000 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe84e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe834003a00 0x7fe8500b30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59646/0 (socket says 172.21.15.152:59646) 2022-09-20T20:08:17.000 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe84e59c700 1 -- 172.21.15.152:0/374574270 learned_addr learned my addr 172.21.15.152:0/374574270 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:17.000 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/374574270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe834004850 0x7fe8500c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:17.001 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe84ed9d700 1 --2- 172.21.15.152:0/374574270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe834005320 0x7fe8500c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:17.001 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe84dd9b700 1 -- 172.21.15.152:0/374574270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe834004850 msgr2=0x7fe8500c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2022-09-20T20:08:17.001 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe84dd9b700 1 -- 172.21.15.152:0/374574270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe834004850 msgr2=0x7fe8500c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-09-20T20:08:17.001 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/374574270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe834004850 0x7fe8500c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:17.002 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe84dd9b700 1 --2- 172.21.15.152:0/374574270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe834004850 0x7fe8500c91a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:17.002 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe84e59c700 1 -- 172.21.15.152:0/374574270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe834004850 msgr2=0x7fe8500c91a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-20T20:08:17.002 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe84e59c700 1 --2- 172.21.15.152:0/374574270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe834004850 0x7fe8500c91a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.002 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe84e59c700 1 -- 172.21.15.152:0/374574270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe834005320 msgr2=0x7fe8500c96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:17.002 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe84e59c700 1 --2- 172.21.15.152:0/374574270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe834005320 0x7fe8500c96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.003 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe84e59c700 1 -- 172.21.15.152:0/374574270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe85015b560 con 0x7fe834003a00 2022-09-20T20:08:17.003 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe84ed9d700 1 --2- 172.21.15.152:0/374574270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe834005320 0x7fe8500c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:08:17.003 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.988+0000 7fe84e59c700 1 --2- 172.21.15.152:0/374574270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe834003a00 0x7fe8500b30a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe84400c7f0 tx=0x7fe84400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:17.003 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.989+0000 7fe83effd700 1 -- 172.21.15.152:0/374574270 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe844004460 con 0x7fe834003a00 2022-09-20T20:08:17.004 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.989+0000 7fe83effd700 1 -- 172.21.15.152:0/374574270 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe84400c040 con 0x7fe834003a00 2022-09-20T20:08:17.004 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.989+0000 7fe83effd700 1 -- 172.21.15.152:0/374574270 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe844015a00 con 0x7fe834003a00 2022-09-20T20:08:17.004 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.989+0000 7fe854bc8700 1 -- 172.21.15.152:0/374574270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe85015b840 con 0x7fe834003a00 2022-09-20T20:08:17.004 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.989+0000 7fe854bc8700 1 -- 172.21.15.152:0/374574270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe85015be00 con 0x7fe834003a00 2022-09-20T20:08:17.004 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.989+0000 7fe83effd700 1 -- 172.21.15.152:0/374574270 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fe844028070 con 0x7fe834003a00 2022-09-20T20:08:17.005 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.989+0000 7fe83effd700 1 -- 172.21.15.152:0/374574270 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fe844000e40 con 0x7fe834003a00 2022-09-20T20:08:17.005 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.990+0000 7fe854bc8700 1 -- 172.21.15.152:0/374574270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe85004da60 con 0x7fe834003a00 2022-09-20T20:08:17.005 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:16.992+0000 7fe83effd700 1 -- 172.21.15.152:0/374574270 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7fe844026060 con 0x7fe834003a00 2022-09-20T20:08:17.070 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:17.069+0000 7fe854bc8700 1 -- 172.21.15.152:0/374574270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe850158f80 con 0x7fe834003a00 2022-09-20T20:08:17.073 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:17.071+0000 7fe83effd700 1 -- 172.21.15.152:0/374574270 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe844030090 con 0x7fe834003a00 2022-09-20T20:08:17.075 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:17.072+0000 7fe854bc8700 1 -- 172.21.15.152:0/374574270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe834003a00 msgr2=0x7fe8500b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:17.075 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:17.072+0000 7fe854bc8700 1 --2- 172.21.15.152:0/374574270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe834003a00 0x7fe8500b30a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe84400c7f0 tx=0x7fe84400cf90 comp rx=0 tx=0).stop 2022-09-20T20:08:17.075 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:17.072+0000 7fe854bc8700 1 -- 172.21.15.152:0/374574270 shutdown_connections 2022-09-20T20:08:17.076 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:17.072+0000 7fe854bc8700 1 --2- 172.21.15.152:0/374574270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe834005320 0x7fe8500c96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.076 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:17.072+0000 7fe854bc8700 1 --2- 172.21.15.152:0/374574270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe834003a00 0x7fe8500b30a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.076 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:17.072+0000 7fe854bc8700 1 --2- 172.21.15.152:0/374574270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe834004850 0x7fe8500c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.076 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:17.072+0000 7fe854bc8700 1 -- 172.21.15.152:0/374574270 >> 172.21.15.152:0/374574270 conn(0x7fe850069df0 msgr2=0x7fe850156300 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:17.077 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:17.072+0000 7fe854bc8700 1 -- 172.21.15.152:0/374574270 shutdown_connections 2022-09-20T20:08:17.077 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:17.072+0000 7fe854bc8700 1 -- 172.21.15.152:0/374574270 wait complete. 2022-09-20T20:08:17.077 INFO:teuthology.orchestra.run.smithi152.stderr:adjusted tunables profile to default 2022-09-20T20:08:17.087 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2022-09-20T20:08:17.088 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:08:17.088 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2022-09-20T20:08:17.115 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:17.114+0000 7f61be265200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-09-20T20:08:17.116 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:08:17.117 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2022-09-20T20:08:17.184 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:08:17.184 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2022-09-20T20:08:17.252 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2022-09-20T20:08:17.252 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2022-09-20T20:08:17.281 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:17.279+0000 7f61be265200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-09-20T20:08:17.309 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:08:17.310 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2022-09-20T20:08:17.340 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:08:17.341 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2022-09-20T20:08:17.410 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:08:17.410 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2022-09-20T20:08:17.480 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2022-09-20T20:08:17.481 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2022-09-20T20:08:17.548 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new c48a8b9b-3648-4172-8ee8-1ff95e1f0452 0 2022-09-20T20:08:17.709 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.707+0000 7f869579a700 1 Processor -- start 2022-09-20T20:08:17.709 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.707+0000 7f869579a700 1 -- start start 2022-09-20T20:08:17.722 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f869579a700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f869006b8f0 0x7f86900cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:17.722 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f869579a700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f86900cf940 0x7f86900ae3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:17.722 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f869579a700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869006bd40 con 0x7f86900d17c0 2022-09-20T20:08:17.722 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f869579a700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86900d00b0 con 0x7f86900cf940 2022-09-20T20:08:17.723 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f869579a700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869006a920 con 0x7f869006b8f0 2022-09-20T20:08:17.723 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868e7fc700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f869006b8f0 0x7f86900cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:17.723 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868effd700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f86900d17c0 0x7f86900d1b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:49852/0 (socket says 172.21.15.171:49852) 2022-09-20T20:08:17.724 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868effd700 1 -- 172.21.15.171:0/3950689264 learned_addr learned my addr 172.21.15.171:0/3950689264 (peer_addr_for_me v1:172.21.15.171:0/0) 2022-09-20T20:08:17.724 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868e7fc700 1 -- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f869006b8f0 msgr2=0x7f86900cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-20T20:08:17.724 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868e7fc700 1 -- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f869006b8f0 msgr2=0x7f86900cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:17.724 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868e7fc700 1 --2- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f869006b8f0 0x7f86900cf400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:17.725 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868e7fc700 1 --2- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f869006b8f0 0x7f86900cf400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:17.725 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868f7fe700 1 --2- 172.21.15.171:0/3950689264 >> v2:172.21.15.152:3300/0 conn(0x7f86900cf940 0x7f86900ae3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:17.725 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868dffb700 1 -- 172.21.15.171:0/3950689264 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080090519 0 0) 0x7f869006bd40 con 0x7f86900d17c0 2022-09-20T20:08:17.725 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868dffb700 1 -- 172.21.15.171:0/3950689264 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f867c0035b0 con 0x7f86900d17c0 2022-09-20T20:08:17.725 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868dffb700 1 -- 172.21.15.171:0/3950689264 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3272212846 0 0) 0x7f867c0035b0 con 0x7f86900d17c0 2022-09-20T20:08:17.726 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868dffb700 1 -- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f869006b8f0 msgr2=0x7f86900cf400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-09-20T20:08:17.726 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868dffb700 1 --2- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f869006b8f0 0x7f86900cf400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.726 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868dffb700 1 -- 172.21.15.171:0/3950689264 >> v2:172.21.15.152:3300/0 conn(0x7f86900cf940 msgr2=0x7f86900ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:17.726 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868dffb700 1 --2- 172.21.15.171:0/3950689264 >> v2:172.21.15.152:3300/0 conn(0x7f86900cf940 0x7f86900ae3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.727 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868dffb700 1 -- 172.21.15.171:0/3950689264 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869006ab30 con 0x7f86900d17c0 2022-09-20T20:08:17.727 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868dffb700 1 -- 172.21.15.171:0/3950689264 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3495984756 0 0) 0x7f86800017f0 con 0x7f86900d17c0 2022-09-20T20:08:17.727 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868dffb700 1 -- 172.21.15.171:0/3950689264 >> v1:172.21.15.171:6789/0 conn(0x7f86900d17c0 legacy=0x7f86900d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:17.727 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868dffb700 1 --2- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f867c003a00 0x7f867c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:17.728 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868dffb700 1 --2- 172.21.15.171:0/3950689264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f867c004850 0x7f867c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:17.728 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868dffb700 1 --2- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f869006b8f0 0x7f867c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:17.729 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868dffb700 1 -- 172.21.15.171:0/3950689264 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86900d00b0 con 0x7f867c004850 2022-09-20T20:08:17.729 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868dffb700 1 -- 172.21.15.171:0/3950689264 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869006a920 con 0x7f867c003a00 2022-09-20T20:08:17.729 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868dffb700 1 -- 172.21.15.171:0/3950689264 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c00bac0 con 0x7f869006b8f0 2022-09-20T20:08:17.730 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868effd700 1 --2- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f867c003a00 0x7f867c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:17.730 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.708+0000 7f868f7fe700 1 --2- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f869006b8f0 0x7f867c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:17.730 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.709+0000 7f868e7fc700 1 --2- 172.21.15.171:0/3950689264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f867c004850 0x7f867c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:17.730 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.709+0000 7f868f7fe700 1 -- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f869006b8f0 msgr2=0x7f867c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2022-09-20T20:08:17.731 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.709+0000 7f868f7fe700 1 -- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f869006b8f0 msgr2=0x7f867c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:17.731 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.709+0000 7f868f7fe700 1 --2- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f869006b8f0 0x7f867c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:17.731 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.709+0000 7f868f7fe700 1 --2- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f869006b8f0 0x7f867c005200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:17.731 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.709+0000 7f868effd700 1 -- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f869006b8f0 msgr2=0x7f867c005200 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-09-20T20:08:17.731 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.709+0000 7f868effd700 1 --2- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f869006b8f0 0x7f867c005200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.732 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.709+0000 7f868effd700 1 -- 172.21.15.171:0/3950689264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f867c004850 msgr2=0x7f867c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:17.732 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.709+0000 7f868effd700 1 --2- 172.21.15.171:0/3950689264 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f867c004850 0x7f867c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.732 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.709+0000 7f868effd700 1 -- 172.21.15.171:0/3950689264 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c0035b0 con 0x7f867c003a00 2022-09-20T20:08:17.732 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.709+0000 7f868effd700 1 --2- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f867c003a00 0x7f867c003dd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8680003f90 tx=0x7f867c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51ecbf8754730e4d server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:17.733 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.709+0000 7f868dffb700 1 -- 172.21.15.171:0/3950689264 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86800082d0 con 0x7f867c003a00 2022-09-20T20:08:17.733 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.709+0000 7f868dffb700 1 -- 172.21.15.171:0/3950689264 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8680008430 con 0x7f867c003a00 2022-09-20T20:08:17.733 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.709+0000 7f868dffb700 1 -- 172.21.15.171:0/3950689264 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680008d90 con 0x7f867c003a00 2022-09-20T20:08:17.733 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.710+0000 7f869579a700 1 -- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f867c003a00 msgr2=0x7f867c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:17.734 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.710+0000 7f869579a700 1 --2- 172.21.15.171:0/3950689264 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f867c003a00 0x7f867c003dd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8680003f90 tx=0x7f867c005880 comp rx=0 tx=0).stop 2022-09-20T20:08:17.734 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.710+0000 7f868f7fe700 1 -- 172.21.15.171:0/3950689264 reap_dead start 2022-09-20T20:08:17.734 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.710+0000 7f869579a700 1 -- 172.21.15.171:0/3950689264 shutdown_connections 2022-09-20T20:08:17.734 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.710+0000 7f869579a700 1 -- 172.21.15.171:0/3950689264 >> 172.21.15.171:0/3950689264 conn(0x7f869009abb0 msgr2=0x7f8690088fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:17.735 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.710+0000 7f869579a700 1 -- 172.21.15.171:0/3950689264 shutdown_connections 2022-09-20T20:08:17.735 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.710+0000 7f869579a700 1 -- 172.21.15.171:0/3950689264 wait complete. 2022-09-20T20:08:17.735 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.711+0000 7f869579a700 1 Processor -- start 2022-09-20T20:08:17.735 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.711+0000 7f869579a700 1 -- start start 2022-09-20T20:08:17.736 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f869579a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f867c003a00 0x7f86900c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:17.736 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f869579a700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86900c7ec0 0x7f86900b6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:17.736 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f869579a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86900b65b0 0x7f86900b3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:17.736 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f869579a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8690158340 con 0x7f86900b65b0 2022-09-20T20:08:17.736 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f869579a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86900c6e20 con 0x7f867c003a00 2022-09-20T20:08:17.737 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f869579a700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86900c7100 con 0x7f86900c7ec0 2022-09-20T20:08:17.737 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f868effd700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f867c003a00 0x7f86900c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:17.737 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f868effd700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f867c003a00 0x7f86900c4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:50190/0 (socket says 172.21.15.171:50190) 2022-09-20T20:08:17.737 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f868effd700 1 -- 172.21.15.171:0/321939634 learned_addr learned my addr 172.21.15.171:0/321939634 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-09-20T20:08:17.738 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f868e7fc700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86900c7ec0 0x7f86900b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:17.738 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f868e7fc700 1 -- 172.21.15.171:0/321939634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86900c7ec0 msgr2=0x7f86900b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2022-09-20T20:08:17.739 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f868e7fc700 1 -- 172.21.15.171:0/321939634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86900c7ec0 msgr2=0x7f86900b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-09-20T20:08:17.739 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f868e7fc700 1 --2- 172.21.15.171:0/321939634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86900c7ec0 0x7f86900b6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:17.740 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f868f7fe700 1 --2- 172.21.15.171:0/321939634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86900b65b0 0x7f86900b3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:17.740 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f868e7fc700 1 --2- 172.21.15.171:0/321939634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86900c7ec0 0x7f86900b6070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:17.741 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f868effd700 1 -- 172.21.15.171:0/321939634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86900c7ec0 msgr2=0x7f86900b6070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-20T20:08:17.741 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f868effd700 1 --2- 172.21.15.171:0/321939634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86900c7ec0 0x7f86900b6070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.742 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f868effd700 1 -- 172.21.15.171:0/321939634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86900b65b0 msgr2=0x7f86900b3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:17.742 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f868effd700 1 --2- 172.21.15.171:0/321939634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86900b65b0 0x7f86900b3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.742 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f868effd700 1 -- 172.21.15.171:0/321939634 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86900c73e0 con 0x7f867c003a00 2022-09-20T20:08:17.743 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f868f7fe700 1 --2- 172.21.15.171:0/321939634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86900b65b0 0x7f86900b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-20T20:08:17.743 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f868effd700 1 --2- 172.21.15.171:0/321939634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f867c003a00 0x7f86900c4600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f867c00ba90 tx=0x7f8680003a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:17.744 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f86777fe700 1 -- 172.21.15.171:0/321939634 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680003880 con 0x7f867c003a00 2022-09-20T20:08:17.744 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f86777fe700 1 -- 172.21.15.171:0/321939634 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8680005830 con 0x7f867c003a00 2022-09-20T20:08:17.745 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f869579a700 1 -- 172.21.15.171:0/321939634 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86900c76c0 con 0x7f867c003a00 2022-09-20T20:08:17.745 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f86777fe700 1 -- 172.21.15.171:0/321939634 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680005ba0 con 0x7f867c003a00 2022-09-20T20:08:17.746 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f869579a700 1 -- 172.21.15.171:0/321939634 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86900c4b40 con 0x7f867c003a00 2022-09-20T20:08:17.746 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.712+0000 7f86777fe700 1 -- 172.21.15.171:0/321939634 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f8680011030 con 0x7f867c003a00 2022-09-20T20:08:17.747 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.713+0000 7f86777fe700 1 -- 172.21.15.171:0/321939634 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8680015420 con 0x7f867c003a00 2022-09-20T20:08:17.747 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.713+0000 7f869579a700 1 -- 172.21.15.171:0/321939634 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86900c7d10 con 0x7f867c003a00 2022-09-20T20:08:17.747 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.716+0000 7f86777fe700 1 -- 172.21.15.171:0/321939634 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7f868002e060 con 0x7f867c003a00 2022-09-20T20:08:17.778 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:17.776+0000 7f61be265200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-09-20T20:08:17.802 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.800+0000 7f869579a700 1 -- 172.21.15.171:0/321939634 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c48a8b9b-3648-4172-8ee8-1ff95e1f0452", "id": 0} v 0) v1 -- 0x7f86900ce0b0 con 0x7f867c003a00 2022-09-20T20:08:17.807 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.805+0000 7f86777fe700 1 -- 172.21.15.171:0/321939634 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c48a8b9b-3648-4172-8ee8-1ff95e1f0452", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8680025070 con 0x7f867c003a00 2022-09-20T20:08:17.808 INFO:teuthology.orchestra.run.smithi171.stdout:0 2022-09-20T20:08:17.811 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.806+0000 7f869579a700 1 -- 172.21.15.171:0/321939634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f867c003a00 msgr2=0x7f86900c4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:17.811 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.806+0000 7f869579a700 1 --2- 172.21.15.171:0/321939634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f867c003a00 0x7f86900c4600 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f867c00ba90 tx=0x7f8680003a00 comp rx=0 tx=0).stop 2022-09-20T20:08:17.811 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.806+0000 7f869579a700 1 -- 172.21.15.171:0/321939634 shutdown_connections 2022-09-20T20:08:17.812 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.806+0000 7f869579a700 1 --2- 172.21.15.171:0/321939634 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f86900b65b0 0x7f86900b3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.812 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.806+0000 7f869579a700 1 --2- 172.21.15.171:0/321939634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f867c003a00 0x7f86900c4600 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.812 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.806+0000 7f869579a700 1 --2- 172.21.15.171:0/321939634 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f86900c7ec0 0x7f86900b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.812 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.806+0000 7f869579a700 1 -- 172.21.15.171:0/321939634 >> 172.21.15.171:0/321939634 conn(0x7f869009abb0 msgr2=0x7f86900af2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:17.813 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.806+0000 7f869579a700 1 -- 172.21.15.171:0/321939634 shutdown_connections 2022-09-20T20:08:17.813 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.806+0000 7f869579a700 1 -- 172.21.15.171:0/321939634 wait complete. 2022-09-20T20:08:17.820 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new e272de33-f058-41d6-af3a-3031de13004d 1 2022-09-20T20:08:17.891 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:17.890+0000 7fbc19c2c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-09-20T20:08:17.940 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.938+0000 7efecf769700 1 Processor -- start 2022-09-20T20:08:17.941 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.938+0000 7efecf769700 1 -- start start 2022-09-20T20:08:17.949 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.939+0000 7efecf769700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efec8158c60 0x7efec80c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:17.950 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.939+0000 7efecf769700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efec806f5f0 0x7efec80cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:17.950 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.939+0000 7efecf769700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec80ca1c0 con 0x7efec80cc360 2022-09-20T20:08:17.950 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.939+0000 7efecf769700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec815c4b0 con 0x7efec806f5f0 2022-09-20T20:08:17.950 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.939+0000 7efecf769700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec80cc760 con 0x7efec8158c60 2022-09-20T20:08:17.951 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.939+0000 7efecd505700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efec8158c60 0x7efec80c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:17.951 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.939+0000 7efecd505700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7efec8158c60 0x7efec80c9c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:50212/0 (socket says 172.21.15.171:50212) 2022-09-20T20:08:17.951 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.939+0000 7efecd505700 1 -- 172.21.15.171:0/1951758634 learned_addr learned my addr 172.21.15.171:0/1951758634 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-09-20T20:08:17.951 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.939+0000 7efeccd04700 1 --2- 172.21.15.171:0/1951758634 >> v2:172.21.15.152:3300/0 conn(0x7efec806f5f0 0x7efec80cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:17.951 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.940+0000 7efecd505700 1 -- 172.21.15.171:0/1951758634 >> v2:172.21.15.152:3300/0 conn(0x7efec806f5f0 msgr2=0x7efec80cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:17.952 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.940+0000 7efecd505700 1 --2- 172.21.15.171:0/1951758634 >> v2:172.21.15.152:3300/0 conn(0x7efec806f5f0 0x7efec80cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.952 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.940+0000 7efecd505700 1 -- 172.21.15.171:0/1951758634 >> v1:172.21.15.171:6789/0 conn(0x7efec80cc360 legacy=0x7efec815ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:17.952 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.940+0000 7efecd505700 1 -- 172.21.15.171:0/1951758634 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec815b930 con 0x7efec8158c60 2022-09-20T20:08:17.952 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.940+0000 7efecd505700 1 --2- 172.21.15.171:0/1951758634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec8158c60 0x7efec80c9c80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efec8069ad0 tx=0x7efec4009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28da573209bc77a8 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:17.953 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.940+0000 7efebffff700 1 -- 172.21.15.171:0/1951758634 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec4011830 con 0x7efec8158c60 2022-09-20T20:08:17.953 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.940+0000 7efebffff700 1 -- 172.21.15.171:0/1951758634 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec4011990 con 0x7efec8158c60 2022-09-20T20:08:17.953 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.940+0000 7efebffff700 1 -- 172.21.15.171:0/1951758634 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec4011d20 con 0x7efec8158c60 2022-09-20T20:08:17.953 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.941+0000 7efecf769700 1 -- 172.21.15.171:0/1951758634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec8158c60 msgr2=0x7efec80c9c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:17.954 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.941+0000 7efecf769700 1 --2- 172.21.15.171:0/1951758634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec8158c60 0x7efec80c9c80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7efec8069ad0 tx=0x7efec4009bd0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.954 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.941+0000 7efecf769700 1 -- 172.21.15.171:0/1951758634 shutdown_connections 2022-09-20T20:08:17.954 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.941+0000 7efecf769700 1 --2- 172.21.15.171:0/1951758634 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec8158c60 0x7efec80c9c80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.954 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.941+0000 7efecf769700 1 --2- 172.21.15.171:0/1951758634 >> v2:172.21.15.152:3300/0 conn(0x7efec806f5f0 0x7efec80cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.955 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.941+0000 7efecf769700 1 -- 172.21.15.171:0/1951758634 >> 172.21.15.171:0/1951758634 conn(0x7efec806d140 msgr2=0x7efec806d510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:17.955 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.941+0000 7efecf769700 1 -- 172.21.15.171:0/1951758634 shutdown_connections 2022-09-20T20:08:17.955 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.941+0000 7efecf769700 1 -- 172.21.15.171:0/1951758634 wait complete. 2022-09-20T20:08:17.955 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.942+0000 7efecf769700 1 Processor -- start 2022-09-20T20:08:17.956 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.942+0000 7efecf769700 1 -- start start 2022-09-20T20:08:17.956 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efecf769700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efec806f5f0 0x7efec80c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:17.956 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efecf769700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec80cc360 0x7efec814d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:17.957 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efecf769700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec8158c60 0x7efec8156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:17.957 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efecf769700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec81f5340 con 0x7efec806f5f0 2022-09-20T20:08:17.957 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efecf769700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec814dc80 con 0x7efec8158c60 2022-09-20T20:08:17.957 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efecf769700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec814d730 con 0x7efec80cc360 2022-09-20T20:08:17.958 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efecdd06700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec8158c60 0x7efec8156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:17.958 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efecdd06700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec8158c60 0x7efec8156070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:50220/0 (socket says 172.21.15.171:50220) 2022-09-20T20:08:17.958 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efecdd06700 1 -- 172.21.15.171:0/2006726226 learned_addr learned my addr 172.21.15.171:0/2006726226 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-09-20T20:08:17.959 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efeccd04700 1 --2- 172.21.15.171:0/2006726226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec80cc360 0x7efec814d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:17.959 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efecd505700 1 --2- 172.21.15.171:0/2006726226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efec806f5f0 0x7efec80c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:17.959 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efeccd04700 1 -- 172.21.15.171:0/2006726226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec80cc360 msgr2=0x7efec814d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2022-09-20T20:08:17.959 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efeccd04700 1 -- 172.21.15.171:0/2006726226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec80cc360 msgr2=0x7efec814d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-09-20T20:08:17.960 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efeccd04700 1 --2- 172.21.15.171:0/2006726226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec80cc360 0x7efec814d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:17.960 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efeccd04700 1 --2- 172.21.15.171:0/2006726226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec80cc360 0x7efec814d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:17.960 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efecdd06700 1 -- 172.21.15.171:0/2006726226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec80cc360 msgr2=0x7efec814d1f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-20T20:08:17.960 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efecdd06700 1 --2- 172.21.15.171:0/2006726226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec80cc360 0x7efec814d1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.961 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efecdd06700 1 -- 172.21.15.171:0/2006726226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efec806f5f0 msgr2=0x7efec80c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:17.961 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efecdd06700 1 --2- 172.21.15.171:0/2006726226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efec806f5f0 0x7efec80c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:17.961 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efecdd06700 1 -- 172.21.15.171:0/2006726226 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec4009550 con 0x7efec8158c60 2022-09-20T20:08:17.961 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efecdd06700 1 --2- 172.21.15.171:0/2006726226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec8158c60 0x7efec8156070 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efec000cc50 tx=0x7efec000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:17.962 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efebdffb700 1 -- 172.21.15.171:0/2006726226 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec0003c00 con 0x7efec8158c60 2022-09-20T20:08:17.962 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efebdffb700 1 -- 172.21.15.171:0/2006726226 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec0003d60 con 0x7efec8158c60 2022-09-20T20:08:17.962 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efecf769700 1 -- 172.21.15.171:0/2006726226 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec81f5060 con 0x7efec8158c60 2022-09-20T20:08:17.963 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.943+0000 7efebdffb700 1 -- 172.21.15.171:0/2006726226 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec000ab60 con 0x7efec8158c60 2022-09-20T20:08:17.963 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.944+0000 7efebdffb700 1 -- 172.21.15.171:0/2006726226 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7efec0010050 con 0x7efec8158c60 2022-09-20T20:08:17.963 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.944+0000 7efecf769700 1 -- 172.21.15.171:0/2006726226 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec80c8160 con 0x7efec8158c60 2022-09-20T20:08:17.963 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.944+0000 7efebdffb700 1 -- 172.21.15.171:0/2006726226 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7efec00050d0 con 0x7efec8158c60 2022-09-20T20:08:17.964 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.945+0000 7efecf769700 1 -- 172.21.15.171:0/2006726226 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec806fa70 con 0x7efec8158c60 2022-09-20T20:08:17.964 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:17.947+0000 7efebdffb700 1 -- 172.21.15.171:0/2006726226 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7efec0005290 con 0x7efec8158c60 2022-09-20T20:08:18.037 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.035+0000 7efecf769700 1 -- 172.21.15.171:0/2006726226 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e272de33-f058-41d6-af3a-3031de13004d", "id": 1} v 0) v1 -- 0x7efec804da60 con 0x7efec8158c60 2022-09-20T20:08:18.044 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.042+0000 7efebdffb700 1 -- 172.21.15.171:0/2006726226 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e272de33-f058-41d6-af3a-3031de13004d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7efec002a0b0 con 0x7efec8158c60 2022-09-20T20:08:18.045 INFO:teuthology.orchestra.run.smithi171.stdout:1 2022-09-20T20:08:18.046 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.044+0000 7efecf769700 1 -- 172.21.15.171:0/2006726226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec8158c60 msgr2=0x7efec8156070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:18.047 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.044+0000 7efecf769700 1 --2- 172.21.15.171:0/2006726226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec8158c60 0x7efec8156070 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7efec000cc50 tx=0x7efec000cf60 comp rx=0 tx=0).stop 2022-09-20T20:08:18.047 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.044+0000 7efecf769700 1 -- 172.21.15.171:0/2006726226 shutdown_connections 2022-09-20T20:08:18.047 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.044+0000 7efecf769700 1 --2- 172.21.15.171:0/2006726226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efec8158c60 0x7efec8156070 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.047 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.044+0000 7efecf769700 1 --2- 172.21.15.171:0/2006726226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efec806f5f0 0x7efec80c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.048 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.044+0000 7efecf769700 1 --2- 172.21.15.171:0/2006726226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efec80cc360 0x7efec814d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.048 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.044+0000 7efecf769700 1 -- 172.21.15.171:0/2006726226 >> 172.21.15.171:0/2006726226 conn(0x7efec806d140 msgr2=0x7efec815c660 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:18.048 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.044+0000 7efecf769700 1 -- 172.21.15.171:0/2006726226 shutdown_connections 2022-09-20T20:08:18.048 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.044+0000 7efecf769700 1 -- 172.21.15.171:0/2006726226 wait complete. 2022-09-20T20:08:18.061 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new ab49b061-3e6f-4acb-a402-c687d6b71b7b 2 2022-09-20T20:08:18.062 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:18.060+0000 7fbc19c2c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-09-20T20:08:18.108 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:18.106+0000 7f61be265200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-09-20T20:08:18.184 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.182+0000 7f081ec1a700 1 Processor -- start 2022-09-20T20:08:18.185 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.182+0000 7f081ec1a700 1 -- start start 2022-09-20T20:08:18.188 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f081ec1a700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0818155af0 0x7f08180c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.189 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f081ec1a700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 0x7f08180ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.189 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f081ec1a700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08180cee50 con 0x7f08180cea10 2022-09-20T20:08:18.189 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f081ec1a700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08181586e0 con 0x7f0818155af0 2022-09-20T20:08:18.189 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f081ec1a700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08181589c0 con 0x7f08180b09c0 2022-09-20T20:08:18.190 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f081c9b6700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0818155af0 0x7f08180c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.190 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f0817fff700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 0x7f08180ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.190 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f081c9b6700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0818155af0 0x7f08180c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:50232/0 (socket says 172.21.15.171:50232) 2022-09-20T20:08:18.190 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f0817fff700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 0x7f08180ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:53692/0 (socket says 172.21.15.171:53692) 2022-09-20T20:08:18.191 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f081c9b6700 1 -- 172.21.15.171:0/2755941047 learned_addr learned my addr 172.21.15.171:0/2755941047 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-09-20T20:08:18.191 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f0817fff700 1 -- 172.21.15.171:0/2755941047 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 msgr2=0x7f08180ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-20T20:08:18.191 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f0817fff700 1 -- 172.21.15.171:0/2755941047 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 msgr2=0x7f08180ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:18.192 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f0817fff700 1 --2- 172.21.15.171:0/2755941047 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 0x7f08180ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:18.192 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f0817fff700 1 --2- 172.21.15.171:0/2755941047 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 0x7f08180ce4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:18.192 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f081c9b6700 1 -- 172.21.15.171:0/2755941047 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 msgr2=0x7f08180ce4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-09-20T20:08:18.193 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f081c9b6700 1 --2- 172.21.15.171:0/2755941047 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 0x7f08180ce4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.193 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f081c9b6700 1 -- 172.21.15.171:0/2755941047 >> v1:172.21.15.171:6789/0 conn(0x7f08180cea10 legacy=0x7f08180cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:18.193 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f081c9b6700 1 -- 172.21.15.171:0/2755941047 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0818158ca0 con 0x7f0818155af0 2022-09-20T20:08:18.193 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f08177fe700 1 -- 172.21.15.171:0/2755941047 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907485283 0 0) 0x7f08180cee50 con 0x7f08180cea10 2022-09-20T20:08:18.194 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f081c9b6700 1 --2- 172.21.15.171:0/2755941047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0818155af0 0x7f08180c91a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f080c0098f0 tx=0x7f080c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54510fc8da83c830 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:18.194 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f08177fe700 1 -- 172.21.15.171:0/2755941047 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c00b8a0 con 0x7f0818155af0 2022-09-20T20:08:18.195 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f08177fe700 1 -- 172.21.15.171:0/2755941047 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c00ba00 con 0x7f0818155af0 2022-09-20T20:08:18.195 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.184+0000 7f08177fe700 1 -- 172.21.15.171:0/2755941047 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080c00bd90 con 0x7f0818155af0 2022-09-20T20:08:18.196 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.185+0000 7f081ec1a700 1 -- 172.21.15.171:0/2755941047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0818155af0 msgr2=0x7f08180c91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:18.196 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.185+0000 7f081ec1a700 1 --2- 172.21.15.171:0/2755941047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0818155af0 0x7f08180c91a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f080c0098f0 tx=0x7f080c009c00 comp rx=0 tx=0).stop 2022-09-20T20:08:18.197 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.185+0000 7f081ec1a700 1 -- 172.21.15.171:0/2755941047 shutdown_connections 2022-09-20T20:08:18.197 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.185+0000 7f081ec1a700 1 --2- 172.21.15.171:0/2755941047 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0818155af0 0x7f08180c91a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.198 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.185+0000 7f081ec1a700 1 --2- 172.21.15.171:0/2755941047 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 0x7f08180ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.198 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.185+0000 7f081ec1a700 1 -- 172.21.15.171:0/2755941047 >> 172.21.15.171:0/2755941047 conn(0x7f0818069df0 msgr2=0x7f081806a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:18.199 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.185+0000 7f081ec1a700 1 -- 172.21.15.171:0/2755941047 shutdown_connections 2022-09-20T20:08:18.199 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.185+0000 7f081ec1a700 1 -- 172.21.15.171:0/2755941047 wait complete. 2022-09-20T20:08:18.206 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.187+0000 7f081ec1a700 1 Processor -- start 2022-09-20T20:08:18.206 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.187+0000 7f081ec1a700 1 -- start start 2022-09-20T20:08:18.207 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.188+0000 7f081ec1a700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 0x7f08180c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.207 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.188+0000 7f081ec1a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08180cea10 0x7f081815b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.208 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.188+0000 7f081ec1a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0818155af0 0x7f08181f2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.208 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.188+0000 7f081ec1a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08181ee940 con 0x7f0818155af0 2022-09-20T20:08:18.209 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.188+0000 7f081ec1a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08181ef780 con 0x7f08180cea10 2022-09-20T20:08:18.209 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.188+0000 7f081ec1a700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08181eeb90 con 0x7f08180b09c0 2022-09-20T20:08:18.209 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.188+0000 7f081c9b6700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 0x7f08180c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.210 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.188+0000 7f081c9b6700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 0x7f08180c4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:53706/0 (socket says 172.21.15.171:53706) 2022-09-20T20:08:18.210 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.188+0000 7f081c9b6700 1 -- 172.21.15.171:0/933881332 learned_addr learned my addr 172.21.15.171:0/933881332 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-09-20T20:08:18.211 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f0817fff700 1 --2- 172.21.15.171:0/933881332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08180cea10 0x7f081815b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.211 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f081c9b6700 1 -- 172.21.15.171:0/933881332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 msgr2=0x7f08180c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2022-09-20T20:08:18.212 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f081c9b6700 1 -- 172.21.15.171:0/933881332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 msgr2=0x7f08180c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-09-20T20:08:18.212 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f081c9b6700 1 --2- 172.21.15.171:0/933881332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 0x7f08180c4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:18.213 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f081c9b6700 1 --2- 172.21.15.171:0/933881332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 0x7f08180c4520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:18.213 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f081d1b7700 1 --2- 172.21.15.171:0/933881332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0818155af0 0x7f08181f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.214 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f0817fff700 1 -- 172.21.15.171:0/933881332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 msgr2=0x7f08180c4520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-20T20:08:18.214 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f0817fff700 1 --2- 172.21.15.171:0/933881332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 0x7f08180c4520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.215 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f0817fff700 1 -- 172.21.15.171:0/933881332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0818155af0 msgr2=0x7f08181f2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:18.215 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f0817fff700 1 --2- 172.21.15.171:0/933881332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0818155af0 0x7f08181f2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.216 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f0817fff700 1 -- 172.21.15.171:0/933881332 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c009550 con 0x7f08180cea10 2022-09-20T20:08:18.216 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f081d1b7700 1 --2- 172.21.15.171:0/933881332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0818155af0 0x7f08181f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-20T20:08:18.217 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f0817fff700 1 --2- 172.21.15.171:0/933881332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08180cea10 0x7f081815b9b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f080400e810 tx=0x7f080400ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:18.217 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f08157fa700 1 -- 172.21.15.171:0/933881332 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804013610 con 0x7f08180cea10 2022-09-20T20:08:18.218 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f08157fa700 1 -- 172.21.15.171:0/933881332 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0804013770 con 0x7f08180cea10 2022-09-20T20:08:18.218 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f08157fa700 1 -- 172.21.15.171:0/933881332 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804013b20 con 0x7f08180cea10 2022-09-20T20:08:18.219 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f081ec1a700 1 -- 172.21.15.171:0/933881332 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08181eee50 con 0x7f08180cea10 2022-09-20T20:08:18.219 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f081ec1a700 1 -- 172.21.15.171:0/933881332 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08181ef410 con 0x7f08180cea10 2022-09-20T20:08:18.220 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f08157fa700 1 -- 172.21.15.171:0/933881332 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f0804023070 con 0x7f08180cea10 2022-09-20T20:08:18.220 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.189+0000 7f08157fa700 1 -- 172.21.15.171:0/933881332 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f0804012370 con 0x7f08180cea10 2022-09-20T20:08:18.220 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.190+0000 7f081ec1a700 1 -- 172.21.15.171:0/933881332 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08180b2500 con 0x7f08180cea10 2022-09-20T20:08:18.221 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.192+0000 7f08157fa700 1 -- 172.21.15.171:0/933881332 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7f0804021060 con 0x7f08180cea10 2022-09-20T20:08:18.235 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:18.233+0000 7f61be265200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-09-20T20:08:18.275 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.273+0000 7f081ec1a700 1 -- 172.21.15.171:0/933881332 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ab49b061-3e6f-4acb-a402-c687d6b71b7b", "id": 2} v 0) v1 -- 0x7f081804da60 con 0x7f08180cea10 2022-09-20T20:08:18.283 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.281+0000 7f08157fa700 1 -- 172.21.15.171:0/933881332 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ab49b061-3e6f-4acb-a402-c687d6b71b7b", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0804017070 con 0x7f08180cea10 2022-09-20T20:08:18.284 INFO:teuthology.orchestra.run.smithi171.stdout:2 2022-09-20T20:08:18.286 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.282+0000 7f081ec1a700 1 -- 172.21.15.171:0/933881332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08180cea10 msgr2=0x7f081815b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:18.287 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.282+0000 7f081ec1a700 1 --2- 172.21.15.171:0/933881332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08180cea10 0x7f081815b9b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f080400e810 tx=0x7f080400ebd0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.287 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.282+0000 7f081ec1a700 1 -- 172.21.15.171:0/933881332 shutdown_connections 2022-09-20T20:08:18.287 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.282+0000 7f081ec1a700 1 --2- 172.21.15.171:0/933881332 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08180b09c0 0x7f08180c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.288 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.282+0000 7f081ec1a700 1 --2- 172.21.15.171:0/933881332 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0818155af0 0x7f08181f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.288 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.282+0000 7f081ec1a700 1 --2- 172.21.15.171:0/933881332 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08180cea10 0x7f081815b9b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.289 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.282+0000 7f081ec1a700 1 -- 172.21.15.171:0/933881332 >> 172.21.15.171:0/933881332 conn(0x7f0818069df0 msgr2=0x7f08180cccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:18.289 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.282+0000 7f081ec1a700 1 -- 172.21.15.171:0/933881332 shutdown_connections 2022-09-20T20:08:18.289 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.282+0000 7f081ec1a700 1 -- 172.21.15.171:0/933881332 wait complete. 2022-09-20T20:08:18.296 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 465e8685-6b56-4763-9ce8-937508e05d89 3 2022-09-20T20:08:18.417 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.415+0000 7f3a51d12700 1 Processor -- start 2022-09-20T20:08:18.417 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.415+0000 7f3a51d12700 1 -- start start 2022-09-20T20:08:18.423 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.416+0000 7f3a51d12700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3a4c06f7d0 0x7f3a4c15b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.424 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.416+0000 7f3a51d12700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3a4c0ce490 0x7f3a4c068f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.424 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.416+0000 7f3a51d12700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a4c158b80 con 0x7f3a4c0c9ed0 2022-09-20T20:08:18.424 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.416+0000 7f3a51d12700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4c0cc7e0 con 0x7f3a4c0ce490 2022-09-20T20:08:18.424 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.416+0000 7f3a51d12700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4c0cd3e0 con 0x7f3a4c06f7d0 2022-09-20T20:08:18.425 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.416+0000 7f3a4b7fe700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3a4c06f7d0 0x7f3a4c15b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.425 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.416+0000 7f3a4b7fe700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3a4c06f7d0 0x7f3a4c15b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:50248/0 (socket says 172.21.15.171:50248) 2022-09-20T20:08:18.425 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.416+0000 7f3a4b7fe700 1 -- 172.21.15.171:0/3542267689 learned_addr learned my addr 172.21.15.171:0/3542267689 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-09-20T20:08:18.425 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.416+0000 7f3a4bfff700 1 --2- 172.21.15.171:0/3542267689 >> v2:172.21.15.152:3300/0 conn(0x7f3a4c0ce490 0x7f3a4c068f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.426 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.416+0000 7f3a4b7fe700 1 -- 172.21.15.171:0/3542267689 >> v2:172.21.15.152:3300/0 conn(0x7f3a4c0ce490 msgr2=0x7f3a4c068f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:18.426 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.416+0000 7f3a4b7fe700 1 --2- 172.21.15.171:0/3542267689 >> v2:172.21.15.152:3300/0 conn(0x7f3a4c0ce490 0x7f3a4c068f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.426 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.416+0000 7f3a4b7fe700 1 -- 172.21.15.171:0/3542267689 >> v1:172.21.15.152:6789/0 conn(0x7f3a4c0c9ed0 legacy=0x7f3a4c06fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:18.426 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.416+0000 7f3a4b7fe700 1 -- 172.21.15.171:0/3542267689 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c157f70 con 0x7f3a4c06f7d0 2022-09-20T20:08:18.427 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.416+0000 7f3a4b7fe700 1 --2- 172.21.15.171:0/3542267689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a4c06f7d0 0x7f3a4c15b1f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c06abc0 tx=0x7f3a3c00d430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f08d4388526827d7 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:18.427 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.416+0000 7f3a4a7fc700 1 -- 172.21.15.171:0/3542267689 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c010070 con 0x7f3a4c06f7d0 2022-09-20T20:08:18.427 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.416+0000 7f3a4a7fc700 1 -- 172.21.15.171:0/3542267689 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c00dad0 con 0x7f3a4c06f7d0 2022-09-20T20:08:18.427 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.416+0000 7f3a4a7fc700 1 -- 172.21.15.171:0/3542267689 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c00de80 con 0x7f3a4c06f7d0 2022-09-20T20:08:18.428 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.417+0000 7f3a51d12700 1 -- 172.21.15.171:0/3542267689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a4c06f7d0 msgr2=0x7f3a4c15b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:18.428 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.417+0000 7f3a51d12700 1 --2- 172.21.15.171:0/3542267689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a4c06f7d0 0x7f3a4c15b1f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c06abc0 tx=0x7f3a3c00d430 comp rx=0 tx=0).stop 2022-09-20T20:08:18.428 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.417+0000 7f3a51d12700 1 -- 172.21.15.171:0/3542267689 shutdown_connections 2022-09-20T20:08:18.429 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.417+0000 7f3a51d12700 1 --2- 172.21.15.171:0/3542267689 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a4c06f7d0 0x7f3a4c15b1f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.429 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.417+0000 7f3a51d12700 1 --2- 172.21.15.171:0/3542267689 >> v2:172.21.15.152:3300/0 conn(0x7f3a4c0ce490 0x7f3a4c068f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.429 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.417+0000 7f3a51d12700 1 -- 172.21.15.171:0/3542267689 >> 172.21.15.171:0/3542267689 conn(0x7f3a4c0b04e0 msgr2=0x7f3a4c0cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:18.429 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.417+0000 7f3a51d12700 1 -- 172.21.15.171:0/3542267689 shutdown_connections 2022-09-20T20:08:18.430 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.417+0000 7f3a51d12700 1 -- 172.21.15.171:0/3542267689 wait complete. 2022-09-20T20:08:18.430 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.418+0000 7f3a51d12700 1 Processor -- start 2022-09-20T20:08:18.430 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.418+0000 7f3a51d12700 1 -- start start 2022-09-20T20:08:18.431 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a51d12700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a4c06f7d0 0x7f3a4c1e0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.431 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a51d12700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a4c0c9ed0 0x7f3a4c1f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.431 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a51d12700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a4c0ce490 0x7f3a4c1f4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.431 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a51d12700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c1e0940 con 0x7f3a4c0ce490 2022-09-20T20:08:18.431 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a51d12700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c0ab220 con 0x7f3a4c0c9ed0 2022-09-20T20:08:18.432 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a51d12700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c0aa930 con 0x7f3a4c06f7d0 2022-09-20T20:08:18.432 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a4affd700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a4c0c9ed0 0x7f3a4c1f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.432 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a4b7fe700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a4c06f7d0 0x7f3a4c1e0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.432 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a4affd700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a4c0c9ed0 0x7f3a4c1f41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:50264/0 (socket says 172.21.15.171:50264) 2022-09-20T20:08:18.433 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a4affd700 1 -- 172.21.15.171:0/817411500 learned_addr learned my addr 172.21.15.171:0/817411500 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-09-20T20:08:18.433 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a4bfff700 1 --2- 172.21.15.171:0/817411500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a4c0ce490 0x7f3a4c1f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.433 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a4b7fe700 1 -- 172.21.15.171:0/817411500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a4c06f7d0 msgr2=0x7f3a4c1e0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2022-09-20T20:08:18.433 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a4b7fe700 1 -- 172.21.15.171:0/817411500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a4c06f7d0 msgr2=0x7f3a4c1e0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-09-20T20:08:18.434 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a4b7fe700 1 --2- 172.21.15.171:0/817411500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a4c06f7d0 0x7f3a4c1e0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:18.434 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a4b7fe700 1 --2- 172.21.15.171:0/817411500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a4c06f7d0 0x7f3a4c1e0d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:18.434 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a4affd700 1 -- 172.21.15.171:0/817411500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a4c06f7d0 msgr2=0x7f3a4c1e0d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-20T20:08:18.434 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a4affd700 1 --2- 172.21.15.171:0/817411500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a4c06f7d0 0x7f3a4c1e0d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.434 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a4affd700 1 -- 172.21.15.171:0/817411500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a4c0ce490 msgr2=0x7f3a4c1f4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:18.435 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.419+0000 7f3a4affd700 1 --2- 172.21.15.171:0/817411500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a4c0ce490 0x7f3a4c1f4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.435 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.420+0000 7f3a4affd700 1 -- 172.21.15.171:0/817411500 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c00bd40 con 0x7f3a4c0c9ed0 2022-09-20T20:08:18.435 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.420+0000 7f3a4affd700 1 --2- 172.21.15.171:0/817411500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a4c0c9ed0 0x7f3a4c1f41f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000c4e0 tx=0x7f3a4000c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:18.435 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.420+0000 7f3a33fff700 1 -- 172.21.15.171:0/817411500 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a400052d0 con 0x7f3a4c0c9ed0 2022-09-20T20:08:18.437 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.420+0000 7f3a33fff700 1 -- 172.21.15.171:0/817411500 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a40005430 con 0x7f3a4c0c9ed0 2022-09-20T20:08:18.437 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.420+0000 7f3a33fff700 1 -- 172.21.15.171:0/817411500 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a400038c0 con 0x7f3a4c0c9ed0 2022-09-20T20:08:18.438 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.420+0000 7f3a51d12700 1 -- 172.21.15.171:0/817411500 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4c0aabd0 con 0x7f3a4c0c9ed0 2022-09-20T20:08:18.438 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.420+0000 7f3a51d12700 1 -- 172.21.15.171:0/817411500 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4c0c4640 con 0x7f3a4c0c9ed0 2022-09-20T20:08:18.439 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.420+0000 7f3a33fff700 1 -- 172.21.15.171:0/817411500 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f3a40019030 con 0x7f3a4c0c9ed0 2022-09-20T20:08:18.439 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.420+0000 7f3a33fff700 1 -- 172.21.15.171:0/817411500 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f3a40011c00 con 0x7f3a4c0c9ed0 2022-09-20T20:08:18.439 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.421+0000 7f3a51d12700 1 -- 172.21.15.171:0/817411500 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4c04da60 con 0x7f3a4c0c9ed0 2022-09-20T20:08:18.440 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.424+0000 7f3a33fff700 1 -- 172.21.15.171:0/817411500 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7f3a40017070 con 0x7f3a4c0c9ed0 2022-09-20T20:08:18.459 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:18.458+0000 7f61be265200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-09-20T20:08:18.528 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:18.526+0000 7f61be265200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-09-20T20:08:18.540 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.538+0000 7f3a51d12700 1 -- 172.21.15.171:0/817411500 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "465e8685-6b56-4763-9ce8-937508e05d89", "id": 3} v 0) v1 -- 0x7f3a4c070400 con 0x7f3a4c0c9ed0 2022-09-20T20:08:18.548 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.546+0000 7f3a33fff700 1 -- 172.21.15.171:0/817411500 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "465e8685-6b56-4763-9ce8-937508e05d89", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3a40011e10 con 0x7f3a4c0c9ed0 2022-09-20T20:08:18.549 INFO:teuthology.orchestra.run.smithi171.stdout:3 2022-09-20T20:08:18.550 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.547+0000 7f3a51d12700 1 -- 172.21.15.171:0/817411500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a4c0c9ed0 msgr2=0x7f3a4c1f41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:18.550 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.547+0000 7f3a51d12700 1 --2- 172.21.15.171:0/817411500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a4c0c9ed0 0x7f3a4c1f41f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000c4e0 tx=0x7f3a4000c7f0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.551 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.547+0000 7f3a51d12700 1 -- 172.21.15.171:0/817411500 shutdown_connections 2022-09-20T20:08:18.551 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.547+0000 7f3a51d12700 1 --2- 172.21.15.171:0/817411500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3a4c06f7d0 0x7f3a4c1e0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.551 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.547+0000 7f3a51d12700 1 --2- 172.21.15.171:0/817411500 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a4c0ce490 0x7f3a4c1f4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.551 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.547+0000 7f3a51d12700 1 --2- 172.21.15.171:0/817411500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3a4c0c9ed0 0x7f3a4c1f41f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.551 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.547+0000 7f3a51d12700 1 -- 172.21.15.171:0/817411500 >> 172.21.15.171:0/817411500 conn(0x7f3a4c0b04e0 msgr2=0x7f3a4c068f50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:18.552 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.547+0000 7f3a51d12700 1 -- 172.21.15.171:0/817411500 shutdown_connections 2022-09-20T20:08:18.552 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.547+0000 7f3a51d12700 1 -- 172.21.15.171:0/817411500 wait complete. 2022-09-20T20:08:18.561 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 3f460e6a-25ec-4940-ba11-6cc651fca0b3 4 2022-09-20T20:08:18.599 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:18.597+0000 7fbc19c2c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-09-20T20:08:18.691 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.680+0000 7ffa75642700 1 Processor -- start 2022-09-20T20:08:18.692 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.681+0000 7ffa75642700 1 -- start start 2022-09-20T20:08:18.692 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.681+0000 7ffa75642700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700d17c0 0x7ffa7006b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.693 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.681+0000 7ffa75642700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffa700d1b90 0x7ffa700cf400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.693 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.681+0000 7ffa75642700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7006ab30 con 0x7ffa700cf940 2022-09-20T20:08:18.693 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.681+0000 7ffa75642700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa700d00b0 con 0x7ffa700d1b90 2022-09-20T20:08:18.694 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.681+0000 7ffa75642700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7006a920 con 0x7ffa700d17c0 2022-09-20T20:08:18.694 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.681+0000 7ffa6effd700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700d17c0 0x7ffa7006b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.694 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.681+0000 7ffa6f7fe700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7ffa700cf940 0x7ffa700ae3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:49878/0 (socket says 172.21.15.171:49878) 2022-09-20T20:08:18.694 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.681+0000 7ffa6effd700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700d17c0 0x7ffa7006b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:53710/0 (socket says 172.21.15.171:53710) 2022-09-20T20:08:18.695 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.681+0000 7ffa6f7fe700 1 -- 172.21.15.171:0/4039463541 learned_addr learned my addr 172.21.15.171:0/4039463541 (peer_addr_for_me v1:172.21.15.171:0/0) 2022-09-20T20:08:18.695 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.682+0000 7ffa6effd700 1 -- 172.21.15.171:0/4039463541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700d17c0 msgr2=0x7ffa7006b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-09-20T20:08:18.695 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.682+0000 7ffa6effd700 1 -- 172.21.15.171:0/4039463541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700d17c0 msgr2=0x7ffa7006b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:18.695 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.682+0000 7ffa6effd700 1 --2- 172.21.15.171:0/4039463541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700d17c0 0x7ffa7006b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:18.696 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.682+0000 7ffa6e7fc700 1 --2- 172.21.15.171:0/4039463541 >> v2:172.21.15.152:3300/0 conn(0x7ffa700d1b90 0x7ffa700cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.696 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.682+0000 7ffa6effd700 1 --2- 172.21.15.171:0/4039463541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700d17c0 0x7ffa7006b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:18.696 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.682+0000 7ffa6dffb700 1 -- 172.21.15.171:0/4039463541 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990736536 0 0) 0x7ffa7006ab30 con 0x7ffa700cf940 2022-09-20T20:08:18.696 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.682+0000 7ffa6dffb700 1 -- 172.21.15.171:0/4039463541 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa5c0035b0 con 0x7ffa700cf940 2022-09-20T20:08:18.697 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.682+0000 7ffa6e7fc700 1 -- 172.21.15.171:0/4039463541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700d17c0 msgr2=0x7ffa7006b8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-09-20T20:08:18.697 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.682+0000 7ffa6e7fc700 1 --2- 172.21.15.171:0/4039463541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700d17c0 0x7ffa7006b8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.697 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.682+0000 7ffa6e7fc700 1 -- 172.21.15.171:0/4039463541 >> v1:172.21.15.171:6789/0 conn(0x7ffa700cf940 legacy=0x7ffa700ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:18.697 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.682+0000 7ffa6e7fc700 1 -- 172.21.15.171:0/4039463541 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7006ae10 con 0x7ffa700d1b90 2022-09-20T20:08:18.698 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.682+0000 7ffa6e7fc700 1 --2- 172.21.15.171:0/4039463541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa700d1b90 0x7ffa700cf400 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009840 tx=0x7ffa64009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=776d7b368bb44400 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:18.698 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.682+0000 7ffa6dffb700 1 -- 172.21.15.171:0/4039463541 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64011830 con 0x7ffa700d1b90 2022-09-20T20:08:18.698 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.682+0000 7ffa6dffb700 1 -- 172.21.15.171:0/4039463541 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa64011990 con 0x7ffa700d1b90 2022-09-20T20:08:18.698 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.682+0000 7ffa6dffb700 1 -- 172.21.15.171:0/4039463541 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64011d20 con 0x7ffa700d1b90 2022-09-20T20:08:18.699 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.683+0000 7ffa75642700 1 -- 172.21.15.171:0/4039463541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa700d1b90 msgr2=0x7ffa700cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:18.699 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.683+0000 7ffa75642700 1 --2- 172.21.15.171:0/4039463541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa700d1b90 0x7ffa700cf400 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffa64009840 tx=0x7ffa64009b50 comp rx=0 tx=0).stop 2022-09-20T20:08:18.699 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.683+0000 7ffa75642700 1 -- 172.21.15.171:0/4039463541 shutdown_connections 2022-09-20T20:08:18.700 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.683+0000 7ffa75642700 1 --2- 172.21.15.171:0/4039463541 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700d17c0 0x7ffa7006b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.700 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.683+0000 7ffa75642700 1 --2- 172.21.15.171:0/4039463541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa700d1b90 0x7ffa700cf400 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.700 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.683+0000 7ffa75642700 1 -- 172.21.15.171:0/4039463541 >> 172.21.15.171:0/4039463541 conn(0x7ffa7009abb0 msgr2=0x7ffa70088fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:18.701 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.683+0000 7ffa75642700 1 -- 172.21.15.171:0/4039463541 shutdown_connections 2022-09-20T20:08:18.701 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.683+0000 7ffa75642700 1 -- 172.21.15.171:0/4039463541 wait complete. 2022-09-20T20:08:18.701 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.684+0000 7ffa75642700 1 Processor -- start 2022-09-20T20:08:18.702 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.684+0000 7ffa75642700 1 -- start start 2022-09-20T20:08:18.702 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa75642700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700cf940 0x7ffa70151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.703 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa75642700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa700d17c0 0x7ffa700b2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.703 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa75642700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa700d1b90 0x7ffa700b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.703 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa75642700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa700b1320 con 0x7ffa700d1b90 2022-09-20T20:08:18.704 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa75642700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa700c5360 con 0x7ffa700d17c0 2022-09-20T20:08:18.704 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa75642700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa700b2e90 con 0x7ffa700cf940 2022-09-20T20:08:18.704 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa6effd700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700cf940 0x7ffa70151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.704 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa6e7fc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa700d17c0 0x7ffa700b2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.705 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa6effd700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700cf940 0x7ffa70151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:53724/0 (socket says 172.21.15.171:53724) 2022-09-20T20:08:18.705 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa6e7fc700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa700d17c0 0x7ffa700b2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:50268/0 (socket says 172.21.15.171:50268) 2022-09-20T20:08:18.705 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa6effd700 1 -- 172.21.15.171:0/2941995741 learned_addr learned my addr 172.21.15.171:0/2941995741 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-09-20T20:08:18.706 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa6f7fe700 1 --2- 172.21.15.171:0/2941995741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa700d1b90 0x7ffa700b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.706 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa6effd700 1 -- 172.21.15.171:0/2941995741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700cf940 msgr2=0x7ffa70151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2022-09-20T20:08:18.706 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa6effd700 1 -- 172.21.15.171:0/2941995741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700cf940 msgr2=0x7ffa70151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-09-20T20:08:18.706 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa6effd700 1 --2- 172.21.15.171:0/2941995741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700cf940 0x7ffa70151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:18.707 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa6effd700 1 --2- 172.21.15.171:0/2941995741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700cf940 0x7ffa70151b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:18.707 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa6e7fc700 1 -- 172.21.15.171:0/2941995741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700cf940 msgr2=0x7ffa70151b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-20T20:08:18.707 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa6e7fc700 1 --2- 172.21.15.171:0/2941995741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700cf940 0x7ffa70151b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.707 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa6e7fc700 1 -- 172.21.15.171:0/2941995741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa700d1b90 msgr2=0x7ffa700b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:18.707 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa6e7fc700 1 --2- 172.21.15.171:0/2941995741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa700d1b90 0x7ffa700b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.708 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa6e7fc700 1 -- 172.21.15.171:0/2941995741 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa640094a0 con 0x7ffa700d17c0 2022-09-20T20:08:18.708 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.685+0000 7ffa6f7fe700 1 --2- 172.21.15.171:0/2941995741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa700d1b90 0x7ffa700b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:08:18.708 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.686+0000 7ffa6e7fc700 1 --2- 172.21.15.171:0/2941995741 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa700d17c0 0x7ffa700b2410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ffa64016000 tx=0x7ffa64004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:18.708 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.686+0000 7ffa577fe700 1 -- 172.21.15.171:0/2941995741 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa640036a0 con 0x7ffa700d17c0 2022-09-20T20:08:18.709 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.686+0000 7ffa577fe700 1 -- 172.21.15.171:0/2941995741 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6401f070 con 0x7ffa700d17c0 2022-09-20T20:08:18.709 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.686+0000 7ffa75642700 1 -- 172.21.15.171:0/2941995741 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa700c80e0 con 0x7ffa700d17c0 2022-09-20T20:08:18.709 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.686+0000 7ffa577fe700 1 -- 172.21.15.171:0/2941995741 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa64003a20 con 0x7ffa700d17c0 2022-09-20T20:08:18.709 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.686+0000 7ffa75642700 1 -- 172.21.15.171:0/2941995741 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa700ca400 con 0x7ffa700d17c0 2022-09-20T20:08:18.709 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.686+0000 7ffa577fe700 1 -- 172.21.15.171:0/2941995741 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7ffa6400f050 con 0x7ffa700d17c0 2022-09-20T20:08:18.710 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.686+0000 7ffa577fe700 1 -- 172.21.15.171:0/2941995741 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7ffa64021070 con 0x7ffa700d17c0 2022-09-20T20:08:18.711 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.687+0000 7ffa75642700 1 -- 172.21.15.171:0/2941995741 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa700ce0b0 con 0x7ffa700d17c0 2022-09-20T20:08:18.711 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.689+0000 7ffa577fe700 1 -- 172.21.15.171:0/2941995741 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7ffa6402b020 con 0x7ffa700d17c0 2022-09-20T20:08:18.773 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.771+0000 7ffa75642700 1 -- 172.21.15.171:0/2941995741 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3f460e6a-25ec-4940-ba11-6cc651fca0b3", "id": 4} v 0) v1 -- 0x7ffa7004da60 con 0x7ffa700d17c0 2022-09-20T20:08:18.786 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.779+0000 7ffa577fe700 1 -- 172.21.15.171:0/2941995741 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3f460e6a-25ec-4940-ba11-6cc651fca0b3", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffa64015020 con 0x7ffa700d17c0 2022-09-20T20:08:18.787 INFO:teuthology.orchestra.run.smithi171.stdout:4 2022-09-20T20:08:18.788 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.780+0000 7ffa75642700 1 -- 172.21.15.171:0/2941995741 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa700d17c0 msgr2=0x7ffa700b2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:18.788 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.780+0000 7ffa75642700 1 --2- 172.21.15.171:0/2941995741 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa700d17c0 0x7ffa700b2410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ffa64016000 tx=0x7ffa64004750 comp rx=0 tx=0).stop 2022-09-20T20:08:18.789 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.780+0000 7ffa75642700 1 -- 172.21.15.171:0/2941995741 shutdown_connections 2022-09-20T20:08:18.789 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.780+0000 7ffa75642700 1 --2- 172.21.15.171:0/2941995741 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffa700cf940 0x7ffa70151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.789 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.780+0000 7ffa75642700 1 --2- 172.21.15.171:0/2941995741 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffa700d1b90 0x7ffa700b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.789 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.780+0000 7ffa75642700 1 --2- 172.21.15.171:0/2941995741 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffa700d17c0 0x7ffa700b2410 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.790 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.780+0000 7ffa75642700 1 -- 172.21.15.171:0/2941995741 >> 172.21.15.171:0/2941995741 conn(0x7ffa7009abb0 msgr2=0x7ffa7015a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:18.790 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.780+0000 7ffa75642700 1 -- 172.21.15.171:0/2941995741 shutdown_connections 2022-09-20T20:08:18.790 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.780+0000 7ffa75642700 1 -- 172.21.15.171:0/2941995741 wait complete. 2022-09-20T20:08:18.793 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 8adc5c61-c754-4cdf-8eda-b5d20a09bf5d 5 2022-09-20T20:08:18.868 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:18.866+0000 7f61be265200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-09-20T20:08:18.947 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:18.946+0000 7f61be265200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-09-20T20:08:18.955 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.953+0000 7f4cdd974700 1 Processor -- start 2022-09-20T20:08:18.955 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.953+0000 7f4cdd974700 1 -- start start 2022-09-20T20:08:18.959 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.954+0000 7f4cdd974700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd806c1e0 0x7f4cd8068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.960 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.954+0000 7f4cdd974700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4cd80ca020 0x7f4cd80cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.960 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.954+0000 7f4cdd974700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd80c8c00 con 0x7f4cd8157ee0 2022-09-20T20:08:18.960 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.954+0000 7f4cdd974700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd806c650 con 0x7f4cd80ca020 2022-09-20T20:08:18.961 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.954+0000 7f4cdd974700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd80c9480 con 0x7f4cd806c1e0 2022-09-20T20:08:18.961 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.954+0000 7f4cd67fc700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd806c1e0 0x7f4cd8068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.961 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.954+0000 7f4cd77fe700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4cd80ca020 0x7f4cd80cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.961 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.954+0000 7f4cd67fc700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd806c1e0 0x7f4cd8068ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:53732/0 (socket says 172.21.15.171:53732) 2022-09-20T20:08:18.962 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.954+0000 7f4cd67fc700 1 -- 172.21.15.171:0/2370129700 learned_addr learned my addr 172.21.15.171:0/2370129700 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-09-20T20:08:18.962 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.954+0000 7f4cd67fc700 1 -- 172.21.15.171:0/2370129700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd806c1e0 msgr2=0x7f4cd8068ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-20T20:08:18.962 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.954+0000 7f4cd67fc700 1 -- 172.21.15.171:0/2370129700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd806c1e0 msgr2=0x7f4cd8068ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:18.962 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.954+0000 7f4cd67fc700 1 --2- 172.21.15.171:0/2370129700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd806c1e0 0x7f4cd8068ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:18.962 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.954+0000 7f4cd67fc700 1 --2- 172.21.15.171:0/2370129700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd806c1e0 0x7f4cd8068ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:18.963 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.955+0000 7f4cd77fe700 1 -- 172.21.15.171:0/2370129700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd806c1e0 msgr2=0x7f4cd8068ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-09-20T20:08:18.963 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.955+0000 7f4cd77fe700 1 --2- 172.21.15.171:0/2370129700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd806c1e0 0x7f4cd8068ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.963 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.955+0000 7f4cd77fe700 1 -- 172.21.15.171:0/2370129700 >> v1:172.21.15.171:6789/0 conn(0x7f4cd8157ee0 legacy=0x7f4cd80c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:18.963 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.955+0000 7f4cd77fe700 1 -- 172.21.15.171:0/2370129700 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd806cb10 con 0x7f4cd80ca020 2022-09-20T20:08:18.964 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.955+0000 7f4cd77fe700 1 --2- 172.21.15.171:0/2370129700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd80ca020 0x7f4cd80cbaa0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009d90 tx=0x7f4cd000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c8743b676c0552b server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:18.964 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.955+0000 7f4cd5ffb700 1 -- 172.21.15.171:0/2370129700 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd000e070 con 0x7f4cd80ca020 2022-09-20T20:08:18.964 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.955+0000 7f4cd5ffb700 1 -- 172.21.15.171:0/2370129700 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd000bbd0 con 0x7f4cd80ca020 2022-09-20T20:08:18.964 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.955+0000 7f4cd5ffb700 1 -- 172.21.15.171:0/2370129700 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd0012430 con 0x7f4cd80ca020 2022-09-20T20:08:18.964 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.955+0000 7f4cdd974700 1 -- 172.21.15.171:0/2370129700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd80ca020 msgr2=0x7f4cd80cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:18.965 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.955+0000 7f4cdd974700 1 --2- 172.21.15.171:0/2370129700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd80ca020 0x7f4cd80cbaa0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009d90 tx=0x7f4cd000b330 comp rx=0 tx=0).stop 2022-09-20T20:08:18.965 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.956+0000 7f4cdd974700 1 -- 172.21.15.171:0/2370129700 shutdown_connections 2022-09-20T20:08:18.965 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.956+0000 7f4cdd974700 1 --2- 172.21.15.171:0/2370129700 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd80ca020 0x7f4cd80cbaa0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.965 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.956+0000 7f4cdd974700 1 --2- 172.21.15.171:0/2370129700 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd806c1e0 0x7f4cd8068ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.966 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.956+0000 7f4cdd974700 1 -- 172.21.15.171:0/2370129700 >> 172.21.15.171:0/2370129700 conn(0x7f4cd80b04e0 msgr2=0x7f4cd80cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:18.966 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.956+0000 7f4cdd974700 1 -- 172.21.15.171:0/2370129700 shutdown_connections 2022-09-20T20:08:18.966 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.956+0000 7f4cdd974700 1 -- 172.21.15.171:0/2370129700 wait complete. 2022-09-20T20:08:18.966 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.957+0000 7f4cdd974700 1 Processor -- start 2022-09-20T20:08:18.967 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.957+0000 7f4cdd974700 1 -- start start 2022-09-20T20:08:18.971 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.958+0000 7f4cdd974700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd806c1e0 0x7f4cd80c2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.971 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.958+0000 7f4cdd974700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cd80ca020 0x7f4cd8157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.971 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.958+0000 7f4cdd974700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd8157ee0 0x7f4cd80b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:18.971 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.958+0000 7f4cdd974700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd8159530 con 0x7f4cd80ca020 2022-09-20T20:08:18.972 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.958+0000 7f4cdd974700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd8157650 con 0x7f4cd806c1e0 2022-09-20T20:08:18.972 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.958+0000 7f4cdd974700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd80c3720 con 0x7f4cd8157ee0 2022-09-20T20:08:18.972 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.958+0000 7f4cd6ffd700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd806c1e0 0x7f4cd80c2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.972 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.958+0000 7f4cd77fe700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd8157ee0 0x7f4cd80b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.972 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.958+0000 7f4cd6ffd700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd806c1e0 0x7f4cd80c2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:50284/0 (socket says 172.21.15.171:50284) 2022-09-20T20:08:18.973 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.958+0000 7f4cd6ffd700 1 -- 172.21.15.171:0/1258478797 learned_addr learned my addr 172.21.15.171:0/1258478797 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-09-20T20:08:18.973 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.958+0000 7f4cd67fc700 1 --2- 172.21.15.171:0/1258478797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cd80ca020 0x7f4cd8157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:18.973 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.959+0000 7f4cd77fe700 1 -- 172.21.15.171:0/1258478797 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd8157ee0 msgr2=0x7f4cd80b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2022-09-20T20:08:18.974 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.959+0000 7f4cd77fe700 1 -- 172.21.15.171:0/1258478797 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd8157ee0 msgr2=0x7f4cd80b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-09-20T20:08:18.974 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.959+0000 7f4cd77fe700 1 --2- 172.21.15.171:0/1258478797 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd8157ee0 0x7f4cd80b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:18.974 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.959+0000 7f4cd77fe700 1 --2- 172.21.15.171:0/1258478797 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd8157ee0 0x7f4cd80b1310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:18.974 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.959+0000 7f4cd6ffd700 1 -- 172.21.15.171:0/1258478797 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd8157ee0 msgr2=0x7f4cd80b1310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-20T20:08:18.975 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.959+0000 7f4cd6ffd700 1 --2- 172.21.15.171:0/1258478797 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd8157ee0 0x7f4cd80b1310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.975 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.959+0000 7f4cd6ffd700 1 -- 172.21.15.171:0/1258478797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cd80ca020 msgr2=0x7f4cd8157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:18.975 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.959+0000 7f4cd6ffd700 1 --2- 172.21.15.171:0/1258478797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cd80ca020 0x7f4cd8157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:18.975 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.959+0000 7f4cd6ffd700 1 -- 172.21.15.171:0/1258478797 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd0009a70 con 0x7f4cd806c1e0 2022-09-20T20:08:18.976 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.959+0000 7f4cd6ffd700 1 --2- 172.21.15.171:0/1258478797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd806c1e0 0x7f4cd80c2600 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800c450 tx=0x7f4cc800c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:18.976 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.959+0000 7f4cbffff700 1 -- 172.21.15.171:0/1258478797 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80052d0 con 0x7f4cd806c1e0 2022-09-20T20:08:18.976 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.959+0000 7f4cbffff700 1 -- 172.21.15.171:0/1258478797 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc8005430 con 0x7f4cd806c1e0 2022-09-20T20:08:18.976 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.959+0000 7f4cbffff700 1 -- 172.21.15.171:0/1258478797 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80038c0 con 0x7f4cd806c1e0 2022-09-20T20:08:18.977 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.959+0000 7f4cdd974700 1 -- 172.21.15.171:0/1258478797 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd80b1850 con 0x7f4cd806c1e0 2022-09-20T20:08:18.977 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.959+0000 7f4cdd974700 1 -- 172.21.15.171:0/1258478797 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd80c39c0 con 0x7f4cd806c1e0 2022-09-20T20:08:18.978 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.959+0000 7f4cbffff700 1 -- 172.21.15.171:0/1258478797 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f4cc8019030 con 0x7f4cd806c1e0 2022-09-20T20:08:18.978 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.959+0000 7f4cbffff700 1 -- 172.21.15.171:0/1258478797 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f4cc8011c90 con 0x7f4cd806c1e0 2022-09-20T20:08:18.978 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.960+0000 7f4cdd974700 1 -- 172.21.15.171:0/1258478797 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd804da60 con 0x7f4cd806c1e0 2022-09-20T20:08:18.978 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:18.964+0000 7f4cbffff700 1 -- 172.21.15.171:0/1258478797 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7f4cc8017070 con 0x7f4cd806c1e0 2022-09-20T20:08:18.979 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:18.968+0000 7fbc19c2c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-09-20T20:08:19.023 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:19.021+0000 7f61be265200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-09-20T20:08:19.048 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.047+0000 7f4cdd974700 1 -- 172.21.15.171:0/1258478797 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8adc5c61-c754-4cdf-8eda-b5d20a09bf5d", "id": 5} v 0) v1 -- 0x7f4cd81596e0 con 0x7f4cd806c1e0 2022-09-20T20:08:19.056 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.054+0000 7f4cbffff700 1 -- 172.21.15.171:0/1258478797 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8adc5c61-c754-4cdf-8eda-b5d20a09bf5d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4cc8011720 con 0x7f4cd806c1e0 2022-09-20T20:08:19.057 INFO:teuthology.orchestra.run.smithi171.stdout:5 2022-09-20T20:08:19.060 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.055+0000 7f4cdd974700 1 -- 172.21.15.171:0/1258478797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd806c1e0 msgr2=0x7f4cd80c2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:19.060 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.055+0000 7f4cdd974700 1 --2- 172.21.15.171:0/1258478797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd806c1e0 0x7f4cd80c2600 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800c450 tx=0x7f4cc800c760 comp rx=0 tx=0).stop 2022-09-20T20:08:19.061 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.055+0000 7f4cdd974700 1 -- 172.21.15.171:0/1258478797 shutdown_connections 2022-09-20T20:08:19.061 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.055+0000 7f4cdd974700 1 --2- 172.21.15.171:0/1258478797 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4cd8157ee0 0x7f4cd80b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.061 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.055+0000 7f4cdd974700 1 --2- 172.21.15.171:0/1258478797 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4cd806c1e0 0x7f4cd80c2600 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.062 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.055+0000 7f4cdd974700 1 --2- 172.21.15.171:0/1258478797 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cd80ca020 0x7f4cd8157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.062 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.055+0000 7f4cdd974700 1 -- 172.21.15.171:0/1258478797 >> 172.21.15.171:0/1258478797 conn(0x7f4cd80b04e0 msgr2=0x7f4cd80cc870 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:19.063 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.055+0000 7f4cdd974700 1 -- 172.21.15.171:0/1258478797 shutdown_connections 2022-09-20T20:08:19.063 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.055+0000 7f4cdd974700 1 -- 172.21.15.171:0/1258478797 wait complete. 2022-09-20T20:08:19.070 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new be0e8f6c-e8df-4488-a8c2-ffd847668001 6 2022-09-20T20:08:19.099 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:19.097+0000 7f61be265200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-09-20T20:08:19.104 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:19.102+0000 7fbc19c2c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-09-20T20:08:19.192 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.190+0000 7f83ff831700 1 Processor -- start 2022-09-20T20:08:19.193 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.190+0000 7f83ff831700 1 -- start start 2022-09-20T20:08:19.196 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.191+0000 7f83ff831700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f83f8155af0 0x7f83f80c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:19.196 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.191+0000 7f83ff831700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80b09c0 0x7f83f80ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:19.197 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.191+0000 7f83ff831700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f83f80cea10 0x7f83f80cb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:19.197 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.191+0000 7f83ff831700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f80cee50 con 0x7f83f8155af0 2022-09-20T20:08:19.197 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.191+0000 7f83ff831700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f81586e0 con 0x7f83f80cea10 2022-09-20T20:08:19.197 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.191+0000 7f83ff831700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f81589c0 con 0x7f83f80b09c0 2022-09-20T20:08:19.197 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83fcdcc700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80b09c0 0x7f83f80ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:19.198 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83fddce700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f83f80cea10 0x7f83f80cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:19.198 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83fddce700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f83f80cea10 0x7f83f80cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:50294/0 (socket says 172.21.15.171:50294) 2022-09-20T20:08:19.198 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83fcdcc700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80b09c0 0x7f83f80ce4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:53750/0 (socket says 172.21.15.171:53750) 2022-09-20T20:08:19.198 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83fddce700 1 -- 172.21.15.171:0/1679649770 learned_addr learned my addr 172.21.15.171:0/1679649770 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-09-20T20:08:19.199 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83fd5cd700 1 --2- 172.21.15.171:0/1679649770 >> v2:172.21.15.152:3300/0 conn(0x7f83f8155af0 0x7f83f80c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:19.199 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83fcdcc700 1 -- 172.21.15.171:0/1679649770 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80b09c0 msgr2=0x7f83f80ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-20T20:08:19.199 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83fcdcc700 1 -- 172.21.15.171:0/1679649770 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80b09c0 msgr2=0x7f83f80ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:19.200 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83fcdcc700 1 --2- 172.21.15.171:0/1679649770 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80b09c0 0x7f83f80ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:19.200 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83fcdcc700 1 --2- 172.21.15.171:0/1679649770 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80b09c0 0x7f83f80ce4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:19.200 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83fddce700 1 -- 172.21.15.171:0/1679649770 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80b09c0 msgr2=0x7f83f80ce4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-09-20T20:08:19.201 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83fddce700 1 --2- 172.21.15.171:0/1679649770 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80b09c0 0x7f83f80ce4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.201 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83fddce700 1 -- 172.21.15.171:0/1679649770 >> v2:172.21.15.152:3300/0 conn(0x7f83f8155af0 msgr2=0x7f83f80c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:19.201 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83fddce700 1 --2- 172.21.15.171:0/1679649770 >> v2:172.21.15.152:3300/0 conn(0x7f83f8155af0 0x7f83f80c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.201 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83fddce700 1 -- 172.21.15.171:0/1679649770 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f8158ca0 con 0x7f83f80cea10 2022-09-20T20:08:19.202 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83fddce700 1 --2- 172.21.15.171:0/1679649770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83f80cea10 0x7f83f80cb010 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f83f80b44a0 tx=0x7f83f000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1de7e7d050deee5 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:19.202 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83e7fff700 1 -- 172.21.15.171:0/1679649770 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f000e070 con 0x7f83f80cea10 2022-09-20T20:08:19.202 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83e7fff700 1 -- 172.21.15.171:0/1679649770 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f000b910 con 0x7f83f80cea10 2022-09-20T20:08:19.202 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.192+0000 7f83e7fff700 1 -- 172.21.15.171:0/1679649770 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f000bcc0 con 0x7f83f80cea10 2022-09-20T20:08:19.203 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.193+0000 7f83ff831700 1 -- 172.21.15.171:0/1679649770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83f80cea10 msgr2=0x7f83f80cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:19.203 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.193+0000 7f83ff831700 1 --2- 172.21.15.171:0/1679649770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83f80cea10 0x7f83f80cb010 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f83f80b44a0 tx=0x7f83f000b330 comp rx=0 tx=0).stop 2022-09-20T20:08:19.203 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.193+0000 7f83ff831700 1 -- 172.21.15.171:0/1679649770 shutdown_connections 2022-09-20T20:08:19.203 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.193+0000 7f83ff831700 1 --2- 172.21.15.171:0/1679649770 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83f80cea10 0x7f83f80cb010 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.204 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.193+0000 7f83ff831700 1 --2- 172.21.15.171:0/1679649770 >> v2:172.21.15.152:3300/0 conn(0x7f83f8155af0 0x7f83f80c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.204 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.193+0000 7f83ff831700 1 --2- 172.21.15.171:0/1679649770 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80b09c0 0x7f83f80ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.204 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.193+0000 7f83ff831700 1 -- 172.21.15.171:0/1679649770 >> 172.21.15.171:0/1679649770 conn(0x7f83f8069df0 msgr2=0x7f83f806a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:19.204 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.193+0000 7f83ff831700 1 -- 172.21.15.171:0/1679649770 shutdown_connections 2022-09-20T20:08:19.204 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.193+0000 7f83ff831700 1 -- 172.21.15.171:0/1679649770 wait complete. 2022-09-20T20:08:19.208 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.195+0000 7f83ff831700 1 Processor -- start 2022-09-20T20:08:19.208 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.195+0000 7f83ff831700 1 -- start start 2022-09-20T20:08:19.208 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83ff831700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83f80b09c0 0x7f83f80c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:19.208 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83ff831700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80cea10 0x7f83f80c2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:19.209 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83ff831700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83f8155af0 0x7f83f80b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:19.209 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83ff831700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f814f510 con 0x7f83f80b09c0 2022-09-20T20:08:19.210 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83ff831700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f814c680 con 0x7f83f8155af0 2022-09-20T20:08:19.211 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83ff831700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f80c2a40 con 0x7f83f80cea10 2022-09-20T20:08:19.211 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83fcdcc700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80cea10 0x7f83f80c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:19.212 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83fddce700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83f8155af0 0x7f83f80b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:19.212 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83fcdcc700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80cea10 0x7f83f80c2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:53752/0 (socket says 172.21.15.171:53752) 2022-09-20T20:08:19.213 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83fcdcc700 1 -- 172.21.15.171:0/4037394100 learned_addr learned my addr 172.21.15.171:0/4037394100 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-09-20T20:08:19.213 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83fd5cd700 1 --2- 172.21.15.171:0/4037394100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83f80b09c0 0x7f83f80c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:19.213 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83fcdcc700 1 -- 172.21.15.171:0/4037394100 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80cea10 msgr2=0x7f83f80c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2022-09-20T20:08:19.214 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83fcdcc700 1 -- 172.21.15.171:0/4037394100 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80cea10 msgr2=0x7f83f80c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-09-20T20:08:19.214 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83fcdcc700 1 --2- 172.21.15.171:0/4037394100 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80cea10 0x7f83f80c2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:19.215 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83fcdcc700 1 --2- 172.21.15.171:0/4037394100 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80cea10 0x7f83f80c2340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:19.215 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83fddce700 1 -- 172.21.15.171:0/4037394100 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80cea10 msgr2=0x7f83f80c2340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-20T20:08:19.216 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83fddce700 1 --2- 172.21.15.171:0/4037394100 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80cea10 0x7f83f80c2340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.216 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83fddce700 1 -- 172.21.15.171:0/4037394100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83f80b09c0 msgr2=0x7f83f80c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:19.217 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83fddce700 1 --2- 172.21.15.171:0/4037394100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83f80b09c0 0x7f83f80c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.217 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.196+0000 7f83fddce700 1 -- 172.21.15.171:0/4037394100 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f0009b30 con 0x7f83f8155af0 2022-09-20T20:08:19.218 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.197+0000 7f83fddce700 1 --2- 172.21.15.171:0/4037394100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83f8155af0 0x7f83f80b3570 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f83f0015000 tx=0x7f83f0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:19.218 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.197+0000 7f83e5ffb700 1 -- 172.21.15.171:0/4037394100 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f00099b0 con 0x7f83f8155af0 2022-09-20T20:08:19.218 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.197+0000 7f83e5ffb700 1 -- 172.21.15.171:0/4037394100 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f00092e0 con 0x7f83f8155af0 2022-09-20T20:08:19.219 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.197+0000 7f83e5ffb700 1 -- 172.21.15.171:0/4037394100 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0004470 con 0x7f83f8155af0 2022-09-20T20:08:19.219 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.197+0000 7f83ff831700 1 -- 172.21.15.171:0/4037394100 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f80c2d20 con 0x7f83f8155af0 2022-09-20T20:08:19.220 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.197+0000 7f83ff831700 1 -- 172.21.15.171:0/4037394100 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f80c3000 con 0x7f83f8155af0 2022-09-20T20:08:19.220 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.197+0000 7f83e5ffb700 1 -- 172.21.15.171:0/4037394100 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f83f0004840 con 0x7f83f8155af0 2022-09-20T20:08:19.221 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.197+0000 7f83e5ffb700 1 -- 172.21.15.171:0/4037394100 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f83f001cc10 con 0x7f83f8155af0 2022-09-20T20:08:19.221 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.198+0000 7f83ff831700 1 -- 172.21.15.171:0/4037394100 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f804da60 con 0x7f83f8155af0 2022-09-20T20:08:19.221 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.200+0000 7f83e5ffb700 1 -- 172.21.15.171:0/4037394100 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7f83f0020030 con 0x7f83f8155af0 2022-09-20T20:08:19.285 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.283+0000 7f83ff831700 1 -- 172.21.15.171:0/4037394100 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "be0e8f6c-e8df-4488-a8c2-ffd847668001", "id": 6} v 0) v1 -- 0x7f83f8158f80 con 0x7f83f8155af0 2022-09-20T20:08:19.291 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.289+0000 7f83e5ffb700 1 -- 172.21.15.171:0/4037394100 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be0e8f6c-e8df-4488-a8c2-ffd847668001", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f83f00330b0 con 0x7f83f8155af0 2022-09-20T20:08:19.291 INFO:teuthology.orchestra.run.smithi171.stdout:6 2022-09-20T20:08:19.292 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.290+0000 7f83ff831700 1 -- 172.21.15.171:0/4037394100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83f8155af0 msgr2=0x7f83f80b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:19.293 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.290+0000 7f83ff831700 1 --2- 172.21.15.171:0/4037394100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83f8155af0 0x7f83f80b3570 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f83f0015000 tx=0x7f83f0004ad0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.293 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.290+0000 7f83ff831700 1 -- 172.21.15.171:0/4037394100 shutdown_connections 2022-09-20T20:08:19.293 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.290+0000 7f83ff831700 1 --2- 172.21.15.171:0/4037394100 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f83f8155af0 0x7f83f80b3570 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.293 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.290+0000 7f83ff831700 1 --2- 172.21.15.171:0/4037394100 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83f80b09c0 0x7f83f80c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.294 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.290+0000 7f83ff831700 1 --2- 172.21.15.171:0/4037394100 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f83f80cea10 0x7f83f80c2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.294 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.290+0000 7f83ff831700 1 -- 172.21.15.171:0/4037394100 >> 172.21.15.171:0/4037394100 conn(0x7f83f8069df0 msgr2=0x7f83f80c9740 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:19.294 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.290+0000 7f83ff831700 1 -- 172.21.15.171:0/4037394100 shutdown_connections 2022-09-20T20:08:19.294 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.290+0000 7f83ff831700 1 -- 172.21.15.171:0/4037394100 wait complete. 2022-09-20T20:08:19.303 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 7841c1e5-c5d4-4b08-917e-a6ff8ef0cc02 7 2022-09-20T20:08:19.323 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:19.321+0000 7f61be265200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-09-20T20:08:19.338 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:19.336+0000 7fbc19c2c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-09-20T20:08:19.411 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:19.409+0000 7fbc19c2c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-09-20T20:08:19.460 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.458+0000 7f791515f700 1 Processor -- start 2022-09-20T20:08:19.461 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.458+0000 7f791515f700 1 -- start start 2022-09-20T20:08:19.464 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.459+0000 7f791515f700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f791006ff00 0x7f79100ca310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:19.464 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.460+0000 7f791515f700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f79100adb50 0x7f79100ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:19.465 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.460+0000 7f791515f700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79100c8ef0 con 0x7f7910158f00 2022-09-20T20:08:19.465 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.460+0000 7f791515f700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7910069c60 con 0x7f791006ff00 2022-09-20T20:08:19.465 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.460+0000 7f791515f700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7910071410 con 0x7f79100adb50 2022-09-20T20:08:19.465 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.460+0000 7f790ed9d700 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f7910158f00 0x7f7910070d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:49892/0 (socket says 172.21.15.171:49892) 2022-09-20T20:08:19.466 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.460+0000 7f790ed9d700 1 -- 172.21.15.171:0/3681017951 learned_addr learned my addr 172.21.15.171:0/3681017951 (peer_addr_for_me v1:172.21.15.171:0/0) 2022-09-20T20:08:19.466 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.460+0000 7f790f59e700 1 --2- 172.21.15.171:0/3681017951 >> v2:172.21.15.171:3300/0 conn(0x7f79100adb50 0x7f79100ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:19.466 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.460+0000 7f790e59c700 1 --2- 172.21.15.171:0/3681017951 >> v2:172.21.15.152:3300/0 conn(0x7f791006ff00 0x7f79100ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:19.466 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.460+0000 7f790f59e700 1 -- 172.21.15.171:0/3681017951 >> v2:172.21.15.152:3300/0 conn(0x7f791006ff00 msgr2=0x7f79100ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:19.467 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.460+0000 7f790f59e700 1 --2- 172.21.15.171:0/3681017951 >> v2:172.21.15.152:3300/0 conn(0x7f791006ff00 0x7f79100ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.467 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.460+0000 7f790f59e700 1 -- 172.21.15.171:0/3681017951 >> v1:172.21.15.171:6789/0 conn(0x7f7910158f00 legacy=0x7f7910070d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:19.467 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.460+0000 7f790f59e700 1 -- 172.21.15.171:0/3681017951 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7910069730 con 0x7f79100adb50 2022-09-20T20:08:19.467 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.460+0000 7f790f59e700 1 --2- 172.21.15.171:0/3681017951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79100adb50 0x7f79100ce500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f79100c8ab0 tx=0x7f790800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2778640383fb5f4c server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:19.468 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.460+0000 7f790dd9b700 1 -- 172.21.15.171:0/3681017951 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790800e070 con 0x7f79100adb50 2022-09-20T20:08:19.468 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.460+0000 7f790dd9b700 1 -- 172.21.15.171:0/3681017951 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790800bb20 con 0x7f79100adb50 2022-09-20T20:08:19.468 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.460+0000 7f790dd9b700 1 -- 172.21.15.171:0/3681017951 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908012430 con 0x7f79100adb50 2022-09-20T20:08:19.468 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.461+0000 7f791515f700 1 -- 172.21.15.171:0/3681017951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79100adb50 msgr2=0x7f79100ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:19.469 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.461+0000 7f791515f700 1 --2- 172.21.15.171:0/3681017951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79100adb50 0x7f79100ce500 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f79100c8ab0 tx=0x7f790800b330 comp rx=0 tx=0).stop 2022-09-20T20:08:19.469 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.461+0000 7f791515f700 1 -- 172.21.15.171:0/3681017951 shutdown_connections 2022-09-20T20:08:19.469 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.461+0000 7f791515f700 1 --2- 172.21.15.171:0/3681017951 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79100adb50 0x7f79100ce500 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.469 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.461+0000 7f791515f700 1 --2- 172.21.15.171:0/3681017951 >> v2:172.21.15.152:3300/0 conn(0x7f791006ff00 0x7f79100ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.470 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.461+0000 7f791515f700 1 -- 172.21.15.171:0/3681017951 >> 172.21.15.171:0/3681017951 conn(0x7f7910069df0 msgr2=0x7f791006a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:19.470 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.461+0000 7f791515f700 1 -- 172.21.15.171:0/3681017951 shutdown_connections 2022-09-20T20:08:19.470 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.461+0000 7f791515f700 1 -- 172.21.15.171:0/3681017951 wait complete. 2022-09-20T20:08:19.474 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.463+0000 7f791515f700 1 Processor -- start 2022-09-20T20:08:19.474 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.463+0000 7f791515f700 1 -- start start 2022-09-20T20:08:19.474 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.464+0000 7f791515f700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f791006ff00 0x7f79101e3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:19.474 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.464+0000 7f791515f700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79100adb50 0x7f79101e4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:19.475 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.464+0000 7f791515f700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7910158f00 0x7f79101ddfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:19.475 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.464+0000 7f791515f700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79101e3750 con 0x7f7910158f00 2022-09-20T20:08:19.475 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.464+0000 7f791515f700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79101e3f30 con 0x7f79100adb50 2022-09-20T20:08:19.475 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.464+0000 7f791515f700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79101e4210 con 0x7f791006ff00 2022-09-20T20:08:19.476 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.464+0000 7f790ed9d700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f791006ff00 0x7f79101e3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:19.476 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.464+0000 7f790ed9d700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f791006ff00 0x7f79101e3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:53764/0 (socket says 172.21.15.171:53764) 2022-09-20T20:08:19.476 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.464+0000 7f790ed9d700 1 -- 172.21.15.171:0/1249446324 learned_addr learned my addr 172.21.15.171:0/1249446324 (peer_addr_for_me v2:172.21.15.171:0/0) 2022-09-20T20:08:19.476 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.464+0000 7f790f59e700 1 --2- 172.21.15.171:0/1249446324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7910158f00 0x7f79101ddfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:19.477 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.464+0000 7f790e59c700 1 --2- 172.21.15.171:0/1249446324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79100adb50 0x7f79101e4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:19.477 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.464+0000 7f790ed9d700 1 -- 172.21.15.171:0/1249446324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f791006ff00 msgr2=0x7f79101e3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2022-09-20T20:08:19.477 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.464+0000 7f790ed9d700 1 -- 172.21.15.171:0/1249446324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f791006ff00 msgr2=0x7f79101e3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-09-20T20:08:19.477 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.464+0000 7f790ed9d700 1 --2- 172.21.15.171:0/1249446324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f791006ff00 0x7f79101e3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:19.477 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.464+0000 7f790ed9d700 1 --2- 172.21.15.171:0/1249446324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f791006ff00 0x7f79101e3950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:19.478 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.464+0000 7f790f59e700 1 -- 172.21.15.171:0/1249446324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f791006ff00 msgr2=0x7f79101e3950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-20T20:08:19.478 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.464+0000 7f790f59e700 1 --2- 172.21.15.171:0/1249446324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f791006ff00 0x7f79101e3950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.478 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.465+0000 7f790f59e700 1 -- 172.21.15.171:0/1249446324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79100adb50 msgr2=0x7f79101e4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:19.478 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.465+0000 7f790f59e700 1 --2- 172.21.15.171:0/1249446324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79100adb50 0x7f79101e4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.479 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.465+0000 7f790f59e700 1 -- 172.21.15.171:0/1249446324 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7908009a70 con 0x7f7910158f00 2022-09-20T20:08:19.479 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.465+0000 7f790e59c700 1 --2- 172.21.15.171:0/1249446324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79100adb50 0x7f79101e4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:08:19.479 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.465+0000 7f790f59e700 1 --2- 172.21.15.171:0/1249446324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7910158f00 0x7f79101ddfe0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7908016000 tx=0x7f7908004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:19.480 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.465+0000 7f78f77fe700 1 -- 172.21.15.171:0/1249446324 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908012430 con 0x7f7910158f00 2022-09-20T20:08:19.480 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.465+0000 7f78f77fe700 1 -- 172.21.15.171:0/1249446324 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7908020070 con 0x7f7910158f00 2022-09-20T20:08:19.480 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.465+0000 7f791515f700 1 -- 172.21.15.171:0/1249446324 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79101e44f0 con 0x7f7910158f00 2022-09-20T20:08:19.480 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.465+0000 7f78f77fe700 1 -- 172.21.15.171:0/1249446324 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7908004280 con 0x7f7910158f00 2022-09-20T20:08:19.480 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.465+0000 7f791515f700 1 -- 172.21.15.171:0/1249446324 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79101e4ab0 con 0x7f7910158f00 2022-09-20T20:08:19.481 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.465+0000 7f78f77fe700 1 -- 172.21.15.171:0/1249446324 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f790802e070 con 0x7f7910158f00 2022-09-20T20:08:19.481 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.465+0000 7f78f77fe700 1 -- 172.21.15.171:0/1249446324 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f7908022070 con 0x7f7910158f00 2022-09-20T20:08:19.481 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.466+0000 7f791515f700 1 -- 172.21.15.171:0/1249446324 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79101e4c40 con 0x7f7910158f00 2022-09-20T20:08:19.481 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.468+0000 7f78f77fe700 1 -- 172.21.15.171:0/1249446324 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7f790802c060 con 0x7f7910158f00 2022-09-20T20:08:19.551 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.549+0000 7f791515f700 1 -- 172.21.15.171:0/1249446324 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7841c1e5-c5d4-4b08-917e-a6ff8ef0cc02", "id": 7} v 0) v1 -- 0x7f791004da60 con 0x7f7910158f00 2022-09-20T20:08:19.554 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.553+0000 7f78f77fe700 1 -- 172.21.15.171:0/1249446324 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7841c1e5-c5d4-4b08-917e-a6ff8ef0cc02", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7908004650 con 0x7f7910158f00 2022-09-20T20:08:19.555 INFO:teuthology.orchestra.run.smithi171.stdout:7 2022-09-20T20:08:19.556 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.554+0000 7f791515f700 1 -- 172.21.15.171:0/1249446324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7910158f00 msgr2=0x7f79101ddfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:19.556 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.554+0000 7f791515f700 1 --2- 172.21.15.171:0/1249446324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7910158f00 0x7f79101ddfe0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7908016000 tx=0x7f7908004ad0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.557 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.554+0000 7f791515f700 1 -- 172.21.15.171:0/1249446324 shutdown_connections 2022-09-20T20:08:19.557 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.554+0000 7f791515f700 1 --2- 172.21.15.171:0/1249446324 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f791006ff00 0x7f79101e3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.557 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.554+0000 7f791515f700 1 --2- 172.21.15.171:0/1249446324 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7910158f00 0x7f79101ddfe0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.557 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.554+0000 7f791515f700 1 --2- 172.21.15.171:0/1249446324 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79100adb50 0x7f79101e4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.558 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.554+0000 7f791515f700 1 -- 172.21.15.171:0/1249446324 >> 172.21.15.171:0/1249446324 conn(0x7f7910069df0 msgr2=0x7f79100b2120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:19.558 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.554+0000 7f791515f700 1 -- 172.21.15.171:0/1249446324 shutdown_connections 2022-09-20T20:08:19.558 INFO:teuthology.orchestra.run.smithi171.stderr:2022-09-20T20:08:19.554+0000 7f791515f700 1 -- 172.21.15.171:0/1249446324 wait complete. 2022-09-20T20:08:19.568 INFO:tasks.ceph.osd.0:Restarting daemon 2022-09-20T20:08:19.568 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-09-20T20:08:19.571 INFO:tasks.ceph.osd.0:Started 2022-09-20T20:08:19.571 INFO:tasks.ceph.osd.1:Restarting daemon 2022-09-20T20:08:19.572 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-09-20T20:08:19.574 INFO:tasks.ceph.osd.1:Started 2022-09-20T20:08:19.574 INFO:tasks.ceph.osd.2:Restarting daemon 2022-09-20T20:08:19.574 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-09-20T20:08:19.577 INFO:tasks.ceph.osd.2:Started 2022-09-20T20:08:19.577 INFO:tasks.ceph.osd.3:Restarting daemon 2022-09-20T20:08:19.578 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-09-20T20:08:19.580 INFO:tasks.ceph.osd.3:Started 2022-09-20T20:08:19.580 INFO:tasks.ceph.osd.4:Restarting daemon 2022-09-20T20:08:19.581 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2022-09-20T20:08:19.583 INFO:tasks.ceph.osd.4:Started 2022-09-20T20:08:19.584 INFO:tasks.ceph.osd.5:Restarting daemon 2022-09-20T20:08:19.584 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2022-09-20T20:08:19.586 INFO:tasks.ceph.osd.5:Started 2022-09-20T20:08:19.590 INFO:tasks.ceph.osd.6:Restarting daemon 2022-09-20T20:08:19.591 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2022-09-20T20:08:19.594 INFO:tasks.ceph.osd.6:Started 2022-09-20T20:08:19.595 INFO:tasks.ceph.osd.7:Restarting daemon 2022-09-20T20:08:19.595 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2022-09-20T20:08:19.598 INFO:tasks.ceph.osd.7:Started 2022-09-20T20:08:19.599 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-20T20:08:19.742 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.740+0000 7efd34bc6700 1 Processor -- start 2022-09-20T20:08:19.742 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.740+0000 7efd34bc6700 1 -- start start 2022-09-20T20:08:19.747 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.741+0000 7efd34bc6700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd300cc070 0x7efd300cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:19.747 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.741+0000 7efd34bc6700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd300c9f40 con 0x7efd300cd5a0 2022-09-20T20:08:19.747 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.741+0000 7efd34bc6700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd3015cce0 con 0x7efd300b4c30 2022-09-20T20:08:19.747 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.741+0000 7efd34bc6700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd3015d8f0 con 0x7efd300cc070 2022-09-20T20:08:19.748 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2ed9d700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7efd300cd5a0 0x7efd300cda20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:40842/0 (socket says 172.21.15.152:40842) 2022-09-20T20:08:19.748 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2ed9d700 1 -- 172.21.15.152:0/3550713934 learned_addr learned my addr 172.21.15.152:0/3550713934 (peer_addr_for_me v1:172.21.15.152:0/0) 2022-09-20T20:08:19.748 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2dd9b700 1 --2- 172.21.15.152:0/3550713934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd300cc070 0x7efd300cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:19.748 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2dd9b700 1 -- 172.21.15.152:0/3550713934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd300cc070 msgr2=0x7efd300cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2022-09-20T20:08:19.748 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2dd9b700 1 -- 172.21.15.152:0/3550713934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd300cc070 msgr2=0x7efd300cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:19.749 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2dd9b700 1 --2- 172.21.15.152:0/3550713934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd300cc070 0x7efd300cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:19.749 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2dd9b700 1 --2- 172.21.15.152:0/3550713934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd300cc070 0x7efd300cc4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:19.749 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2d59a700 1 -- 172.21.15.152:0/3550713934 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062619541 0 0) 0x7efd300c9f40 con 0x7efd300cd5a0 2022-09-20T20:08:19.749 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2d59a700 1 -- 172.21.15.152:0/3550713934 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd140035b0 con 0x7efd300cd5a0 2022-09-20T20:08:19.750 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2d59a700 1 -- 172.21.15.152:0/3550713934 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607788135 0 0) 0x7efd3015cce0 con 0x7efd300b4c30 2022-09-20T20:08:19.750 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2d59a700 1 -- 172.21.15.152:0/3550713934 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd300c9f40 con 0x7efd300b4c30 2022-09-20T20:08:19.750 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2d59a700 1 -- 172.21.15.152:0/3550713934 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 812706343 0 0) 0x7efd140035b0 con 0x7efd300cd5a0 2022-09-20T20:08:19.750 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2d59a700 1 -- 172.21.15.152:0/3550713934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd300cc070 msgr2=0x7efd300cc4e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-09-20T20:08:19.750 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2d59a700 1 --2- 172.21.15.152:0/3550713934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd300cc070 0x7efd300cc4e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.751 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2d59a700 1 -- 172.21.15.152:0/3550713934 >> v1:172.21.15.171:6789/0 conn(0x7efd300b4c30 legacy=0x7efd300ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:19.751 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2d59a700 1 -- 172.21.15.152:0/3550713934 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3015cfc0 con 0x7efd300cd5a0 2022-09-20T20:08:19.752 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2d59a700 1 -- 172.21.15.152:0/3550713934 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3495984756 0 0) 0x7efd280019f0 con 0x7efd300cd5a0 2022-09-20T20:08:19.752 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2d59a700 1 -- 172.21.15.152:0/3550713934 >> v1:172.21.15.152:6789/0 conn(0x7efd300cd5a0 legacy=0x7efd300cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:19.752 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2d59a700 1 --2- 172.21.15.152:0/3550713934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd14004c50 0x7efd14005020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:19.753 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2d59a700 1 --2- 172.21.15.152:0/3550713934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd140037f0 0x7efd14003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:19.753 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2d59a700 1 --2- 172.21.15.152:0/3550713934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd300cc070 0x7efd14004250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:19.753 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2d59a700 1 -- 172.21.15.152:0/3550713934 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd20001230 con 0x7efd140037f0 2022-09-20T20:08:19.753 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2d59a700 1 -- 172.21.15.152:0/3550713934 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd3015d8f0 con 0x7efd14004c50 2022-09-20T20:08:19.753 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2d59a700 1 -- 172.21.15.152:0/3550713934 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1400bbf0 con 0x7efd300cc070 2022-09-20T20:08:19.754 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2e59c700 1 --2- 172.21.15.152:0/3550713934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd14004c50 0x7efd14005020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:19.754 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2dd9b700 1 --2- 172.21.15.152:0/3550713934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd140037f0 0x7efd14003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:19.754 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.742+0000 7efd2ed9d700 1 --2- 172.21.15.152:0/3550713934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd300cc070 0x7efd14004250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:19.754 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.743+0000 7efd2dd9b700 1 -- 172.21.15.152:0/3550713934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd300cc070 msgr2=0x7efd14004250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:19.755 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.743+0000 7efd2dd9b700 1 --2- 172.21.15.152:0/3550713934 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd300cc070 0x7efd14004250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.755 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.743+0000 7efd2dd9b700 1 -- 172.21.15.152:0/3550713934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd14004c50 msgr2=0x7efd14005020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:19.755 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.743+0000 7efd2dd9b700 1 --2- 172.21.15.152:0/3550713934 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd14004c50 0x7efd14005020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.755 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.743+0000 7efd2dd9b700 1 -- 172.21.15.152:0/3550713934 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd140035b0 con 0x7efd140037f0 2022-09-20T20:08:19.756 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.743+0000 7efd2dd9b700 1 --2- 172.21.15.152:0/3550713934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd140037f0 0x7efd14003c60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efd240098c0 tx=0x7efd14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de04cf4aa37ac0e8 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:19.756 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.743+0000 7efd2d59a700 1 -- 172.21.15.152:0/3550713934 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd2400c070 con 0x7efd140037f0 2022-09-20T20:08:19.756 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.743+0000 7efd2d59a700 1 -- 172.21.15.152:0/3550713934 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd24004020 con 0x7efd140037f0 2022-09-20T20:08:19.757 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.743+0000 7efd2d59a700 1 -- 172.21.15.152:0/3550713934 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd240043d0 con 0x7efd140037f0 2022-09-20T20:08:19.757 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.743+0000 7efd34bc6700 1 -- 172.21.15.152:0/3550713934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd140037f0 msgr2=0x7efd14003c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:19.757 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.743+0000 7efd34bc6700 1 --2- 172.21.15.152:0/3550713934 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd140037f0 0x7efd14003c60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efd240098c0 tx=0x7efd14005880 comp rx=0 tx=0).stop 2022-09-20T20:08:19.758 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.743+0000 7efd2ed9d700 1 -- 172.21.15.152:0/3550713934 reap_dead start 2022-09-20T20:08:19.758 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.744+0000 7efd34bc6700 1 -- 172.21.15.152:0/3550713934 shutdown_connections 2022-09-20T20:08:19.759 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.744+0000 7efd34bc6700 1 -- 172.21.15.152:0/3550713934 >> 172.21.15.152:0/3550713934 conn(0x7efd3006d1b0 msgr2=0x7efd3006d580 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:19.759 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.744+0000 7efd34bc6700 1 -- 172.21.15.152:0/3550713934 shutdown_connections 2022-09-20T20:08:19.760 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.744+0000 7efd34bc6700 1 -- 172.21.15.152:0/3550713934 wait complete. 2022-09-20T20:08:19.760 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.745+0000 7efd34bc6700 1 Processor -- start 2022-09-20T20:08:19.760 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.745+0000 7efd34bc6700 1 -- start start 2022-09-20T20:08:19.766 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd34bc6700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd140037f0 0x7efd300a6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:19.767 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd34bc6700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd30149fa0 0x7efd301edf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:19.767 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd34bc6700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd301f1ba0 0x7efd300b0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:19.768 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd34bc6700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd301ee4a0 con 0x7efd140037f0 2022-09-20T20:08:19.769 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd34bc6700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd301f24a0 con 0x7efd301f1ba0 2022-09-20T20:08:19.769 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd34bc6700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd301f2780 con 0x7efd30149fa0 2022-09-20T20:08:19.769 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd2e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd140037f0 0x7efd300a6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:19.770 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd2ed9d700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd301f1ba0 0x7efd300b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:19.770 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd2e59c700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd140037f0 0x7efd300a6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59688/0 (socket says 172.21.15.152:59688) 2022-09-20T20:08:19.771 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd2e59c700 1 -- 172.21.15.152:0/3993833487 learned_addr learned my addr 172.21.15.152:0/3993833487 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:19.771 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd2dd9b700 1 --2- 172.21.15.152:0/3993833487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd30149fa0 0x7efd301edf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:19.772 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd2dd9b700 1 -- 172.21.15.152:0/3993833487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd30149fa0 msgr2=0x7efd301edf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2022-09-20T20:08:19.772 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd2dd9b700 1 -- 172.21.15.152:0/3993833487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd30149fa0 msgr2=0x7efd301edf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-09-20T20:08:19.772 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd2dd9b700 1 --2- 172.21.15.152:0/3993833487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd30149fa0 0x7efd301edf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:19.773 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd2dd9b700 1 --2- 172.21.15.152:0/3993833487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd30149fa0 0x7efd301edf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:19.773 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd2e59c700 1 -- 172.21.15.152:0/3993833487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd30149fa0 msgr2=0x7efd301edf60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-20T20:08:19.774 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd2e59c700 1 --2- 172.21.15.152:0/3993833487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd30149fa0 0x7efd301edf60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.774 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd2e59c700 1 -- 172.21.15.152:0/3993833487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd301f1ba0 msgr2=0x7efd300b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:19.775 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd2e59c700 1 --2- 172.21.15.152:0/3993833487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd301f1ba0 0x7efd300b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.775 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd2e59c700 1 -- 172.21.15.152:0/3993833487 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd301f2a60 con 0x7efd140037f0 2022-09-20T20:08:19.775 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd2ed9d700 1 --2- 172.21.15.152:0/3993833487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd301f1ba0 0x7efd300b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:08:19.776 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd2e59c700 1 --2- 172.21.15.152:0/3993833487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd140037f0 0x7efd300a6480 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efd2000fb60 tx=0x7efd2000fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:19.776 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd1effd700 1 -- 172.21.15.152:0/3993833487 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd200052e0 con 0x7efd140037f0 2022-09-20T20:08:19.777 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd1effd700 1 -- 172.21.15.152:0/3993833487 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd20005440 con 0x7efd140037f0 2022-09-20T20:08:19.777 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd34bc6700 1 -- 172.21.15.152:0/3993833487 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd3015a5b0 con 0x7efd140037f0 2022-09-20T20:08:19.778 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.746+0000 7efd1effd700 1 -- 172.21.15.152:0/3993833487 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd200038c0 con 0x7efd140037f0 2022-09-20T20:08:19.778 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.747+0000 7efd34bc6700 1 -- 172.21.15.152:0/3993833487 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd301f2010 con 0x7efd140037f0 2022-09-20T20:08:19.778 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.747+0000 7efd1effd700 1 -- 172.21.15.152:0/3993833487 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7efd20003a20 con 0x7efd140037f0 2022-09-20T20:08:19.779 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.747+0000 7efd1effd700 1 -- 172.21.15.152:0/3993833487 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7efd2001d460 con 0x7efd140037f0 2022-09-20T20:08:19.779 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.747+0000 7efd34bc6700 1 -- 172.21.15.152:0/3993833487 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd3015ac00 con 0x7efd140037f0 2022-09-20T20:08:19.780 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.750+0000 7efd1effd700 1 -- 172.21.15.152:0/3993833487 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7efd2000d870 con 0x7efd140037f0 2022-09-20T20:08:19.781 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:19.777+0000 7fbc19c2c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-09-20T20:08:19.821 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.819+0000 7efd34bc6700 1 -- 172.21.15.152:0/3993833487 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd30068780 con 0x7efd140037f0 2022-09-20T20:08:19.822 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.820+0000 7efd1effd700 1 -- 172.21.15.152:0/3993833487 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7efd2000da10 con 0x7efd140037f0 2022-09-20T20:08:19.822 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:08:19.823 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":10,"fsid":"065d03fa-a408-48e8-87c7-c58c779882b2","created":"2022-09-20T20:08:16.965173+0000","modified":"2022-09-20T20:08:19.551690+0000","last_up_change":"0.000000","last_in_change":"2022-09-20T20:08:19.551690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c48a8b9b-3648-4172-8ee8-1ff95e1f0452","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e272de33-f058-41d6-af3a-3031de13004d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ab49b061-3e6f-4acb-a402-c687d6b71b7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"465e8685-6b56-4763-9ce8-937508e05d89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3f460e6a-25ec-4940-ba11-6cc651fca0b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8adc5c61-c754-4cdf-8eda-b5d20a09bf5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"be0e8f6c-e8df-4488-a8c2-ffd847668001","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7841c1e5-c5d4-4b08-917e-a6ff8ef0cc02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-20T20:08:19.824 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.821+0000 7efd34bc6700 1 -- 172.21.15.152:0/3993833487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd140037f0 msgr2=0x7efd300a6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:19.824 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.821+0000 7efd34bc6700 1 --2- 172.21.15.152:0/3993833487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd140037f0 0x7efd300a6480 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efd2000fb60 tx=0x7efd2000fe70 comp rx=0 tx=0).stop 2022-09-20T20:08:19.824 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.821+0000 7efd34bc6700 1 -- 172.21.15.152:0/3993833487 shutdown_connections 2022-09-20T20:08:19.824 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.821+0000 7efd34bc6700 1 --2- 172.21.15.152:0/3993833487 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7efd301f1ba0 0x7efd300b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.825 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.821+0000 7efd34bc6700 1 --2- 172.21.15.152:0/3993833487 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efd140037f0 0x7efd300a6480 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.825 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.821+0000 7efd34bc6700 1 --2- 172.21.15.152:0/3993833487 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7efd30149fa0 0x7efd301edf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:19.825 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.821+0000 7efd34bc6700 1 -- 172.21.15.152:0/3993833487 >> 172.21.15.152:0/3993833487 conn(0x7efd3006d1b0 msgr2=0x7efd300b4180 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:19.825 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.821+0000 7efd34bc6700 1 -- 172.21.15.152:0/3993833487 shutdown_connections 2022-09-20T20:08:19.826 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:19.821+0000 7efd34bc6700 1 -- 172.21.15.152:0/3993833487 wait complete. 2022-09-20T20:08:19.834 INFO:tasks.ceph.ceph_manager.ceph:[] 2022-09-20T20:08:19.835 INFO:tasks.ceph:Waiting for OSDs to come up 2022-09-20T20:08:19.858 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:19.856+0000 7fbc19c2c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-09-20T20:08:19.932 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:19.930+0000 7fbc19c2c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-09-20T20:08:20.010 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:20.008+0000 7fbc19c2c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-09-20T20:08:20.147 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:20.146+0000 7f61be265200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-09-20T20:08:20.190 INFO:tasks.ceph.osd.4.smithi171.stderr:2022-09-20T20:08:20.188+0000 7f103b31b5c0 -1 Falling back to public interface 2022-09-20T20:08:20.191 INFO:tasks.ceph.osd.5.smithi171.stderr:2022-09-20T20:08:20.189+0000 7fa985edb5c0 -1 Falling back to public interface 2022-09-20T20:08:20.210 INFO:tasks.ceph.osd.3.smithi152.stderr:2022-09-20T20:08:20.208+0000 7f96b83a55c0 -1 Falling back to public interface 2022-09-20T20:08:20.211 INFO:tasks.ceph.osd.2.smithi152.stderr:2022-09-20T20:08:20.209+0000 7f8f519905c0 -1 Falling back to public interface 2022-09-20T20:08:20.214 INFO:tasks.ceph.osd.6.smithi171.stderr:2022-09-20T20:08:20.212+0000 7fa537b1a5c0 -1 Falling back to public interface 2022-09-20T20:08:20.215 INFO:tasks.ceph.osd.0.smithi152.stderr:2022-09-20T20:08:20.212+0000 7f7e89ab25c0 -1 Falling back to public interface 2022-09-20T20:08:20.215 INFO:tasks.ceph.osd.1.smithi152.stderr:2022-09-20T20:08:20.212+0000 7f989d3c65c0 -1 Falling back to public interface 2022-09-20T20:08:20.216 INFO:tasks.ceph.osd.0.smithi152.stderr:2022-09-20T20:08:20.214+0000 7f7e81067700 -1 PosixStack listen unable to listen on v1:0.0.0.0:6823/0: (98) Address already in use 2022-09-20T20:08:20.232 INFO:tasks.ceph.osd.7.smithi171.stderr:2022-09-20T20:08:20.230+0000 7fe95160d5c0 -1 Falling back to public interface 2022-09-20T20:08:20.238 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:20.236+0000 7fbc19c2c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-09-20T20:08:20.642 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-09-20T20:08:20.756 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.754+0000 7f975a170700 1 Processor -- start 2022-09-20T20:08:20.756 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.754+0000 7f975a170700 1 -- start start 2022-09-20T20:08:20.760 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.755+0000 7f975a170700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975415b660 0x7f975406be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:20.760 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.755+0000 7f975a170700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f975406c490 0x7f975406c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:20.760 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.755+0000 7f975a170700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97540cda10 con 0x7f975406ce40 2022-09-20T20:08:20.760 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.755+0000 7f975a170700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97540adbe0 con 0x7f975406c490 2022-09-20T20:08:20.761 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.755+0000 7f975a170700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975406d2c0 con 0x7f975415b660 2022-09-20T20:08:20.761 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.755+0000 7f97537fe700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975415b660 0x7f975406be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:20.761 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.755+0000 7f9752ffd700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f975406c490 0x7f975406c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:20.761 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.755+0000 7f97537fe700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975415b660 0x7f975406be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.152:32926/0 (socket says 172.21.15.152:32926) 2022-09-20T20:08:20.761 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.755+0000 7f9752ffd700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f975406c490 0x7f975406c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.152:40100/0 (socket says 172.21.15.152:40100) 2022-09-20T20:08:20.762 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.755+0000 7f97537fe700 1 -- 172.21.15.152:0/419454964 learned_addr learned my addr 172.21.15.152:0/419454964 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:20.762 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.755+0000 7f97537fe700 1 -- 172.21.15.152:0/419454964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975415b660 msgr2=0x7f975406be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2022-09-20T20:08:20.762 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.755+0000 7f97537fe700 1 -- 172.21.15.152:0/419454964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975415b660 msgr2=0x7f975406be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2022-09-20T20:08:20.762 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.755+0000 7f97537fe700 1 --2- 172.21.15.152:0/419454964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975415b660 0x7f975406be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:20.763 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.755+0000 7f97537fe700 1 --2- 172.21.15.152:0/419454964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975415b660 0x7f975406be70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:20.763 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.756+0000 7f9752ffd700 1 -- 172.21.15.152:0/419454964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975415b660 msgr2=0x7f975406be70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-09-20T20:08:20.763 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.756+0000 7f9752ffd700 1 --2- 172.21.15.152:0/419454964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975415b660 0x7f975406be70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:20.763 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.756+0000 7f9752ffd700 1 -- 172.21.15.152:0/419454964 >> v1:172.21.15.171:6789/0 conn(0x7f975406ce40 legacy=0x7f9754068ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:20.764 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.756+0000 7f9752ffd700 1 -- 172.21.15.152:0/419454964 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97540ab190 con 0x7f975406c490 2022-09-20T20:08:20.764 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.756+0000 7f97527fc700 1 -- 172.21.15.152:0/419454964 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913606650 0 0) 0x7f97540cda10 con 0x7f975406ce40 2022-09-20T20:08:20.764 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.756+0000 7f9752ffd700 1 --2- 172.21.15.152:0/419454964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f975406c490 0x7f975406c900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f973c009840 tx=0x7f973c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edb145e6ec072fb9 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:20.764 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.756+0000 7f97527fc700 1 -- 172.21.15.152:0/419454964 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c011830 con 0x7f975406c490 2022-09-20T20:08:20.764 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.756+0000 7f97527fc700 1 -- 172.21.15.152:0/419454964 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c011990 con 0x7f975406c490 2022-09-20T20:08:20.765 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.756+0000 7f97527fc700 1 -- 172.21.15.152:0/419454964 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c011d20 con 0x7f975406c490 2022-09-20T20:08:20.765 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.757+0000 7f975a170700 1 -- 172.21.15.152:0/419454964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f975406c490 msgr2=0x7f975406c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:20.765 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.757+0000 7f975a170700 1 --2- 172.21.15.152:0/419454964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f975406c490 0x7f975406c900 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f973c009840 tx=0x7f973c009b50 comp rx=0 tx=0).stop 2022-09-20T20:08:20.765 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.757+0000 7f975a170700 1 -- 172.21.15.152:0/419454964 shutdown_connections 2022-09-20T20:08:20.765 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.757+0000 7f975a170700 1 --2- 172.21.15.152:0/419454964 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975415b660 0x7f975406be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:20.766 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.757+0000 7f975a170700 1 --2- 172.21.15.152:0/419454964 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f975406c490 0x7f975406c900 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:20.766 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.757+0000 7f975a170700 1 -- 172.21.15.152:0/419454964 >> 172.21.15.152:0/419454964 conn(0x7f975406a710 msgr2=0x7f97540ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:20.766 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.757+0000 7f975a170700 1 -- 172.21.15.152:0/419454964 shutdown_connections 2022-09-20T20:08:20.766 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.757+0000 7f975a170700 1 -- 172.21.15.152:0/419454964 wait complete. 2022-09-20T20:08:20.767 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.758+0000 7f975a170700 1 Processor -- start 2022-09-20T20:08:20.767 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.758+0000 7f975a170700 1 -- start start 2022-09-20T20:08:20.770 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f975a170700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f975406c490 0x7f97540c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:20.770 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f975a170700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975406ce40 0x7f9754151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:20.770 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f975a170700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f975415b660 0x7f975415c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:20.771 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f975a170700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97540c4620 con 0x7f975415b660 2022-09-20T20:08:20.771 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f975a170700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9754152430 con 0x7f975406c490 2022-09-20T20:08:20.771 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f975a170700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975415ca10 con 0x7f975406ce40 2022-09-20T20:08:20.771 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f9753fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f975415b660 0x7f975415c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:20.772 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f97537fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f975406c490 0x7f97540c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:20.772 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f9752ffd700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975406ce40 0x7f9754151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:20.772 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f9753fff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f975415b660 0x7f975415c4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59702/0 (socket says 172.21.15.152:59702) 2022-09-20T20:08:20.772 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f97537fe700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f975406c490 0x7f97540c40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.152:40114/0 (socket says 172.21.15.152:40114) 2022-09-20T20:08:20.772 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f9753fff700 1 -- 172.21.15.152:0/948112869 learned_addr learned my addr 172.21.15.152:0/948112869 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:20.773 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f9752ffd700 1 -- 172.21.15.152:0/948112869 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975406ce40 msgr2=0x7f9754151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2022-09-20T20:08:20.773 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f9752ffd700 1 -- 172.21.15.152:0/948112869 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975406ce40 msgr2=0x7f9754151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2022-09-20T20:08:20.773 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f9752ffd700 1 --2- 172.21.15.152:0/948112869 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975406ce40 0x7f9754151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2022-09-20T20:08:20.773 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f9752ffd700 1 --2- 172.21.15.152:0/948112869 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975406ce40 0x7f9754151ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2022-09-20T20:08:20.773 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f97537fe700 1 -- 172.21.15.152:0/948112869 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975406ce40 msgr2=0x7f9754151ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2022-09-20T20:08:20.774 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f97537fe700 1 --2- 172.21.15.152:0/948112869 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975406ce40 0x7f9754151ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:20.774 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f97537fe700 1 -- 172.21.15.152:0/948112869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f975415b660 msgr2=0x7f975415c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:20.774 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f97537fe700 1 --2- 172.21.15.152:0/948112869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f975415b660 0x7f975415c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:20.774 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f97537fe700 1 -- 172.21.15.152:0/948112869 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c0094a0 con 0x7f975406c490 2022-09-20T20:08:20.775 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.759+0000 7f9753fff700 1 --2- 172.21.15.152:0/948112869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f975415b660 0x7f975415c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:08:20.775 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.760+0000 7f97537fe700 1 --2- 172.21.15.152:0/948112869 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f975406c490 0x7f97540c40e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f974c006fa0 tx=0x7f974c00eac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:20.775 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.760+0000 7f974bfff700 1 -- 172.21.15.152:0/948112869 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c005c20 con 0x7f975406c490 2022-09-20T20:08:20.775 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.760+0000 7f974bfff700 1 -- 172.21.15.152:0/948112869 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c005d80 con 0x7f975406c490 2022-09-20T20:08:20.775 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.760+0000 7f974bfff700 1 -- 172.21.15.152:0/948112869 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c004270 con 0x7f975406c490 2022-09-20T20:08:20.776 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.760+0000 7f975a170700 1 -- 172.21.15.152:0/948112869 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97540c2040 con 0x7f975406c490 2022-09-20T20:08:20.776 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.760+0000 7f975a170700 1 -- 172.21.15.152:0/948112869 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97540c2600 con 0x7f975406c490 2022-09-20T20:08:20.776 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.760+0000 7f974bfff700 1 -- 172.21.15.152:0/948112869 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f974c0036a0 con 0x7f975406c490 2022-09-20T20:08:20.776 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.760+0000 7f974bfff700 1 -- 172.21.15.152:0/948112869 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f974c006720 con 0x7f975406c490 2022-09-20T20:08:20.776 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.761+0000 7f975a170700 1 -- 172.21.15.152:0/948112869 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975406f4d0 con 0x7f975406c490 2022-09-20T20:08:20.777 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.763+0000 7f974bfff700 1 -- 172.21.15.152:0/948112869 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71346 (secure 0 0 0) 0x7f974c00c070 con 0x7f975406c490 2022-09-20T20:08:20.779 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:20.777+0000 7f61be265200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-09-20T20:08:20.834 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.832+0000 7f975a170700 1 -- 172.21.15.152:0/948112869 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97540687e0 con 0x7f975406c490 2022-09-20T20:08:20.835 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.833+0000 7f974bfff700 1 -- 172.21.15.152:0/948112869 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f974c00f040 con 0x7f975406c490 2022-09-20T20:08:20.835 INFO:teuthology.misc.health.smithi152.stdout: 2022-09-20T20:08:20.836 INFO:teuthology.misc.health.smithi152.stdout:{"epoch":10,"fsid":"065d03fa-a408-48e8-87c7-c58c779882b2","created":"2022-09-20T20:08:16.965173+0000","modified":"2022-09-20T20:08:19.551690+0000","last_up_change":"0.000000","last_in_change":"2022-09-20T20:08:19.551690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c48a8b9b-3648-4172-8ee8-1ff95e1f0452","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e272de33-f058-41d6-af3a-3031de13004d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ab49b061-3e6f-4acb-a402-c687d6b71b7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"465e8685-6b56-4763-9ce8-937508e05d89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3f460e6a-25ec-4940-ba11-6cc651fca0b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8adc5c61-c754-4cdf-8eda-b5d20a09bf5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"be0e8f6c-e8df-4488-a8c2-ffd847668001","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7841c1e5-c5d4-4b08-917e-a6ff8ef0cc02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-20T20:08:20.837 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.834+0000 7f975a170700 1 -- 172.21.15.152:0/948112869 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f975406c490 msgr2=0x7f97540c40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:20.837 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.834+0000 7f975a170700 1 --2- 172.21.15.152:0/948112869 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f975406c490 0x7f97540c40e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f974c006fa0 tx=0x7f974c00eac0 comp rx=0 tx=0).stop 2022-09-20T20:08:20.838 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.834+0000 7f975a170700 1 -- 172.21.15.152:0/948112869 shutdown_connections 2022-09-20T20:08:20.838 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.834+0000 7f975a170700 1 --2- 172.21.15.152:0/948112869 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f975415b660 0x7f975415c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:20.838 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.834+0000 7f975a170700 1 --2- 172.21.15.152:0/948112869 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f975406c490 0x7f97540c40e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:20.839 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.834+0000 7f975a170700 1 --2- 172.21.15.152:0/948112869 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f975406ce40 0x7f9754151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:20.839 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.834+0000 7f975a170700 1 -- 172.21.15.152:0/948112869 >> 172.21.15.152:0/948112869 conn(0x7f975406a710 msgr2=0x7f97540ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:20.839 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.834+0000 7f975a170700 1 -- 172.21.15.152:0/948112869 shutdown_connections 2022-09-20T20:08:20.839 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:20.834+0000 7f975a170700 1 -- 172.21.15.152:0/948112869 wait complete. 2022-09-20T20:08:20.847 DEBUG:teuthology.misc:0 of 8 OSDs are up 2022-09-20T20:08:20.879 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:20.877+0000 7f61be265200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-09-20T20:08:20.958 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:20.956+0000 7f61be265200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-09-20T20:08:21.034 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:21.032+0000 7fbc19c2c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-09-20T20:08:21.276 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:21.274+0000 7f61be265200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-09-20T20:08:21.523 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:21.521+0000 7f61be265200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-09-20T20:08:21.594 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:21.592+0000 7f61be265200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-09-20T20:08:21.662 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:21.660+0000 7fbc19c2c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-09-20T20:08:21.688 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:21.687+0000 7f61be265200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-09-20T20:08:21.758 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:21.756+0000 7fbc19c2c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-09-20T20:08:21.762 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:21.760+0000 7f61be265200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-09-20T20:08:21.838 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:21.836+0000 7fbc19c2c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-09-20T20:08:21.879 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:21.877+0000 7f61be265200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-09-20T20:08:22.107 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:22.105+0000 7f61be265200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-09-20T20:08:22.161 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:22.160+0000 7fbc19c2c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-09-20T20:08:22.183 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:22.182+0000 7f61be265200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-09-20T20:08:22.414 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:22.412+0000 7fbc19c2c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-09-20T20:08:22.485 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:22.483+0000 7fbc19c2c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-09-20T20:08:22.581 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:22.579+0000 7fbc19c2c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-09-20T20:08:22.661 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:22.659+0000 7fbc19c2c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-09-20T20:08:22.779 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:22.777+0000 7fbc19c2c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-09-20T20:08:23.044 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:23.042+0000 7fbc19c2c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-09-20T20:08:23.133 INFO:tasks.ceph.mgr.x.smithi171.stderr:2022-09-20T20:08:23.131+0000 7fbc19c2c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-09-20T20:08:23.211 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:23.209+0000 7f617cf9b700 -1 mgr.server handle_report got status from non-daemon mon.c 2022-09-20T20:08:23.212 INFO:tasks.ceph.mgr.y.smithi152.stderr:2022-09-20T20:08:23.209+0000 7f617cf9b700 -1 mgr.server handle_report got status from non-daemon mon.b 2022-09-20T20:08:23.673 INFO:tasks.ceph.osd.4.smithi171.stderr:2022-09-20T20:08:23.671+0000 7f103b31b5c0 -1 osd.4 0 log_to_monitors true 2022-09-20T20:08:23.675 INFO:tasks.ceph.osd.3.smithi152.stderr:2022-09-20T20:08:23.673+0000 7f96b83a55c0 -1 osd.3 0 log_to_monitors true 2022-09-20T20:08:23.722 INFO:tasks.ceph.osd.0.smithi152.stderr:2022-09-20T20:08:23.720+0000 7f7e89ab25c0 -1 osd.0 0 log_to_monitors true 2022-09-20T20:08:23.722 INFO:tasks.ceph.osd.6.smithi171.stderr:2022-09-20T20:08:23.720+0000 7fa537b1a5c0 -1 osd.6 0 log_to_monitors true 2022-09-20T20:08:23.730 INFO:tasks.ceph.osd.5.smithi171.stderr:2022-09-20T20:08:23.728+0000 7fa985edb5c0 -1 osd.5 0 log_to_monitors true 2022-09-20T20:08:23.731 INFO:tasks.ceph.osd.2.smithi152.stderr:2022-09-20T20:08:23.729+0000 7f8f519905c0 -1 osd.2 0 log_to_monitors true 2022-09-20T20:08:23.743 INFO:tasks.ceph.osd.1.smithi152.stderr:2022-09-20T20:08:23.741+0000 7f989d3c65c0 -1 osd.1 0 log_to_monitors true 2022-09-20T20:08:23.757 INFO:tasks.ceph.osd.7.smithi171.stderr:2022-09-20T20:08:23.756+0000 7fe95160d5c0 -1 osd.7 0 log_to_monitors true 2022-09-20T20:08:27.194 INFO:tasks.ceph.osd.7.smithi171.stderr:2022-09-20T20:08:27.193+0000 7fe9453bb700 -1 osd.7 0 waiting for initial osdmap 2022-09-20T20:08:27.205 INFO:tasks.ceph.osd.7.smithi171.stderr:2022-09-20T20:08:27.203+0000 7fe93d796700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-20T20:08:27.231 INFO:tasks.ceph.osd.5.smithi171.stderr:2022-09-20T20:08:27.229+0000 7fa979c89700 -1 osd.5 0 waiting for initial osdmap 2022-09-20T20:08:27.245 INFO:tasks.ceph.osd.3.smithi152.stderr:2022-09-20T20:08:27.243+0000 7f96ac153700 -1 osd.3 0 waiting for initial osdmap 2022-09-20T20:08:27.248 INFO:tasks.ceph.osd.5.smithi171.stderr:2022-09-20T20:08:27.247+0000 7fa972064700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-20T20:08:27.262 INFO:tasks.ceph.osd.3.smithi152.stderr:2022-09-20T20:08:27.260+0000 7f96a452e700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-20T20:08:27.270 INFO:tasks.ceph.osd.1.smithi152.stderr:2022-09-20T20:08:27.269+0000 7f9891174700 -1 osd.1 0 waiting for initial osdmap 2022-09-20T20:08:27.283 INFO:tasks.ceph.osd.1.smithi152.stderr:2022-09-20T20:08:27.282+0000 7f988954f700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-20T20:08:27.286 INFO:tasks.ceph.osd.2.smithi152.stderr:2022-09-20T20:08:27.285+0000 7f8f4573e700 -1 osd.2 0 waiting for initial osdmap 2022-09-20T20:08:27.288 INFO:tasks.ceph.osd.4.smithi171.stderr:2022-09-20T20:08:27.287+0000 7f102f0c9700 -1 osd.4 0 waiting for initial osdmap 2022-09-20T20:08:27.299 INFO:tasks.ceph.osd.2.smithi152.stderr:2022-09-20T20:08:27.297+0000 7f8f3db19700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-20T20:08:27.305 INFO:tasks.ceph.osd.4.smithi171.stderr:2022-09-20T20:08:27.303+0000 7f10274a4700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-20T20:08:27.308 INFO:tasks.ceph.osd.6.smithi171.stderr:2022-09-20T20:08:27.306+0000 7fa52b8c8700 -1 osd.6 0 waiting for initial osdmap 2022-09-20T20:08:27.328 INFO:tasks.ceph.osd.6.smithi171.stderr:2022-09-20T20:08:27.326+0000 7fa523ca3700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-20T20:08:27.328 INFO:tasks.ceph.osd.0.smithi152.stderr:2022-09-20T20:08:27.327+0000 7f7e7d860700 -1 osd.0 0 waiting for initial osdmap 2022-09-20T20:08:27.340 INFO:tasks.ceph.osd.0.smithi152.stderr:2022-09-20T20:08:27.338+0000 7f7e75c3b700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-09-20T20:08:27.654 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-09-20T20:08:27.768 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.765+0000 7f291f589700 1 Processor -- start 2022-09-20T20:08:27.768 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.766+0000 7f291f589700 1 -- start start 2022-09-20T20:08:27.776 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.766+0000 7f291f589700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f291815b660 0x7f291806be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:27.776 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.767+0000 7f291f589700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f291806d010 0x7f29180ab950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:27.777 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.767+0000 7f291f589700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29180cda10 con 0x7f291806c490 2022-09-20T20:08:27.777 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.767+0000 7f291f589700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29180adbe0 con 0x7f291806d010 2022-09-20T20:08:27.777 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.767+0000 7f291f589700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29180ab190 con 0x7f291815b660 2022-09-20T20:08:27.777 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.767+0000 7f291cb24700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f291806c490 0x7f291806c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46824/0 (socket says 172.21.15.152:46824) 2022-09-20T20:08:27.778 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.767+0000 7f291cb24700 1 -- 172.21.15.152:0/3057522617 learned_addr learned my addr 172.21.15.152:0/3057522617 (peer_addr_for_me v1:172.21.15.152:0/0) 2022-09-20T20:08:27.778 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.767+0000 7f291d325700 1 --2- 172.21.15.152:0/3057522617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f291815b660 0x7f291806be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:27.778 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.767+0000 7f291db26700 1 --2- 172.21.15.152:0/3057522617 >> v2:172.21.15.171:3300/0 conn(0x7f291806d010 0x7f29180ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:27.778 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.767+0000 7f2907fff700 1 -- 172.21.15.152:0/3057522617 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766489267 0 0) 0x7f29180cda10 con 0x7f291806c490 2022-09-20T20:08:27.778 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.767+0000 7f2907fff700 1 -- 172.21.15.152:0/3057522617 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29000035b0 con 0x7f291806c490 2022-09-20T20:08:27.779 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.767+0000 7f291d325700 1 -- 172.21.15.152:0/3057522617 >> v2:172.21.15.171:3300/0 conn(0x7f291806d010 msgr2=0x7f29180ab950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:27.779 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.767+0000 7f291d325700 1 --2- 172.21.15.152:0/3057522617 >> v2:172.21.15.171:3300/0 conn(0x7f291806d010 0x7f29180ab950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:27.779 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.767+0000 7f2907fff700 1 -- 172.21.15.152:0/3057522617 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4063222914 0 0) 0x7f29000035b0 con 0x7f291806c490 2022-09-20T20:08:27.779 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.767+0000 7f291d325700 1 -- 172.21.15.152:0/3057522617 >> v1:172.21.15.152:6789/0 conn(0x7f291806c490 legacy=0x7f291806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:27.780 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.767+0000 7f291d325700 1 -- 172.21.15.152:0/3057522617 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29180cdc60 con 0x7f291815b660 2022-09-20T20:08:27.780 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.767+0000 7f291d325700 1 --2- 172.21.15.152:0/3057522617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f291815b660 0x7f291806be70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2908009820 tx=0x7f2908009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f37c3d98f578cb1 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:27.780 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.767+0000 7f2907fff700 1 -- 172.21.15.152:0/3057522617 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2908005e30 con 0x7f291815b660 2022-09-20T20:08:27.781 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.767+0000 7f2907fff700 1 -- 172.21.15.152:0/3057522617 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2908006030 con 0x7f291815b660 2022-09-20T20:08:27.781 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.768+0000 7f2907fff700 1 -- 172.21.15.152:0/3057522617 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29080063c0 con 0x7f291815b660 2022-09-20T20:08:27.781 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.768+0000 7f291f589700 1 -- 172.21.15.152:0/3057522617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f291815b660 msgr2=0x7f291806be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:27.781 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.768+0000 7f291f589700 1 --2- 172.21.15.152:0/3057522617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f291815b660 0x7f291806be70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2908009820 tx=0x7f2908009b30 comp rx=0 tx=0).stop 2022-09-20T20:08:27.781 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.768+0000 7f291f589700 1 -- 172.21.15.152:0/3057522617 shutdown_connections 2022-09-20T20:08:27.782 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.768+0000 7f291f589700 1 --2- 172.21.15.152:0/3057522617 >> v2:172.21.15.171:3300/0 conn(0x7f291806d010 0x7f29180ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:27.782 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.768+0000 7f291f589700 1 --2- 172.21.15.152:0/3057522617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f291815b660 0x7f291806be70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:27.782 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.768+0000 7f291f589700 1 -- 172.21.15.152:0/3057522617 >> 172.21.15.152:0/3057522617 conn(0x7f291806a710 msgr2=0x7f29180ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:27.782 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.768+0000 7f291f589700 1 -- 172.21.15.152:0/3057522617 shutdown_connections 2022-09-20T20:08:27.783 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.768+0000 7f291f589700 1 -- 172.21.15.152:0/3057522617 wait complete. 2022-09-20T20:08:27.783 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.769+0000 7f291f589700 1 Processor -- start 2022-09-20T20:08:27.783 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.769+0000 7f291f589700 1 -- start start 2022-09-20T20:08:27.783 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.770+0000 7f291f589700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f291806c490 0x7f2918154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:27.783 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.770+0000 7f291f589700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f291806d010 0x7f29180c2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:27.784 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.770+0000 7f291f589700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f291815b660 0x7f29181e3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:27.784 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.770+0000 7f291f589700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2918158f60 con 0x7f291806c490 2022-09-20T20:08:27.784 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.770+0000 7f291f589700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29181582e0 con 0x7f291806d010 2022-09-20T20:08:27.784 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.770+0000 7f291f589700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29181585c0 con 0x7f291815b660 2022-09-20T20:08:27.785 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.770+0000 7f291d325700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f291806c490 0x7f2918154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:27.785 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.770+0000 7f291d325700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f291806c490 0x7f2918154150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43038/0 (socket says 172.21.15.152:43038) 2022-09-20T20:08:27.785 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.770+0000 7f291d325700 1 -- 172.21.15.152:0/3394812932 learned_addr learned my addr 172.21.15.152:0/3394812932 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:27.785 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.770+0000 7f291db26700 1 --2- 172.21.15.152:0/3394812932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f291815b660 0x7f29181e3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:27.785 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.770+0000 7f291cb24700 1 --2- 172.21.15.152:0/3394812932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f291806d010 0x7f29180c2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:27.786 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.770+0000 7f291d325700 1 -- 172.21.15.152:0/3394812932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f291815b660 msgr2=0x7f29181e3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:27.786 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.770+0000 7f291d325700 1 --2- 172.21.15.152:0/3394812932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f291815b660 0x7f29181e3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:27.786 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.770+0000 7f291d325700 1 -- 172.21.15.152:0/3394812932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f291806d010 msgr2=0x7f29180c2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:27.786 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.770+0000 7f291d325700 1 --2- 172.21.15.152:0/3394812932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f291806d010 0x7f29180c2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:27.787 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.770+0000 7f291d325700 1 -- 172.21.15.152:0/3394812932 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2908009430 con 0x7f291806c490 2022-09-20T20:08:27.787 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.770+0000 7f291cb24700 1 --2- 172.21.15.152:0/3394812932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f291806d010 0x7f29180c2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-20T20:08:27.787 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.771+0000 7f291d325700 1 --2- 172.21.15.152:0/3394812932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f291806c490 0x7f2918154150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2908013040 tx=0x7f2908004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:27.787 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.771+0000 7f2905ffb700 1 -- 172.21.15.152:0/3394812932 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2908006880 con 0x7f291806c490 2022-09-20T20:08:27.787 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.771+0000 7f2905ffb700 1 -- 172.21.15.152:0/3394812932 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2908020070 con 0x7f291806c490 2022-09-20T20:08:27.788 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.771+0000 7f291f589700 1 -- 172.21.15.152:0/3394812932 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29181588a0 con 0x7f291806c490 2022-09-20T20:08:27.788 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.771+0000 7f2905ffb700 1 -- 172.21.15.152:0/3394812932 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2908025670 con 0x7f291806c490 2022-09-20T20:08:27.788 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.771+0000 7f291f589700 1 -- 172.21.15.152:0/3394812932 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2918154690 con 0x7f291806c490 2022-09-20T20:08:27.788 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.772+0000 7f291f589700 1 -- 172.21.15.152:0/3394812932 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29180687e0 con 0x7f291806c490 2022-09-20T20:08:27.789 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.772+0000 7f2905ffb700 1 -- 172.21.15.152:0/3394812932 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 4) v1 ==== 83870+0+0 (secure 0 0 0) 0x7f290802b020 con 0x7f291806c490 2022-09-20T20:08:27.789 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.773+0000 7f2905ffb700 1 --2- 172.21.15.152:0/3394812932 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f28f8065a00 0x7f28f8067eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:27.789 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.773+0000 7f2905ffb700 1 -- 172.21.15.152:0/3394812932 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f29080832e0 con 0x7f291806c490 2022-09-20T20:08:27.789 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.773+0000 7f291cb24700 1 --2- 172.21.15.152:0/3394812932 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f28f8065a00 0x7f28f8067eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:27.789 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.773+0000 7f291cb24700 1 --2- 172.21.15.152:0/3394812932 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f28f8065a00 0x7f28f8067eb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2914007b10 tx=0x7f2914009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:27.790 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.777+0000 7f2905ffb700 1 -- 172.21.15.152:0/3394812932 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7f2908052090 con 0x7f291806c490 2022-09-20T20:08:27.956 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.954+0000 7f291f589700 1 -- 172.21.15.152:0/3394812932 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29180cdf40 con 0x7f291806c490 2022-09-20T20:08:27.957 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.955+0000 7f2905ffb700 1 -- 172.21.15.152:0/3394812932 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f29080556b0 con 0x7f291806c490 2022-09-20T20:08:27.957 INFO:teuthology.misc.health.smithi152.stdout: 2022-09-20T20:08:27.958 INFO:teuthology.misc.health.smithi152.stdout:{"epoch":12,"fsid":"065d03fa-a408-48e8-87c7-c58c779882b2","created":"2022-09-20T20:08:16.965173+0000","modified":"2022-09-20T20:08:25.206037+0000","last_up_change":"0.000000","last_in_change":"2022-09-20T20:08:19.551690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"c48a8b9b-3648-4172-8ee8-1ff95e1f0452","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e272de33-f058-41d6-af3a-3031de13004d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ab49b061-3e6f-4acb-a402-c687d6b71b7b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"465e8685-6b56-4763-9ce8-937508e05d89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3f460e6a-25ec-4940-ba11-6cc651fca0b3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8adc5c61-c754-4cdf-8eda-b5d20a09bf5d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"be0e8f6c-e8df-4488-a8c2-ffd847668001","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7841c1e5-c5d4-4b08-917e-a6ff8ef0cc02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-20T20:08:27.959 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.956+0000 7f291f589700 1 -- 172.21.15.152:0/3394812932 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f28f8065a00 msgr2=0x7f28f8067eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:27.960 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.956+0000 7f291f589700 1 --2- 172.21.15.152:0/3394812932 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f28f8065a00 0x7f28f8067eb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2914007b10 tx=0x7f2914009040 comp rx=0 tx=0).stop 2022-09-20T20:08:27.960 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.956+0000 7f291f589700 1 -- 172.21.15.152:0/3394812932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f291806c490 msgr2=0x7f2918154150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:27.960 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.956+0000 7f291f589700 1 --2- 172.21.15.152:0/3394812932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f291806c490 0x7f2918154150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2908013040 tx=0x7f2908004750 comp rx=0 tx=0).stop 2022-09-20T20:08:27.960 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.957+0000 7f291f589700 1 -- 172.21.15.152:0/3394812932 shutdown_connections 2022-09-20T20:08:27.961 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.957+0000 7f291f589700 1 --2- 172.21.15.152:0/3394812932 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f28f8065a00 0x7f28f8067eb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:27.961 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.957+0000 7f291f589700 1 --2- 172.21.15.152:0/3394812932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f291815b660 0x7f29181e3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:27.961 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.957+0000 7f291f589700 1 --2- 172.21.15.152:0/3394812932 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f291806c490 0x7f2918154150 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:27.961 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.957+0000 7f291f589700 1 --2- 172.21.15.152:0/3394812932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f291806d010 0x7f29180c2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:27.961 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.957+0000 7f291f589700 1 -- 172.21.15.152:0/3394812932 >> 172.21.15.152:0/3394812932 conn(0x7f291806a710 msgr2=0x7f291806ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:27.962 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.957+0000 7f291f589700 1 -- 172.21.15.152:0/3394812932 shutdown_connections 2022-09-20T20:08:27.962 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:27.957+0000 7f291f589700 1 -- 172.21.15.152:0/3394812932 wait complete. 2022-09-20T20:08:27.970 DEBUG:teuthology.misc:0 of 8 OSDs are up 2022-09-20T20:08:34.776 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-09-20T20:08:34.895 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.893+0000 7fb978e0e700 1 Processor -- start 2022-09-20T20:08:34.896 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.893+0000 7fb978e0e700 1 -- start start 2022-09-20T20:08:34.899 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.894+0000 7fb978e0e700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb974157f50 0x7fb9740cc110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:34.899 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.894+0000 7fb978e0e700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb9740acd20 0x7fb9740cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:34.899 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.894+0000 7fb978e0e700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9740ce390 con 0x7fb9740adab0 2022-09-20T20:08:34.900 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.894+0000 7fb978e0e700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb974158320 con 0x7fb9740acd20 2022-09-20T20:08:34.900 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.894+0000 7fb978e0e700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97406d640 con 0x7fb974157f50 2022-09-20T20:08:34.900 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.895+0000 7fb972d9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb9740acd20 0x7fb9740cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:34.900 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.895+0000 7fb972d9d700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb9740acd20 0x7fb9740cc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43076/0 (socket says 172.21.15.152:43076) 2022-09-20T20:08:34.901 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.895+0000 7fb972d9d700 1 -- 172.21.15.152:0/3802265168 learned_addr learned my addr 172.21.15.152:0/3802265168 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:34.901 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.895+0000 7fb97259c700 1 --2- 172.21.15.152:0/3802265168 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb974157f50 0x7fb9740cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:34.901 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.895+0000 7fb972d9d700 1 -- 172.21.15.152:0/3802265168 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb974157f50 msgr2=0x7fb9740cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:34.901 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.895+0000 7fb972d9d700 1 --2- 172.21.15.152:0/3802265168 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb974157f50 0x7fb9740cc110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:34.902 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.895+0000 7fb972d9d700 1 -- 172.21.15.152:0/3802265168 >> v1:172.21.15.171:6789/0 conn(0x7fb9740adab0 legacy=0x7fb97406ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:34.902 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.895+0000 7fb972d9d700 1 -- 172.21.15.152:0/3802265168 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97406d920 con 0x7fb9740acd20 2022-09-20T20:08:34.902 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.895+0000 7fb972d9d700 1 --2- 172.21.15.152:0/3802265168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9740acd20 0x7fb9740cc650 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb9640098f0 tx=0x7fb964009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=187722ba09359283 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:34.902 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.895+0000 7fb97159a700 1 -- 172.21.15.152:0/3802265168 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964011830 con 0x7fb9740acd20 2022-09-20T20:08:34.903 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.895+0000 7fb97159a700 1 -- 172.21.15.152:0/3802265168 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb964011990 con 0x7fb9740acd20 2022-09-20T20:08:34.903 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.895+0000 7fb97159a700 1 -- 172.21.15.152:0/3802265168 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964011d20 con 0x7fb9740acd20 2022-09-20T20:08:34.903 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.896+0000 7fb978e0e700 1 -- 172.21.15.152:0/3802265168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9740acd20 msgr2=0x7fb9740cc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:34.903 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.896+0000 7fb978e0e700 1 --2- 172.21.15.152:0/3802265168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9740acd20 0x7fb9740cc650 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb9640098f0 tx=0x7fb964009c00 comp rx=0 tx=0).stop 2022-09-20T20:08:34.904 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.896+0000 7fb978e0e700 1 -- 172.21.15.152:0/3802265168 shutdown_connections 2022-09-20T20:08:34.904 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.896+0000 7fb978e0e700 1 --2- 172.21.15.152:0/3802265168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9740acd20 0x7fb9740cc650 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:34.904 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.896+0000 7fb978e0e700 1 --2- 172.21.15.152:0/3802265168 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb974157f50 0x7fb9740cc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:34.904 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.896+0000 7fb978e0e700 1 -- 172.21.15.152:0/3802265168 >> 172.21.15.152:0/3802265168 conn(0x7fb97406a710 msgr2=0x7fb9740ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:34.904 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.896+0000 7fb978e0e700 1 -- 172.21.15.152:0/3802265168 shutdown_connections 2022-09-20T20:08:34.905 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.896+0000 7fb978e0e700 1 -- 172.21.15.152:0/3802265168 wait complete. 2022-09-20T20:08:34.905 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.897+0000 7fb978e0e700 1 Processor -- start 2022-09-20T20:08:34.905 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.897+0000 7fb978e0e700 1 -- start start 2022-09-20T20:08:34.908 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.898+0000 7fb978e0e700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9740acd20 0x7fb9740b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:34.909 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.898+0000 7fb978e0e700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9740adab0 0x7fb9740afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:34.909 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.898+0000 7fb978e0e700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb974157f50 0x7fb9740b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:34.909 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.898+0000 7fb978e0e700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9740b2810 con 0x7fb974157f50 2022-09-20T20:08:34.909 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.898+0000 7fb978e0e700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9740b2af0 con 0x7fb9740adab0 2022-09-20T20:08:34.910 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.898+0000 7fb978e0e700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9740b2dd0 con 0x7fb9740acd20 2022-09-20T20:08:34.910 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.898+0000 7fb972d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb974157f50 0x7fb9740b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:34.910 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.898+0000 7fb972d9d700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb974157f50 0x7fb9740b03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43092/0 (socket says 172.21.15.152:43092) 2022-09-20T20:08:34.910 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.898+0000 7fb972d9d700 1 -- 172.21.15.152:0/2824307907 learned_addr learned my addr 172.21.15.152:0/2824307907 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:34.911 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.898+0000 7fb97259c700 1 --2- 172.21.15.152:0/2824307907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9740acd20 0x7fb9740b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:34.911 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.898+0000 7fb971d9b700 1 --2- 172.21.15.152:0/2824307907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9740adab0 0x7fb9740afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:34.911 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.898+0000 7fb972d9d700 1 -- 172.21.15.152:0/2824307907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9740acd20 msgr2=0x7fb9740b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:34.911 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.898+0000 7fb972d9d700 1 --2- 172.21.15.152:0/2824307907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9740acd20 0x7fb9740b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:34.912 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.898+0000 7fb972d9d700 1 -- 172.21.15.152:0/2824307907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9740adab0 msgr2=0x7fb9740afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:34.912 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.898+0000 7fb972d9d700 1 --2- 172.21.15.152:0/2824307907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9740adab0 0x7fb9740afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:34.912 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.898+0000 7fb972d9d700 1 -- 172.21.15.152:0/2824307907 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb964009550 con 0x7fb974157f50 2022-09-20T20:08:34.912 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.898+0000 7fb971d9b700 1 --2- 172.21.15.152:0/2824307907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9740adab0 0x7fb9740afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-20T20:08:34.913 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.898+0000 7fb972d9d700 1 --2- 172.21.15.152:0/2824307907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb974157f50 0x7fb9740b03a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb964014040 tx=0x7fb964004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:34.913 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.899+0000 7fb962ffd700 1 -- 172.21.15.152:0/2824307907 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964004590 con 0x7fb974157f50 2022-09-20T20:08:34.913 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.899+0000 7fb962ffd700 1 -- 172.21.15.152:0/2824307907 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96401e070 con 0x7fb974157f50 2022-09-20T20:08:34.913 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.899+0000 7fb962ffd700 1 -- 172.21.15.152:0/2824307907 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9640038e0 con 0x7fb974157f50 2022-09-20T20:08:34.914 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.899+0000 7fb978e0e700 1 -- 172.21.15.152:0/2824307907 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9740b30b0 con 0x7fb974157f50 2022-09-20T20:08:34.914 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.899+0000 7fb978e0e700 1 -- 172.21.15.152:0/2824307907 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9740b23c0 con 0x7fb974157f50 2022-09-20T20:08:34.914 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.900+0000 7fb978e0e700 1 -- 172.21.15.152:0/2824307907 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9740b35d0 con 0x7fb974157f50 2022-09-20T20:08:34.914 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.900+0000 7fb962ffd700 1 -- 172.21.15.152:0/2824307907 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7fb96400f050 con 0x7fb974157f50 2022-09-20T20:08:34.914 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.900+0000 7fb962ffd700 1 --2- 172.21.15.152:0/2824307907 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fb950065a50 0x7fb950067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:34.915 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.900+0000 7fb962ffd700 1 -- 172.21.15.152:0/2824307907 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb964083510 con 0x7fb974157f50 2022-09-20T20:08:34.915 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.900+0000 7fb97259c700 1 --2- 172.21.15.152:0/2824307907 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fb950065a50 0x7fb950067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:34.915 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.901+0000 7fb97259c700 1 --2- 172.21.15.152:0/2824307907 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fb950065a50 0x7fb950067f00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb96c011440 tx=0x7fb96c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:34.915 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:34.905+0000 7fb962ffd700 1 -- 172.21.15.152:0/2824307907 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7fb9740b35d0 con 0x7fb974157f50 2022-09-20T20:08:35.085 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:35.083+0000 7fb978e0e700 1 -- 172.21.15.152:0/2824307907 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9740b35d0 con 0x7fb974157f50 2022-09-20T20:08:35.086 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:35.084+0000 7fb962ffd700 1 -- 172.21.15.152:0/2824307907 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12271 (secure 0 0 0) 0x7fb9740b35d0 con 0x7fb974157f50 2022-09-20T20:08:35.087 INFO:teuthology.misc.health.smithi152.stdout: 2022-09-20T20:08:35.087 INFO:teuthology.misc.health.smithi152.stdout:{"epoch":16,"fsid":"065d03fa-a408-48e8-87c7-c58c779882b2","created":"2022-09-20T20:08:16.965173+0000","modified":"2022-09-20T20:08:31.537732+0000","last_up_change":"2022-09-20T20:08:28.204035+0000","last_in_change":"2022-09-20T20:08:19.551690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-20T20:08:28.246838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"c48a8b9b-3648-4172-8ee8-1ff95e1f0452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":107512},{"type":"v1","addr":"172.21.15.152:6819","nonce":107512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":107512},{"type":"v1","addr":"172.21.15.152:6824","nonce":107512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":107512},{"type":"v1","addr":"172.21.15.152:6831","nonce":107512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":107512},{"type":"v1","addr":"172.21.15.152:6828","nonce":107512}]},"public_addr":"172.21.15.152:6819/107512","cluster_addr":"172.21.15.152:6824/107512","heartbeat_back_addr":"172.21.15.152:6831/107512","heartbeat_front_addr":"172.21.15.152:6828/107512","state":["exists","up"]},{"osd":1,"uuid":"e272de33-f058-41d6-af3a-3031de13004d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":107513},{"type":"v1","addr":"172.21.15.152:6818","nonce":107513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":107513},{"type":"v1","addr":"172.21.15.152:6822","nonce":107513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6827","nonce":107513},{"type":"v1","addr":"172.21.15.152:6829","nonce":107513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6823","nonce":107513},{"type":"v1","addr":"172.21.15.152:6825","nonce":107513}]},"public_addr":"172.21.15.152:6818/107513","cluster_addr":"172.21.15.152:6822/107513","heartbeat_back_addr":"172.21.15.152:6829/107513","heartbeat_front_addr":"172.21.15.152:6825/107513","state":["exists","up"]},{"osd":2,"uuid":"ab49b061-3e6f-4acb-a402-c687d6b71b7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":107514},{"type":"v1","addr":"172.21.15.152:6809","nonce":107514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":107514},{"type":"v1","addr":"172.21.15.152:6811","nonce":107514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":107514},{"type":"v1","addr":"172.21.15.152:6815","nonce":107514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":107514},{"type":"v1","addr":"172.21.15.152:6813","nonce":107514}]},"public_addr":"172.21.15.152:6809/107514","cluster_addr":"172.21.15.152:6811/107514","heartbeat_back_addr":"172.21.15.152:6815/107514","heartbeat_front_addr":"172.21.15.152:6813/107514","state":["exists","up"]},{"osd":3,"uuid":"465e8685-6b56-4763-9ce8-937508e05d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":107515},{"type":"v1","addr":"172.21.15.152:6801","nonce":107515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":107515},{"type":"v1","addr":"172.21.15.152:6803","nonce":107515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":107515},{"type":"v1","addr":"172.21.15.152:6807","nonce":107515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":107515},{"type":"v1","addr":"172.21.15.152:6805","nonce":107515}]},"public_addr":"172.21.15.152:6801/107515","cluster_addr":"172.21.15.152:6803/107515","heartbeat_back_addr":"172.21.15.152:6807/107515","heartbeat_front_addr":"172.21.15.152:6805/107515","state":["exists","up"]},{"osd":4,"uuid":"3f460e6a-25ec-4940-ba11-6cc651fca0b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":107736},{"type":"v1","addr":"172.21.15.171:6801","nonce":107736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":107736},{"type":"v1","addr":"172.21.15.171:6803","nonce":107736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":107736},{"type":"v1","addr":"172.21.15.171:6807","nonce":107736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":107736},{"type":"v1","addr":"172.21.15.171:6805","nonce":107736}]},"public_addr":"172.21.15.171:6801/107736","cluster_addr":"172.21.15.171:6803/107736","heartbeat_back_addr":"172.21.15.171:6807/107736","heartbeat_front_addr":"172.21.15.171:6805/107736","state":["exists","up"]},{"osd":5,"uuid":"8adc5c61-c754-4cdf-8eda-b5d20a09bf5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":107737},{"type":"v1","addr":"172.21.15.171:6809","nonce":107737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":107737},{"type":"v1","addr":"172.21.15.171:6811","nonce":107737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":107737},{"type":"v1","addr":"172.21.15.171:6815","nonce":107737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":107737},{"type":"v1","addr":"172.21.15.171:6813","nonce":107737}]},"public_addr":"172.21.15.171:6809/107737","cluster_addr":"172.21.15.171:6811/107737","heartbeat_back_addr":"172.21.15.171:6815/107737","heartbeat_front_addr":"172.21.15.171:6813/107737","state":["exists","up"]},{"osd":6,"uuid":"be0e8f6c-e8df-4488-a8c2-ffd847668001","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":107767},{"type":"v1","addr":"172.21.15.171:6817","nonce":107767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":107767},{"type":"v1","addr":"172.21.15.171:6819","nonce":107767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":107767},{"type":"v1","addr":"172.21.15.171:6823","nonce":107767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":107767},{"type":"v1","addr":"172.21.15.171:6821","nonce":107767}]},"public_addr":"172.21.15.171:6817/107767","cluster_addr":"172.21.15.171:6819/107767","heartbeat_back_addr":"172.21.15.171:6823/107767","heartbeat_front_addr":"172.21.15.171:6821/107767","state":["exists","up"]},{"osd":7,"uuid":"7841c1e5-c5d4-4b08-917e-a6ff8ef0cc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":107769},{"type":"v1","addr":"172.21.15.171:6825","nonce":107769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":107769},{"type":"v1","addr":"172.21.15.171:6827","nonce":107769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":107769},{"type":"v1","addr":"172.21.15.171:6831","nonce":107769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":107769},{"type":"v1","addr":"172.21.15.171:6829","nonce":107769}]},"public_addr":"172.21.15.171:6825/107769","cluster_addr":"172.21.15.171:6827/107769","heartbeat_back_addr":"172.21.15.171:6831/107769","heartbeat_front_addr":"172.21.15.171:6829/107769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.710168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.695513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.702054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.661718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.695237+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.732826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.747499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.793589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-20T20:08:35.089 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:35.086+0000 7fb978e0e700 1 -- 172.21.15.152:0/2824307907 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fb950065a50 msgr2=0x7fb950067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:35.089 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:35.086+0000 7fb978e0e700 1 --2- 172.21.15.152:0/2824307907 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fb950065a50 0x7fb950067f00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb96c011440 tx=0x7fb96c00b040 comp rx=0 tx=0).stop 2022-09-20T20:08:35.089 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:35.086+0000 7fb978e0e700 1 -- 172.21.15.152:0/2824307907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb974157f50 msgr2=0x7fb9740b03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:35.090 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:35.086+0000 7fb978e0e700 1 --2- 172.21.15.152:0/2824307907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb974157f50 0x7fb9740b03a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb964014040 tx=0x7fb964004750 comp rx=0 tx=0).stop 2022-09-20T20:08:35.090 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:35.086+0000 7fb978e0e700 1 -- 172.21.15.152:0/2824307907 shutdown_connections 2022-09-20T20:08:35.090 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:35.086+0000 7fb978e0e700 1 --2- 172.21.15.152:0/2824307907 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fb950065a50 0x7fb950067f00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.091 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:35.086+0000 7fb978e0e700 1 --2- 172.21.15.152:0/2824307907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9740acd20 0x7fb9740b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.091 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:35.086+0000 7fb978e0e700 1 --2- 172.21.15.152:0/2824307907 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb974157f50 0x7fb9740b03a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.091 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:35.086+0000 7fb978e0e700 1 --2- 172.21.15.152:0/2824307907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9740adab0 0x7fb9740afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.091 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:35.086+0000 7fb978e0e700 1 -- 172.21.15.152:0/2824307907 >> 172.21.15.152:0/2824307907 conn(0x7fb97406a710 msgr2=0x7fb97414e840 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:35.092 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:35.086+0000 7fb978e0e700 1 -- 172.21.15.152:0/2824307907 shutdown_connections 2022-09-20T20:08:35.092 INFO:teuthology.misc.health.smithi152.stderr:2022-09-20T20:08:35.086+0000 7fb978e0e700 1 -- 172.21.15.152:0/2824307907 wait complete. 2022-09-20T20:08:35.100 DEBUG:teuthology.misc:8 of 8 OSDs are up 2022-09-20T20:08:35.100 INFO:tasks.ceph:Creating RBD pool 2022-09-20T20:08:35.101 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd pool create rbd 8 2022-09-20T20:08:35.221 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.219+0000 7f79a74b9700 1 Processor -- start 2022-09-20T20:08:35.222 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.220+0000 7f79a74b9700 1 -- start start 2022-09-20T20:08:35.225 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.220+0000 7f79a74b9700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f79a00ce500 0x7f79a00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:35.225 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.220+0000 7f79a74b9700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79a00b04f0 0x7f79a00b0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:35.225 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.220+0000 7f79a74b9700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a00cb2b0 con 0x7f79a00ce8d0 2022-09-20T20:08:35.226 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.220+0000 7f79a74b9700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a00afff0 con 0x7f79a00ce500 2022-09-20T20:08:35.226 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.220+0000 7f79a74b9700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00cc490 con 0x7f79a00b04f0 2022-09-20T20:08:35.226 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.220+0000 7f79a5255700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f79a00ce500 0x7f79a00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:35.227 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.220+0000 7f79a5255700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f79a00ce500 0x7f79a00694b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43104/0 (socket says 172.21.15.152:43104) 2022-09-20T20:08:35.227 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.220+0000 7f79a5255700 1 -- 172.21.15.152:0/2108488965 learned_addr learned my addr 172.21.15.152:0/2108488965 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:35.227 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.220+0000 7f79a4a54700 1 --1- 172.21.15.152:0/2108488965 >> v1:172.21.15.152:6789/0 conn(0x7f79a00ce8d0 0x7f79a00caba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46836/0 (socket says 172.21.15.152:46836) 2022-09-20T20:08:35.227 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.221+0000 7f79a5a56700 1 --2- 172.21.15.152:0/2108488965 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79a00b04f0 0x7f79a00b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:35.227 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.221+0000 7f79a5255700 1 -- 172.21.15.152:0/2108488965 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79a00b04f0 msgr2=0x7f79a00b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:35.228 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.221+0000 7f79a5255700 1 --2- 172.21.15.152:0/2108488965 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79a00b04f0 0x7f79a00b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.228 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.221+0000 7f79a5255700 1 -- 172.21.15.152:0/2108488965 >> v1:172.21.15.152:6789/0 conn(0x7f79a00ce8d0 legacy=0x7f79a00caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:35.228 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.221+0000 7f798ffff700 1 -- 172.21.15.152:0/2108488965 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715779080 0 0) 0x7f79a00cb2b0 con 0x7f79a00ce8d0 2022-09-20T20:08:35.228 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.221+0000 7f79a5255700 1 -- 172.21.15.152:0/2108488965 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a00cdea0 con 0x7f79a00ce500 2022-09-20T20:08:35.228 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.221+0000 7f79a5255700 1 --2- 172.21.15.152:0/2108488965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a00ce500 0x7f79a00694b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f79900098f0 tx=0x7f7990009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2358a4e894034c43 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:35.229 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.221+0000 7f798ffff700 1 -- 172.21.15.152:0/2108488965 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990011830 con 0x7f79a00ce500 2022-09-20T20:08:35.229 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.221+0000 7f798ffff700 1 -- 172.21.15.152:0/2108488965 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7990011990 con 0x7f79a00ce500 2022-09-20T20:08:35.229 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.221+0000 7f798ffff700 1 -- 172.21.15.152:0/2108488965 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990011d20 con 0x7f79a00ce500 2022-09-20T20:08:35.229 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.222+0000 7f79a74b9700 1 -- 172.21.15.152:0/2108488965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a00ce500 msgr2=0x7f79a00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:35.230 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.222+0000 7f79a74b9700 1 --2- 172.21.15.152:0/2108488965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a00ce500 0x7f79a00694b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f79900098f0 tx=0x7f7990009c00 comp rx=0 tx=0).stop 2022-09-20T20:08:35.230 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.222+0000 7f79a74b9700 1 -- 172.21.15.152:0/2108488965 shutdown_connections 2022-09-20T20:08:35.230 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.222+0000 7f79a74b9700 1 --2- 172.21.15.152:0/2108488965 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79a00b04f0 0x7f79a00b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.231 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.222+0000 7f79a74b9700 1 --2- 172.21.15.152:0/2108488965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a00ce500 0x7f79a00694b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.231 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.222+0000 7f79a74b9700 1 -- 172.21.15.152:0/2108488965 >> 172.21.15.152:0/2108488965 conn(0x7f79a0069df0 msgr2=0x7f79a006a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:35.231 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.222+0000 7f79a74b9700 1 -- 172.21.15.152:0/2108488965 shutdown_connections 2022-09-20T20:08:35.231 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.222+0000 7f79a74b9700 1 -- 172.21.15.152:0/2108488965 wait complete. 2022-09-20T20:08:35.231 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.223+0000 7f79a74b9700 1 Processor -- start 2022-09-20T20:08:35.232 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.223+0000 7f79a74b9700 1 -- start start 2022-09-20T20:08:35.235 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.223+0000 7f79a74b9700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a00b04f0 0x7f79a015a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:35.235 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a74b9700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79a00ce500 0x7f79a00c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:35.236 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a74b9700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79a00ce8d0 0x7f79a00c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:35.236 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a74b9700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00ad450 con 0x7f79a00b04f0 2022-09-20T20:08:35.236 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a74b9700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00ac840 con 0x7f79a00ce500 2022-09-20T20:08:35.236 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a74b9700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00acb20 con 0x7f79a00ce8d0 2022-09-20T20:08:35.237 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a5255700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a00b04f0 0x7f79a015a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:35.237 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a5255700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a00b04f0 0x7f79a015a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43108/0 (socket says 172.21.15.152:43108) 2022-09-20T20:08:35.237 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a5255700 1 -- 172.21.15.152:0/2646315098 learned_addr learned my addr 172.21.15.152:0/2646315098 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:35.237 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a5a56700 1 --2- 172.21.15.152:0/2646315098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79a00ce8d0 0x7f79a00c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:35.238 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a4a54700 1 --2- 172.21.15.152:0/2646315098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79a00ce500 0x7f79a00c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:35.238 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a5255700 1 -- 172.21.15.152:0/2646315098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79a00ce8d0 msgr2=0x7f79a00c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:35.238 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a5255700 1 --2- 172.21.15.152:0/2646315098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79a00ce8d0 0x7f79a00c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.238 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a5255700 1 -- 172.21.15.152:0/2646315098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79a00ce500 msgr2=0x7f79a00c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:35.239 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a5255700 1 --2- 172.21.15.152:0/2646315098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79a00ce500 0x7f79a00c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.239 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a5255700 1 -- 172.21.15.152:0/2646315098 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7990009550 con 0x7f79a00b04f0 2022-09-20T20:08:35.239 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a4a54700 1 --2- 172.21.15.152:0/2646315098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79a00ce500 0x7f79a00c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-20T20:08:35.239 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a5255700 1 --2- 172.21.15.152:0/2646315098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a00b04f0 0x7f79a015a720 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7990009c40 tx=0x7f7990004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:35.239 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f798dffb700 1 -- 172.21.15.152:0/2646315098 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7990004400 con 0x7f79a00b04f0 2022-09-20T20:08:35.240 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f798dffb700 1 -- 172.21.15.152:0/2646315098 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799001f070 con 0x7f79a00b04f0 2022-09-20T20:08:35.240 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a74b9700 1 -- 172.21.15.152:0/2646315098 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a00ace00 con 0x7f79a00b04f0 2022-09-20T20:08:35.240 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f798dffb700 1 -- 172.21.15.152:0/2646315098 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79900038c0 con 0x7f79a00b04f0 2022-09-20T20:08:35.240 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.224+0000 7f79a74b9700 1 -- 172.21.15.152:0/2646315098 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a00ac510 con 0x7f79a00b04f0 2022-09-20T20:08:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.225+0000 7f79a74b9700 1 -- 172.21.15.152:0/2646315098 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a004da60 con 0x7f79a00b04f0 2022-09-20T20:08:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.226+0000 7f798dffb700 1 -- 172.21.15.152:0/2646315098 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7f799002a020 con 0x7f79a00b04f0 2022-09-20T20:08:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.226+0000 7f798dffb700 1 --2- 172.21.15.152:0/2646315098 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f7980065a50 0x7f7980067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.226+0000 7f798dffb700 1 -- 172.21.15.152:0/2646315098 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7990083b50 con 0x7f79a00b04f0 2022-09-20T20:08:35.241 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.226+0000 7f79a4a54700 1 --2- 172.21.15.152:0/2646315098 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f7980065a50 0x7f7980067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:35.242 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.227+0000 7f79a4a54700 1 --2- 172.21.15.152:0/2646315098 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f7980065a50 0x7f7980067f00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f79a00ab8c0 tx=0x7f799c007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:35.242 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.230+0000 7f798dffb700 1 -- 172.21.15.152:0/2646315098 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7f7990051f20 con 0x7f79a00b04f0 2022-09-20T20:08:35.411 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.409+0000 7f79a74b9700 1 -- 172.21.15.152:0/2646315098 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f79a00ad590 con 0x7f79a00b04f0 2022-09-20T20:08:35.745 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.743+0000 7f798dffb700 1 -- 172.21.15.152:0/2646315098 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7f79a00ad590 con 0x7f79a00b04f0 2022-09-20T20:08:35.748 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.746+0000 7f79a74b9700 1 -- 172.21.15.152:0/2646315098 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f7980065a50 msgr2=0x7f7980067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:35.749 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.746+0000 7f79a74b9700 1 --2- 172.21.15.152:0/2646315098 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f7980065a50 0x7f7980067f00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f79a00ab8c0 tx=0x7f799c007d30 comp rx=0 tx=0).stop 2022-09-20T20:08:35.749 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.746+0000 7f79a74b9700 1 -- 172.21.15.152:0/2646315098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a00b04f0 msgr2=0x7f79a015a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:35.749 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.746+0000 7f79a74b9700 1 --2- 172.21.15.152:0/2646315098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a00b04f0 0x7f79a015a720 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7990009c40 tx=0x7f7990004750 comp rx=0 tx=0).stop 2022-09-20T20:08:35.750 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.746+0000 7f79a74b9700 1 -- 172.21.15.152:0/2646315098 shutdown_connections 2022-09-20T20:08:35.750 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.746+0000 7f79a74b9700 1 --2- 172.21.15.152:0/2646315098 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f7980065a50 0x7f7980067f00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.750 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.746+0000 7f79a74b9700 1 --2- 172.21.15.152:0/2646315098 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79a00ce8d0 0x7f79a00c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.751 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.746+0000 7f79a74b9700 1 --2- 172.21.15.152:0/2646315098 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79a00b04f0 0x7f79a015a720 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.751 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.746+0000 7f79a74b9700 1 --2- 172.21.15.152:0/2646315098 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f79a00ce500 0x7f79a00c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.752 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.746+0000 7f79a74b9700 1 -- 172.21.15.152:0/2646315098 >> 172.21.15.152:0/2646315098 conn(0x7f79a0069df0 msgr2=0x7f79a00aeef0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:35.752 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.746+0000 7f79a74b9700 1 -- 172.21.15.152:0/2646315098 shutdown_connections 2022-09-20T20:08:35.753 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.746+0000 7f79a74b9700 1 -- 172.21.15.152:0/2646315098 wait complete. 2022-09-20T20:08:35.753 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'rbd' created 2022-09-20T20:08:35.760 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2022-09-20T20:08:35.883 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.881+0000 7f5ac215a700 1 Processor -- start 2022-09-20T20:08:35.884 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.881+0000 7f5ac215a700 1 -- start start 2022-09-20T20:08:35.890 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.882+0000 7f5ac215a700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5abc157ec0 0x7f5abc0ca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:35.891 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.882+0000 7f5ac215a700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5abc0cc1d0 0x7f5abc0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:35.891 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.882+0000 7f5ac215a700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5abc158290 con 0x7f5abc0caf50 2022-09-20T20:08:35.891 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.882+0000 7f5ac215a700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5abc0ccb90 con 0x7f5abc157ec0 2022-09-20T20:08:35.891 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.882+0000 7f5ac215a700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc0ca0b0 con 0x7f5abc0cc1d0 2022-09-20T20:08:35.892 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.882+0000 7f5abaffd700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f5abc0caf50 0x7f5abc0c8c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:46846/0 (socket says 172.21.15.152:46846) 2022-09-20T20:08:35.892 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.882+0000 7f5abaffd700 1 -- 172.21.15.152:0/246836704 learned_addr learned my addr 172.21.15.152:0/246836704 (peer_addr_for_me v1:172.21.15.152:0/0) 2022-09-20T20:08:35.892 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.882+0000 7f5aba7fc700 1 -- 172.21.15.152:0/246836704 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372609936 0 0) 0x7f5aac001110 con 0x7f5abc0caf50 2022-09-20T20:08:35.892 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.882+0000 7f5aba7fc700 1 -- 172.21.15.152:0/246836704 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5aa80035b0 con 0x7f5abc0caf50 2022-09-20T20:08:35.893 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.882+0000 7f5abbfff700 1 --2- 172.21.15.152:0/246836704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5abc0cc1d0 0x7f5abc0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:35.893 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.882+0000 7f5abb7fe700 1 --2- 172.21.15.152:0/246836704 >> v2:172.21.15.171:3300/0 conn(0x7f5abc157ec0 0x7f5abc0ca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:35.893 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5aba7fc700 1 -- 172.21.15.152:0/246836704 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1666992162 0 0) 0x7f5aa80035b0 con 0x7f5abc0caf50 2022-09-20T20:08:35.893 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5aba7fc700 1 -- 172.21.15.152:0/246836704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5abc0cc1d0 msgr2=0x7f5abc0cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:35.893 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5aba7fc700 1 --2- 172.21.15.152:0/246836704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5abc0cc1d0 0x7f5abc0cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.894 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5aba7fc700 1 -- 172.21.15.152:0/246836704 >> v2:172.21.15.171:3300/0 conn(0x7f5abc157ec0 msgr2=0x7f5abc0ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:35.894 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5aba7fc700 1 --2- 172.21.15.152:0/246836704 >> v2:172.21.15.171:3300/0 conn(0x7f5abc157ec0 0x7f5abc0ca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.894 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5aba7fc700 1 -- 172.21.15.152:0/246836704 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc0c94a0 con 0x7f5abc0caf50 2022-09-20T20:08:35.894 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5aba7fc700 1 -- 172.21.15.152:0/246836704 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3495984756 0 0) 0x7f5aac001800 con 0x7f5abc0caf50 2022-09-20T20:08:35.895 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5aba7fc700 1 -- 172.21.15.152:0/246836704 >> v1:172.21.15.152:6789/0 conn(0x7f5abc0caf50 legacy=0x7f5abc0c8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:35.895 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5aba7fc700 1 --2- 172.21.15.152:0/246836704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5abc0cc1d0 0x7f5aa8003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:35.895 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5aba7fc700 1 --2- 172.21.15.152:0/246836704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5aa8003f80 0x7f5aa8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:35.895 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5aba7fc700 1 --2- 172.21.15.152:0/246836704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5aa8004d90 0x7f5aa8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:35.895 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5aba7fc700 1 -- 172.21.15.152:0/246836704 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc0ccb90 con 0x7f5aa8003f80 2022-09-20T20:08:35.896 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5aba7fc700 1 -- 172.21.15.152:0/246836704 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc0ca0b0 con 0x7f5aa8004d90 2022-09-20T20:08:35.896 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5aba7fc700 1 -- 172.21.15.152:0/246836704 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa800ba10 con 0x7f5abc0cc1d0 2022-09-20T20:08:35.896 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5abaffd700 1 --2- 172.21.15.152:0/246836704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5aa8003f80 0x7f5aa8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:35.896 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5abb7fe700 1 --2- 172.21.15.152:0/246836704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5abc0cc1d0 0x7f5aa8003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:35.897 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5abbfff700 1 --2- 172.21.15.152:0/246836704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5aa8004d90 0x7f5aa8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:35.897 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5abaffd700 1 -- 172.21.15.152:0/246836704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5abc0cc1d0 msgr2=0x7f5aa8003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:35.897 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5abaffd700 1 --2- 172.21.15.152:0/246836704 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5abc0cc1d0 0x7f5aa8003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.897 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5abaffd700 1 -- 172.21.15.152:0/246836704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5aa8004d90 msgr2=0x7f5aa8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:35.897 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5abaffd700 1 --2- 172.21.15.152:0/246836704 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5aa8004d90 0x7f5aa8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.898 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5abaffd700 1 -- 172.21.15.152:0/246836704 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa80035b0 con 0x7f5aa8003f80 2022-09-20T20:08:35.898 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5abaffd700 1 --2- 172.21.15.152:0/246836704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5aa8003f80 0x7f5aa8004850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00c2f0 tx=0x7f5aa8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f14cbabe03ca7b9 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:35.898 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5aba7fc700 1 -- 172.21.15.152:0/246836704 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac00ce30 con 0x7f5aa8003f80 2022-09-20T20:08:35.898 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5aba7fc700 1 -- 172.21.15.152:0/246836704 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aac005960 con 0x7f5aa8003f80 2022-09-20T20:08:35.899 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.883+0000 7f5aba7fc700 1 -- 172.21.15.152:0/246836704 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aac005d10 con 0x7f5aa8003f80 2022-09-20T20:08:35.899 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.884+0000 7f5ac215a700 1 -- 172.21.15.152:0/246836704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5aa8003f80 msgr2=0x7f5aa8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:35.899 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.884+0000 7f5ac215a700 1 --2- 172.21.15.152:0/246836704 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5aa8003f80 0x7f5aa8004850 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00c2f0 tx=0x7f5aa8005880 comp rx=0 tx=0).stop 2022-09-20T20:08:35.899 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.884+0000 7f5abbfff700 1 -- 172.21.15.152:0/246836704 reap_dead start 2022-09-20T20:08:35.899 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.884+0000 7f5ac215a700 1 -- 172.21.15.152:0/246836704 shutdown_connections 2022-09-20T20:08:35.900 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.884+0000 7f5ac215a700 1 -- 172.21.15.152:0/246836704 >> 172.21.15.152:0/246836704 conn(0x7f5abc097a10 msgr2=0x7f5abc06a710 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:35.900 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.884+0000 7f5ac215a700 1 -- 172.21.15.152:0/246836704 shutdown_connections 2022-09-20T20:08:35.900 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.884+0000 7f5ac215a700 1 -- 172.21.15.152:0/246836704 wait complete. 2022-09-20T20:08:35.900 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.885+0000 7f5ac215a700 1 Processor -- start 2022-09-20T20:08:35.900 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.885+0000 7f5ac215a700 1 -- start start 2022-09-20T20:08:35.901 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.886+0000 7f5ac215a700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5aa8003f80 0x7f5abc150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:35.901 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.886+0000 7f5ac215a700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5abc1f0980 0x7f5abc0c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:35.901 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.886+0000 7f5ac215a700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5abc0c7f10 0x7f5abc0cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:35.901 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.886+0000 7f5ac215a700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc0c8420 con 0x7f5aa8003f80 2022-09-20T20:08:35.902 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.886+0000 7f5ac215a700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc1efea0 con 0x7f5abc0c7f10 2022-09-20T20:08:35.902 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.886+0000 7f5ac215a700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc1f0180 con 0x7f5abc1f0980 2022-09-20T20:08:35.902 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.886+0000 7f5abb7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5aa8003f80 0x7f5abc150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:35.902 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.886+0000 7f5abb7fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5aa8003f80 0x7f5abc150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:43126/0 (socket says 172.21.15.152:43126) 2022-09-20T20:08:35.902 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.886+0000 7f5abb7fe700 1 -- 172.21.15.152:0/3076508394 learned_addr learned my addr 172.21.15.152:0/3076508394 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:35.903 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.886+0000 7f5abaffd700 1 --2- 172.21.15.152:0/3076508394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5abc1f0980 0x7f5abc0c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:35.903 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.886+0000 7f5abbfff700 1 --2- 172.21.15.152:0/3076508394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5abc0c7f10 0x7f5abc0cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:35.903 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.886+0000 7f5abb7fe700 1 -- 172.21.15.152:0/3076508394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5abc1f0980 msgr2=0x7f5abc0c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:35.903 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.886+0000 7f5abb7fe700 1 --2- 172.21.15.152:0/3076508394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5abc1f0980 0x7f5abc0c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.904 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.886+0000 7f5abb7fe700 1 -- 172.21.15.152:0/3076508394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5abc0c7f10 msgr2=0x7f5abc0cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:35.904 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.886+0000 7f5abb7fe700 1 --2- 172.21.15.152:0/3076508394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5abc0c7f10 0x7f5abc0cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:35.904 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.886+0000 7f5abb7fe700 1 -- 172.21.15.152:0/3076508394 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc1f0460 con 0x7f5aa8003f80 2022-09-20T20:08:35.904 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.886+0000 7f5abaffd700 1 --2- 172.21.15.152:0/3076508394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5abc1f0980 0x7f5abc0c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-09-20T20:08:35.904 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.886+0000 7f5abbfff700 1 --2- 172.21.15.152:0/3076508394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5abc0c7f10 0x7f5abc0cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-09-20T20:08:35.905 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.887+0000 7f5abb7fe700 1 --2- 172.21.15.152:0/3076508394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5aa8003f80 0x7f5abc150b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0012b40 tx=0x7f5ab0012f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:35.905 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.887+0000 7f5aa3fff700 1 -- 172.21.15.152:0/3076508394 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab000c070 con 0x7f5aa8003f80 2022-09-20T20:08:35.905 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.887+0000 7f5aa3fff700 1 -- 172.21.15.152:0/3076508394 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab0010c50 con 0x7f5aa8003f80 2022-09-20T20:08:35.905 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.887+0000 7f5ac215a700 1 -- 172.21.15.152:0/3076508394 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5abc153b00 con 0x7f5aa8003f80 2022-09-20T20:08:35.906 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.887+0000 7f5aa3fff700 1 -- 172.21.15.152:0/3076508394 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab001a410 con 0x7f5aa8003f80 2022-09-20T20:08:35.906 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.887+0000 7f5ac215a700 1 -- 172.21.15.152:0/3076508394 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5abc0cb930 con 0x7f5aa8003f80 2022-09-20T20:08:35.906 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.888+0000 7f5ac215a700 1 -- 172.21.15.152:0/3076508394 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5abc1efd00 con 0x7f5aa8003f80 2022-09-20T20:08:35.906 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.888+0000 7f5aa3fff700 1 -- 172.21.15.152:0/3076508394 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7f5ab0021030 con 0x7f5aa8003f80 2022-09-20T20:08:35.906 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.888+0000 7f5aa3fff700 1 --2- 172.21.15.152:0/3076508394 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f5a9c065a50 0x7f5a9c067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:35.907 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.889+0000 7f5aa3fff700 1 -- 172.21.15.152:0/3076508394 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f5ab00829b0 con 0x7f5aa8003f80 2022-09-20T20:08:35.907 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.889+0000 7f5abaffd700 1 --2- 172.21.15.152:0/3076508394 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f5a9c065a50 0x7f5a9c067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:35.907 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.889+0000 7f5abaffd700 1 --2- 172.21.15.152:0/3076508394 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f5a9c065a50 0x7f5a9c067f00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5aac015040 tx=0x7f5aac00a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:35.908 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:35.893+0000 7f5aa3fff700 1 -- 172.21.15.152:0/3076508394 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7f5abc1efd00 con 0x7f5aa8003f80 2022-09-20T20:08:36.077 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.075+0000 7f5ac215a700 1 -- 172.21.15.152:0/3076508394 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5abc1efd00 con 0x7f5aa8003f80 2022-09-20T20:08:36.716 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-20T20:08:36.719 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-09-20T20:08:36.750 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.748+0000 7f5aa3fff700 1 -- 172.21.15.152:0/3076508394 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f5abc1efd00 con 0x7f5aa8003f80 2022-09-20T20:08:36.754 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.751+0000 7f5ac215a700 1 -- 172.21.15.152:0/3076508394 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f5a9c065a50 msgr2=0x7f5a9c067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:36.754 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.751+0000 7f5ac215a700 1 --2- 172.21.15.152:0/3076508394 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f5a9c065a50 0x7f5a9c067f00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5aac015040 tx=0x7f5aac00a000 comp rx=0 tx=0).stop 2022-09-20T20:08:36.754 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.751+0000 7f5ac215a700 1 -- 172.21.15.152:0/3076508394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5aa8003f80 msgr2=0x7f5abc150b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:36.755 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.751+0000 7f5ac215a700 1 --2- 172.21.15.152:0/3076508394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5aa8003f80 0x7f5abc150b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5ab0012b40 tx=0x7f5ab0012f00 comp rx=0 tx=0).stop 2022-09-20T20:08:36.755 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.751+0000 7f5ac215a700 1 -- 172.21.15.152:0/3076508394 shutdown_connections 2022-09-20T20:08:36.755 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.751+0000 7f5ac215a700 1 --2- 172.21.15.152:0/3076508394 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f5a9c065a50 0x7f5a9c067f00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:36.756 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.751+0000 7f5ac215a700 1 --2- 172.21.15.152:0/3076508394 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5abc0c7f10 0x7f5abc0cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:36.756 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.751+0000 7f5ac215a700 1 --2- 172.21.15.152:0/3076508394 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5aa8003f80 0x7f5abc150b30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:36.756 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.751+0000 7f5ac215a700 1 --2- 172.21.15.152:0/3076508394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5abc1f0980 0x7f5abc0c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:36.756 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.751+0000 7f5ac215a700 1 -- 172.21.15.152:0/3076508394 >> 172.21.15.152:0/3076508394 conn(0x7f5abc097a10 msgr2=0x7f5abc157370 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:36.757 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.752+0000 7f5ac215a700 1 -- 172.21.15.152:0/3076508394 shutdown_connections 2022-09-20T20:08:36.757 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.752+0000 7f5ac215a700 1 -- 172.21.15.152:0/3076508394 wait complete. 2022-09-20T20:08:36.757 INFO:teuthology.orchestra.run.smithi152.stderr:enabled application 'rbd' on pool 'rbd' 2022-09-20T20:08:36.768 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2022-09-20T20:08:36.769 INFO:tasks.ceph.mds.a:Restarting daemon 2022-09-20T20:08:36.769 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-09-20T20:08:36.811 INFO:tasks.ceph.mds.a:Started 2022-09-20T20:08:36.811 INFO:tasks.ceph.mds.c:Restarting daemon 2022-09-20T20:08:36.812 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-09-20T20:08:36.814 INFO:tasks.ceph.mds.c:Started 2022-09-20T20:08:36.815 INFO:tasks.ceph.mds.b:Restarting daemon 2022-09-20T20:08:36.815 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-09-20T20:08:36.818 INFO:tasks.ceph.mds.b:Started 2022-09-20T20:08:36.819 INFO:tasks.ceph.mds.d:Restarting daemon 2022-09-20T20:08:36.819 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2022-09-20T20:08:36.822 INFO:tasks.ceph.mds.d:Started 2022-09-20T20:08:36.822 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2022-09-20T20:08:36.823 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-20T20:08:36.893 INFO:tasks.ceph.mds.a.smithi152.stdout:starting mds.a at 2022-09-20T20:08:36.893 INFO:tasks.ceph.mds.c.smithi152.stdout:starting mds.c at 2022-09-20T20:08:36.904 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2022-09-20T20:08:36.905 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2022-09-20T20:08:36.952 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.950+0000 7f33c7bea700 1 Processor -- start 2022-09-20T20:08:36.953 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.951+0000 7f33c7bea700 1 -- start start 2022-09-20T20:08:36.960 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.951+0000 7f33c7bea700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33c015c140 0x7f33c006f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:36.960 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.951+0000 7f33c7bea700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c015bcb0 con 0x7f33c00cd230 2022-09-20T20:08:36.960 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.951+0000 7f33c7bea700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33c006b8a0 con 0x7f33c00b10e0 2022-09-20T20:08:36.961 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.951+0000 7f33c7bea700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c00cd6b0 con 0x7f33c015c140 2022-09-20T20:08:36.962 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c6187700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f33c00cd230 0x7f33c01582a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:34936/0 (socket says 172.21.15.152:34936) 2022-09-20T20:08:36.962 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c6187700 1 -- 172.21.15.152:0/1037164647 learned_addr learned my addr 172.21.15.152:0/1037164647 (peer_addr_for_me v1:172.21.15.152:0/0) 2022-09-20T20:08:36.963 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c5185700 1 --2- 172.21.15.152:0/1037164647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33c015c140 0x7f33c006f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:36.963 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c4984700 1 -- 172.21.15.152:0/1037164647 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754580176 0 0) 0x7f33c015bcb0 con 0x7f33c00cd230 2022-09-20T20:08:36.963 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c4984700 1 -- 172.21.15.152:0/1037164647 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33a80035b0 con 0x7f33c00cd230 2022-09-20T20:08:36.963 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c4984700 1 -- 172.21.15.152:0/1037164647 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2120381107 0 0) 0x7f33c006b8a0 con 0x7f33c00b10e0 2022-09-20T20:08:36.964 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c4984700 1 -- 172.21.15.152:0/1037164647 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33c015bcb0 con 0x7f33c00b10e0 2022-09-20T20:08:36.964 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c4984700 1 -- 172.21.15.152:0/1037164647 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 256841961 0 0) 0x7f33a80035b0 con 0x7f33c00cd230 2022-09-20T20:08:36.964 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c4984700 1 -- 172.21.15.152:0/1037164647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33c015c140 msgr2=0x7f33c006f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:36.964 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c4984700 1 --2- 172.21.15.152:0/1037164647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33c015c140 0x7f33c006f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:36.965 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c4984700 1 -- 172.21.15.152:0/1037164647 >> v1:172.21.15.171:6789/0 conn(0x7f33c00b10e0 legacy=0x7f33c00b14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:36.965 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c4984700 1 -- 172.21.15.152:0/1037164647 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c006bdf0 con 0x7f33c00cd230 2022-09-20T20:08:36.965 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c4984700 1 -- 172.21.15.152:0/1037164647 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3495984756 0 0) 0x7f33b80019f0 con 0x7f33c00cd230 2022-09-20T20:08:36.965 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c4984700 1 -- 172.21.15.152:0/1037164647 >> v1:172.21.15.152:6789/0 conn(0x7f33c00cd230 legacy=0x7f33c01582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:36.966 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c4984700 1 --2- 172.21.15.152:0/1037164647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33a8003bc0 0x7f33a8003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:36.966 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c4984700 1 --2- 172.21.15.152:0/1037164647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33a8004850 0x7f33a8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:36.966 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c4984700 1 --2- 172.21.15.152:0/1037164647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33a8005200 0x7f33a800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:36.966 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c4984700 1 -- 172.21.15.152:0/1037164647 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c00cd6b0 con 0x7f33a8004850 2022-09-20T20:08:36.967 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c4984700 1 -- 172.21.15.152:0/1037164647 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a800c060 con 0x7f33a8003bc0 2022-09-20T20:08:36.967 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c4984700 1 -- 172.21.15.152:0/1037164647 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a800c220 con 0x7f33a8005200 2022-09-20T20:08:36.967 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c5185700 1 --2- 172.21.15.152:0/1037164647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33c015c140 0x7f33c006f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:08:36.967 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c5986700 1 --2- 172.21.15.152:0/1037164647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33a8003bc0 0x7f33a8003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:36.968 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c5185700 1 --2- 172.21.15.152:0/1037164647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33a8004850 0x7f33a8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:36.968 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.952+0000 7f33c6187700 1 --2- 172.21.15.152:0/1037164647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33a8005200 0x7f33a800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:36.968 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.953+0000 7f33c5986700 1 -- 172.21.15.152:0/1037164647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33a8005200 msgr2=0x7f33a800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:36.968 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.953+0000 7f33c5986700 1 --2- 172.21.15.152:0/1037164647 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33a8005200 0x7f33a800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:36.969 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.953+0000 7f33c5986700 1 -- 172.21.15.152:0/1037164647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33a8004850 msgr2=0x7f33a8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:36.969 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.953+0000 7f33c5986700 1 --2- 172.21.15.152:0/1037164647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33a8004850 0x7f33a8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:36.969 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.953+0000 7f33c5986700 1 -- 172.21.15.152:0/1037164647 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a80035b0 con 0x7f33a8003bc0 2022-09-20T20:08:36.969 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.953+0000 7f33c5185700 1 --2- 172.21.15.152:0/1037164647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33a8004850 0x7f33a8004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-09-20T20:08:36.970 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.953+0000 7f33c5986700 1 --2- 172.21.15.152:0/1037164647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33a8003bc0 0x7f33a8003fb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f33b0001930 tx=0x7f33a8005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f464c68b36be93a6 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:36.970 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.953+0000 7f33c4984700 1 -- 172.21.15.152:0/1037164647 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b00052d0 con 0x7f33a8003bc0 2022-09-20T20:08:36.970 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.953+0000 7f33c4984700 1 -- 172.21.15.152:0/1037164647 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b0005430 con 0x7f33a8003bc0 2022-09-20T20:08:36.970 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.953+0000 7f33c4984700 1 -- 172.21.15.152:0/1037164647 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b00038c0 con 0x7f33a8003bc0 2022-09-20T20:08:36.971 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.953+0000 7f33c7bea700 1 -- 172.21.15.152:0/1037164647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33a8003bc0 msgr2=0x7f33a8003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:36.971 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.953+0000 7f33c7bea700 1 --2- 172.21.15.152:0/1037164647 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33a8003bc0 0x7f33a8003fb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f33b0001930 tx=0x7f33a8005880 comp rx=0 tx=0).stop 2022-09-20T20:08:36.971 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.953+0000 7f33c6187700 1 -- 172.21.15.152:0/1037164647 reap_dead start 2022-09-20T20:08:36.971 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.953+0000 7f33c7bea700 1 -- 172.21.15.152:0/1037164647 shutdown_connections 2022-09-20T20:08:36.972 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.953+0000 7f33c7bea700 1 -- 172.21.15.152:0/1037164647 >> 172.21.15.152:0/1037164647 conn(0x7f33c006d1b0 msgr2=0x7f33c006d580 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:36.972 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.953+0000 7f33c7bea700 1 -- 172.21.15.152:0/1037164647 shutdown_connections 2022-09-20T20:08:36.972 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.953+0000 7f33c7bea700 1 -- 172.21.15.152:0/1037164647 wait complete. 2022-09-20T20:08:36.972 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.955+0000 7f33c7bea700 1 Processor -- start 2022-09-20T20:08:36.972 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.955+0000 7f33c7bea700 1 -- start start 2022-09-20T20:08:36.973 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.955+0000 7f33c7bea700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33a8003bc0 0x7f33c00c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:36.973 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.955+0000 7f33c7bea700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33c0153950 0x7f33c00c5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:36.973 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.955+0000 7f33c7bea700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33c0140700 0x7f33c0140b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:36.973 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.955+0000 7f33c7bea700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c00c8140 con 0x7f33c0153950 2022-09-20T20:08:36.974 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.955+0000 7f33c7bea700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c00c8980 con 0x7f33c0140700 2022-09-20T20:08:36.974 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.955+0000 7f33c7bea700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c015ccb0 con 0x7f33a8003bc0 2022-09-20T20:08:36.974 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.955+0000 7f33c5185700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33c0153950 0x7f33c00c5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:36.974 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.955+0000 7f33c5185700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33c0153950 0x7f33c00c5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53946/0 (socket says 172.21.15.152:53946) 2022-09-20T20:08:36.975 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.955+0000 7f33c5185700 1 -- 172.21.15.152:0/3561007226 learned_addr learned my addr 172.21.15.152:0/3561007226 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:36.975 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.955+0000 7f33c5986700 1 --2- 172.21.15.152:0/3561007226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33a8003bc0 0x7f33c00c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:36.975 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.956+0000 7f33c6187700 1 --2- 172.21.15.152:0/3561007226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33c0140700 0x7f33c0140b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:36.975 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.956+0000 7f33c5185700 1 -- 172.21.15.152:0/3561007226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33a8003bc0 msgr2=0x7f33c00c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:36.976 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.956+0000 7f33c5185700 1 --2- 172.21.15.152:0/3561007226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33a8003bc0 0x7f33c00c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:36.976 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.956+0000 7f33c5185700 1 -- 172.21.15.152:0/3561007226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33c0140700 msgr2=0x7f33c0140b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:36.976 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.956+0000 7f33c5185700 1 --2- 172.21.15.152:0/3561007226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33c0140700 0x7f33c0140b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:36.976 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.956+0000 7f33c5185700 1 -- 172.21.15.152:0/3561007226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c00c5fd0 con 0x7f33c0153950 2022-09-20T20:08:36.977 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.956+0000 7f33c5185700 1 --2- 172.21.15.152:0/3561007226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33c0153950 0x7f33c00c5a90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f33bc011c80 tx=0x7f33bc011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:36.977 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.956+0000 7f33ae7fc700 1 -- 172.21.15.152:0/3561007226 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc00fa60 con 0x7f33c0153950 2022-09-20T20:08:36.977 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.956+0000 7f33ae7fc700 1 -- 172.21.15.152:0/3561007226 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33bc00fbc0 con 0x7f33c0153950 2022-09-20T20:08:36.977 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.956+0000 7f33ae7fc700 1 -- 172.21.15.152:0/3561007226 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc014440 con 0x7f33c0153950 2022-09-20T20:08:36.977 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.956+0000 7f33c7bea700 1 -- 172.21.15.152:0/3561007226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c015c9d0 con 0x7f33c0153950 2022-09-20T20:08:36.978 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.956+0000 7f33c7bea700 1 -- 172.21.15.152:0/3561007226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c00c8610 con 0x7f33c0153950 2022-09-20T20:08:36.978 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.957+0000 7f33ae7fc700 1 -- 172.21.15.152:0/3561007226 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7f33bc0145a0 con 0x7f33c0153950 2022-09-20T20:08:36.978 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.957+0000 7f33c7bea700 1 -- 172.21.15.152:0/3561007226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c00c8af0 con 0x7f33c0153950 2022-09-20T20:08:36.978 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.958+0000 7f33ae7fc700 1 --2- 172.21.15.152:0/3561007226 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f33a0065a50 0x7f33a0067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:36.979 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.958+0000 7f33ae7fc700 1 -- 172.21.15.152:0/3561007226 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f33bc083120 con 0x7f33c0153950 2022-09-20T20:08:36.979 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.958+0000 7f33c5986700 1 --2- 172.21.15.152:0/3561007226 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f33a0065a50 0x7f33a0067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:36.979 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.958+0000 7f33c5986700 1 --2- 172.21.15.152:0/3561007226 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f33a0065a50 0x7f33a0067f00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f33b0005040 tx=0x7f33b0009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:36.980 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:36.962+0000 7f33ae7fc700 1 -- 172.21.15.152:0/3561007226 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7f33bc051280 con 0x7f33c0153950 2022-09-20T20:08:37.146 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.144+0000 7f33c7bea700 1 -- 172.21.15.152:0/3561007226 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33c0068780 con 0x7f33c0153950 2022-09-20T20:08:37.147 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.145+0000 7f33ae7fc700 1 -- 172.21.15.152:0/3561007226 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+13804 (secure 0 0 0) 0x7f33bc0548a0 con 0x7f33c0153950 2022-09-20T20:08:37.147 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:08:37.147 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":18,"fsid":"065d03fa-a408-48e8-87c7-c58c779882b2","created":"2022-09-20T20:08:16.965173+0000","modified":"2022-09-20T20:08:36.743588+0000","last_up_change":"2022-09-20T20:08:28.204035+0000","last_in_change":"2022-09-20T20:08:19.551690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-20T20:08:28.246838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-09-20T20:08:35.427528+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c48a8b9b-3648-4172-8ee8-1ff95e1f0452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":107512},{"type":"v1","addr":"172.21.15.152:6819","nonce":107512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":107512},{"type":"v1","addr":"172.21.15.152:6824","nonce":107512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":107512},{"type":"v1","addr":"172.21.15.152:6831","nonce":107512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":107512},{"type":"v1","addr":"172.21.15.152:6828","nonce":107512}]},"public_addr":"172.21.15.152:6819/107512","cluster_addr":"172.21.15.152:6824/107512","heartbeat_back_addr":"172.21.15.152:6831/107512","heartbeat_front_addr":"172.21.15.152:6828/107512","state":["exists","up"]},{"osd":1,"uuid":"e272de33-f058-41d6-af3a-3031de13004d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":107513},{"type":"v1","addr":"172.21.15.152:6818","nonce":107513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":107513},{"type":"v1","addr":"172.21.15.152:6822","nonce":107513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6827","nonce":107513},{"type":"v1","addr":"172.21.15.152:6829","nonce":107513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6823","nonce":107513},{"type":"v1","addr":"172.21.15.152:6825","nonce":107513}]},"public_addr":"172.21.15.152:6818/107513","cluster_addr":"172.21.15.152:6822/107513","heartbeat_back_addr":"172.21.15.152:6829/107513","heartbeat_front_addr":"172.21.15.152:6825/107513","state":["exists","up"]},{"osd":2,"uuid":"ab49b061-3e6f-4acb-a402-c687d6b71b7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":107514},{"type":"v1","addr":"172.21.15.152:6809","nonce":107514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":107514},{"type":"v1","addr":"172.21.15.152:6811","nonce":107514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":107514},{"type":"v1","addr":"172.21.15.152:6815","nonce":107514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":107514},{"type":"v1","addr":"172.21.15.152:6813","nonce":107514}]},"public_addr":"172.21.15.152:6809/107514","cluster_addr":"172.21.15.152:6811/107514","heartbeat_back_addr":"172.21.15.152:6815/107514","heartbeat_front_addr":"172.21.15.152:6813/107514","state":["exists","up"]},{"osd":3,"uuid":"465e8685-6b56-4763-9ce8-937508e05d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":107515},{"type":"v1","addr":"172.21.15.152:6801","nonce":107515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":107515},{"type":"v1","addr":"172.21.15.152:6803","nonce":107515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":107515},{"type":"v1","addr":"172.21.15.152:6807","nonce":107515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":107515},{"type":"v1","addr":"172.21.15.152:6805","nonce":107515}]},"public_addr":"172.21.15.152:6801/107515","cluster_addr":"172.21.15.152:6803/107515","heartbeat_back_addr":"172.21.15.152:6807/107515","heartbeat_front_addr":"172.21.15.152:6805/107515","state":["exists","up"]},{"osd":4,"uuid":"3f460e6a-25ec-4940-ba11-6cc651fca0b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":107736},{"type":"v1","addr":"172.21.15.171:6801","nonce":107736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":107736},{"type":"v1","addr":"172.21.15.171:6803","nonce":107736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":107736},{"type":"v1","addr":"172.21.15.171:6807","nonce":107736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":107736},{"type":"v1","addr":"172.21.15.171:6805","nonce":107736}]},"public_addr":"172.21.15.171:6801/107736","cluster_addr":"172.21.15.171:6803/107736","heartbeat_back_addr":"172.21.15.171:6807/107736","heartbeat_front_addr":"172.21.15.171:6805/107736","state":["exists","up"]},{"osd":5,"uuid":"8adc5c61-c754-4cdf-8eda-b5d20a09bf5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":107737},{"type":"v1","addr":"172.21.15.171:6809","nonce":107737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":107737},{"type":"v1","addr":"172.21.15.171:6811","nonce":107737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":107737},{"type":"v1","addr":"172.21.15.171:6815","nonce":107737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":107737},{"type":"v1","addr":"172.21.15.171:6813","nonce":107737}]},"public_addr":"172.21.15.171:6809/107737","cluster_addr":"172.21.15.171:6811/107737","heartbeat_back_addr":"172.21.15.171:6815/107737","heartbeat_front_addr":"172.21.15.171:6813/107737","state":["exists","up"]},{"osd":6,"uuid":"be0e8f6c-e8df-4488-a8c2-ffd847668001","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":107767},{"type":"v1","addr":"172.21.15.171:6817","nonce":107767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":107767},{"type":"v1","addr":"172.21.15.171:6819","nonce":107767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":107767},{"type":"v1","addr":"172.21.15.171:6823","nonce":107767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":107767},{"type":"v1","addr":"172.21.15.171:6821","nonce":107767}]},"public_addr":"172.21.15.171:6817/107767","cluster_addr":"172.21.15.171:6819/107767","heartbeat_back_addr":"172.21.15.171:6823/107767","heartbeat_front_addr":"172.21.15.171:6821/107767","state":["exists","up"]},{"osd":7,"uuid":"7841c1e5-c5d4-4b08-917e-a6ff8ef0cc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":107769},{"type":"v1","addr":"172.21.15.171:6825","nonce":107769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":107769},{"type":"v1","addr":"172.21.15.171:6827","nonce":107769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":107769},{"type":"v1","addr":"172.21.15.171:6831","nonce":107769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":107769},{"type":"v1","addr":"172.21.15.171:6829","nonce":107769}]},"public_addr":"172.21.15.171:6825/107769","cluster_addr":"172.21.15.171:6827/107769","heartbeat_back_addr":"172.21.15.171:6831/107769","heartbeat_front_addr":"172.21.15.171:6829/107769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.710168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.695513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.702054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.661718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.695237+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.732826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.747499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.793589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-20T20:08:37.149 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.147+0000 7f33c7bea700 1 -- 172.21.15.152:0/3561007226 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f33a0065a50 msgr2=0x7f33a0067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:37.150 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.147+0000 7f33c7bea700 1 --2- 172.21.15.152:0/3561007226 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f33a0065a50 0x7f33a0067f00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f33b0005040 tx=0x7f33b0009030 comp rx=0 tx=0).stop 2022-09-20T20:08:37.150 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.147+0000 7f33c7bea700 1 -- 172.21.15.152:0/3561007226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33c0153950 msgr2=0x7f33c00c5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:37.150 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.147+0000 7f33c7bea700 1 --2- 172.21.15.152:0/3561007226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33c0153950 0x7f33c00c5a90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f33bc011c80 tx=0x7f33bc011f90 comp rx=0 tx=0).stop 2022-09-20T20:08:37.150 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.147+0000 7f33c7bea700 1 -- 172.21.15.152:0/3561007226 shutdown_connections 2022-09-20T20:08:37.151 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.147+0000 7f33c7bea700 1 --2- 172.21.15.152:0/3561007226 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f33a0065a50 0x7f33a0067f00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.151 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.147+0000 7f33c7bea700 1 --2- 172.21.15.152:0/3561007226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f33a8003bc0 0x7f33c00c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.151 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.147+0000 7f33c7bea700 1 --2- 172.21.15.152:0/3561007226 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f33c0140700 0x7f33c0140b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.151 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.147+0000 7f33c7bea700 1 --2- 172.21.15.152:0/3561007226 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f33c0153950 0x7f33c00c5a90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.151 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.147+0000 7f33c7bea700 1 -- 172.21.15.152:0/3561007226 >> 172.21.15.152:0/3561007226 conn(0x7f33c006d1b0 msgr2=0x7f33c00ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:37.152 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.147+0000 7f33c7bea700 1 -- 172.21.15.152:0/3561007226 shutdown_connections 2022-09-20T20:08:37.152 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.147+0000 7f33c7bea700 1 -- 172.21.15.152:0/3561007226 wait complete. 2022-09-20T20:08:37.162 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-09-20T20:08:28.246838+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-09-20T20:08:35.427528+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-09-20T20:08:37.162 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-09-20T20:08:37.288 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.286+0000 7fabf14df700 1 Processor -- start 2022-09-20T20:08:37.288 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.286+0000 7fabf14df700 1 -- start start 2022-09-20T20:08:37.295 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabf14df700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fabec152310 0x7fabec0ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.295 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabf14df700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fabec0acc20 0x7fabec0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.296 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabf14df700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fabec158ff0 0x7fabec06b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.296 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabf14df700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabec0ad380 con 0x7fabec0acc20 2022-09-20T20:08:37.296 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabf14df700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabec1526e0 con 0x7fabec152310 2022-09-20T20:08:37.296 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabf14df700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec0ad0a0 con 0x7fabec158ff0 2022-09-20T20:08:37.297 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabea7fc700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fabec0acc20 0x7fabec0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.297 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabea7fc700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fabec0acc20 0x7fabec0b25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53956/0 (socket says 172.21.15.152:53956) 2022-09-20T20:08:37.297 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabea7fc700 1 -- 172.21.15.152:0/3217516805 learned_addr learned my addr 172.21.15.152:0/3217516805 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:37.297 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabeb7fe700 1 --2- 172.21.15.152:0/3217516805 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fabec158ff0 0x7fabec06b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.298 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabeaffd700 1 --2- 172.21.15.152:0/3217516805 >> v2:172.21.15.171:3300/0 conn(0x7fabec152310 0x7fabec0ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.298 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabea7fc700 1 -- 172.21.15.152:0/3217516805 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fabec158ff0 msgr2=0x7fabec06b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:37.298 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabea7fc700 1 --2- 172.21.15.152:0/3217516805 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fabec158ff0 0x7fabec06b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.298 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabea7fc700 1 -- 172.21.15.152:0/3217516805 >> v2:172.21.15.171:3300/0 conn(0x7fabec152310 msgr2=0x7fabec0ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:37.299 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabea7fc700 1 --2- 172.21.15.152:0/3217516805 >> v2:172.21.15.171:3300/0 conn(0x7fabec152310 0x7fabec0ac6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.299 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabea7fc700 1 -- 172.21.15.152:0/3217516805 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec0b1ac0 con 0x7fabec0acc20 2022-09-20T20:08:37.299 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabea7fc700 1 --2- 172.21.15.152:0/3217516805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabec0acc20 0x7fabec0b25a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fabec06f9a0 tx=0x7fabe0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d64874e507e577 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:37.299 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabe9ffb700 1 -- 172.21.15.152:0/3217516805 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe000f8a0 con 0x7fabec0acc20 2022-09-20T20:08:37.300 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabe9ffb700 1 -- 172.21.15.152:0/3217516805 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe000fa00 con 0x7fabec0acc20 2022-09-20T20:08:37.300 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.287+0000 7fabe9ffb700 1 -- 172.21.15.152:0/3217516805 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe000fd90 con 0x7fabec0acc20 2022-09-20T20:08:37.300 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.288+0000 7fabf14df700 1 -- 172.21.15.152:0/3217516805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabec0acc20 msgr2=0x7fabec0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:37.300 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.288+0000 7fabf14df700 1 --2- 172.21.15.152:0/3217516805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabec0acc20 0x7fabec0b25a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fabec06f9a0 tx=0x7fabe0009bd0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.301 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.288+0000 7fabf14df700 1 -- 172.21.15.152:0/3217516805 shutdown_connections 2022-09-20T20:08:37.301 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.288+0000 7fabf14df700 1 --2- 172.21.15.152:0/3217516805 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fabec158ff0 0x7fabec06b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.301 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.288+0000 7fabf14df700 1 --2- 172.21.15.152:0/3217516805 >> v2:172.21.15.171:3300/0 conn(0x7fabec152310 0x7fabec0ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.301 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.288+0000 7fabf14df700 1 --2- 172.21.15.152:0/3217516805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabec0acc20 0x7fabec0b25a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.302 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.288+0000 7fabf14df700 1 -- 172.21.15.152:0/3217516805 >> 172.21.15.152:0/3217516805 conn(0x7fabec071850 msgr2=0x7fabec071c50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:37.303 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.288+0000 7fabf14df700 1 -- 172.21.15.152:0/3217516805 shutdown_connections 2022-09-20T20:08:37.303 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.288+0000 7fabf14df700 1 -- 172.21.15.152:0/3217516805 wait complete. 2022-09-20T20:08:37.303 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.289+0000 7fabf14df700 1 Processor -- start 2022-09-20T20:08:37.304 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.289+0000 7fabf14df700 1 -- start start 2022-09-20T20:08:37.304 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.290+0000 7fabf14df700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabec152310 0x7fabec1ec3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.305 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.290+0000 7fabf14df700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fabec158ff0 0x7fabec0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.305 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.290+0000 7fabf14df700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fabec0af990 0x7fabec1584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.306 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.290+0000 7fabf14df700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec0ae9b0 con 0x7fabec152310 2022-09-20T20:08:37.306 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.290+0000 7fabf14df700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabec1eccb0 con 0x7fabec0af990 2022-09-20T20:08:37.307 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.290+0000 7fabf14df700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec1ecf90 con 0x7fabec158ff0 2022-09-20T20:08:37.308 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.290+0000 7fabeaffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabec152310 0x7fabec1ec3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.308 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.290+0000 7fabeaffd700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabec152310 0x7fabec1ec3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53958/0 (socket says 172.21.15.152:53958) 2022-09-20T20:08:37.309 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.290+0000 7fabeaffd700 1 -- 172.21.15.152:0/1810635663 learned_addr learned my addr 172.21.15.152:0/1810635663 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:37.309 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.290+0000 7fabea7fc700 1 --2- 172.21.15.152:0/1810635663 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fabec158ff0 0x7fabec0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.309 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.290+0000 7fabeb7fe700 1 --2- 172.21.15.152:0/1810635663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fabec0af990 0x7fabec1584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.310 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.290+0000 7fabeaffd700 1 -- 172.21.15.152:0/1810635663 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fabec158ff0 msgr2=0x7fabec0aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:37.310 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.290+0000 7fabeaffd700 1 --2- 172.21.15.152:0/1810635663 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fabec158ff0 0x7fabec0aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.311 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.290+0000 7fabeaffd700 1 -- 172.21.15.152:0/1810635663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fabec0af990 msgr2=0x7fabec1584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:37.311 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.290+0000 7fabeaffd700 1 --2- 172.21.15.152:0/1810635663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fabec0af990 0x7fabec1584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.312 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.290+0000 7fabeaffd700 1 -- 172.21.15.152:0/1810635663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe0009550 con 0x7fabec152310 2022-09-20T20:08:37.312 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.290+0000 7fabeaffd700 1 --2- 172.21.15.152:0/1810635663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabec152310 0x7fabec1ec3f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fabe400efc0 tx=0x7fabe400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:37.312 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.290+0000 7fabd37fe700 1 -- 172.21.15.152:0/1810635663 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe400cdc0 con 0x7fabec152310 2022-09-20T20:08:37.313 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.291+0000 7fabd37fe700 1 -- 172.21.15.152:0/1810635663 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabe400f040 con 0x7fabec152310 2022-09-20T20:08:37.313 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.291+0000 7fabf14df700 1 -- 172.21.15.152:0/1810635663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabec1ed270 con 0x7fabec152310 2022-09-20T20:08:37.313 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.291+0000 7fabd37fe700 1 -- 172.21.15.152:0/1810635663 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabe40146a0 con 0x7fabec152310 2022-09-20T20:08:37.313 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.291+0000 7fabf14df700 1 -- 172.21.15.152:0/1810635663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabec1ec930 con 0x7fabec152310 2022-09-20T20:08:37.314 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.292+0000 7fabf14df700 1 -- 172.21.15.152:0/1810635663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabec04da60 con 0x7fabec152310 2022-09-20T20:08:37.314 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.292+0000 7fabd37fe700 1 -- 172.21.15.152:0/1810635663 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7fabe4014800 con 0x7fabec152310 2022-09-20T20:08:37.314 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.292+0000 7fabd37fe700 1 --2- 172.21.15.152:0/1810635663 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fabcc065a50 0x7fabcc067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.314 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.292+0000 7fabd37fe700 1 -- 172.21.15.152:0/1810635663 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fabe4083210 con 0x7fabec152310 2022-09-20T20:08:37.315 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.292+0000 7fabea7fc700 1 --2- 172.21.15.152:0/1810635663 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fabcc065a50 0x7fabcc067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.315 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.293+0000 7fabea7fc700 1 --2- 172.21.15.152:0/1810635663 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fabcc065a50 0x7fabcc067f00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fabec0cd880 tx=0x7fabe0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:37.316 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.297+0000 7fabd37fe700 1 -- 172.21.15.152:0/1810635663 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7fabe4051350 con 0x7fabec152310 2022-09-20T20:08:37.476 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.474+0000 7fabf14df700 1 -- 172.21.15.152:0/1810635663 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fabec0b1da0 con 0x7fabec152310 2022-09-20T20:08:37.477 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.475+0000 7fabd37fe700 1 -- 172.21.15.152:0/1810635663 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fabe4054970 con 0x7fabec152310 2022-09-20T20:08:37.477 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2022-09-20T20:08:37.479 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.477+0000 7fabf14df700 1 -- 172.21.15.152:0/1810635663 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fabcc065a50 msgr2=0x7fabcc067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:37.479 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.477+0000 7fabf14df700 1 --2- 172.21.15.152:0/1810635663 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fabcc065a50 0x7fabcc067f00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fabec0cd880 tx=0x7fabe0008030 comp rx=0 tx=0).stop 2022-09-20T20:08:37.479 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.477+0000 7fabf14df700 1 -- 172.21.15.152:0/1810635663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabec152310 msgr2=0x7fabec1ec3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:37.480 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.477+0000 7fabf14df700 1 --2- 172.21.15.152:0/1810635663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabec152310 0x7fabec1ec3f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fabe400efc0 tx=0x7fabe400c3a0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.480 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.477+0000 7fabf14df700 1 -- 172.21.15.152:0/1810635663 shutdown_connections 2022-09-20T20:08:37.480 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.477+0000 7fabf14df700 1 --2- 172.21.15.152:0/1810635663 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fabcc065a50 0x7fabcc067f00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.480 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.477+0000 7fabf14df700 1 --2- 172.21.15.152:0/1810635663 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fabec0af990 0x7fabec1584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.481 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.477+0000 7fabf14df700 1 --2- 172.21.15.152:0/1810635663 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fabec152310 0x7fabec1ec3f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.481 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.477+0000 7fabf14df700 1 --2- 172.21.15.152:0/1810635663 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fabec158ff0 0x7fabec0aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.481 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.477+0000 7fabf14df700 1 -- 172.21.15.152:0/1810635663 >> 172.21.15.152:0/1810635663 conn(0x7fabec071850 msgr2=0x7fabec1505c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:37.481 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.477+0000 7fabf14df700 1 -- 172.21.15.152:0/1810635663 shutdown_connections 2022-09-20T20:08:37.481 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.477+0000 7fabf14df700 1 -- 172.21.15.152:0/1810635663 wait complete. 2022-09-20T20:08:37.491 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-09-20T20:08:37.617 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.612+0000 7fef31ce7700 1 Processor -- start 2022-09-20T20:08:37.617 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.612+0000 7fef31ce7700 1 -- start start 2022-09-20T20:08:37.617 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef31ce7700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fef2c06f7d0 0x7fef2c15b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.617 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef31ce7700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fef2c0c9ed0 0x7fef2c0ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.618 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef31ce7700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef2c06fba0 0x7fef2c071850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.618 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef31ce7700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2c0cc7e0 con 0x7fef2c06f7d0 2022-09-20T20:08:37.619 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef31ce7700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef2c0cd3e0 con 0x7fef2c0c9ed0 2022-09-20T20:08:37.619 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef31ce7700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c158b80 con 0x7fef2c06fba0 2022-09-20T20:08:37.619 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef2b7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fef2c06f7d0 0x7fef2c15b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.620 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef2b7fe700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fef2c06f7d0 0x7fef2c15b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53974/0 (socket says 172.21.15.152:53974) 2022-09-20T20:08:37.620 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef2b7fe700 1 -- 172.21.15.152:0/783393089 learned_addr learned my addr 172.21.15.152:0/783393089 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:37.621 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef23fff700 1 --2- 172.21.15.152:0/783393089 >> v2:172.21.15.171:3300/0 conn(0x7fef2c0c9ed0 0x7fef2c0ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.621 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef2bfff700 1 --2- 172.21.15.152:0/783393089 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef2c06fba0 0x7fef2c071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.621 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef2b7fe700 1 -- 172.21.15.152:0/783393089 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef2c06fba0 msgr2=0x7fef2c071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:37.621 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef2b7fe700 1 --2- 172.21.15.152:0/783393089 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef2c06fba0 0x7fef2c071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.621 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef2b7fe700 1 -- 172.21.15.152:0/783393089 >> v2:172.21.15.171:3300/0 conn(0x7fef2c0c9ed0 msgr2=0x7fef2c0ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:37.622 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef2b7fe700 1 --2- 172.21.15.152:0/783393089 >> v2:172.21.15.171:3300/0 conn(0x7fef2c0c9ed0 0x7fef2c0ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.622 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef2b7fe700 1 -- 172.21.15.152:0/783393089 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c0ce9d0 con 0x7fef2c06f7d0 2022-09-20T20:08:37.622 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef23fff700 1 --2- 172.21.15.152:0/783393089 >> v2:172.21.15.171:3300/0 conn(0x7fef2c0c9ed0 0x7fef2c0ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-20T20:08:37.622 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef2bfff700 1 --2- 172.21.15.152:0/783393089 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef2c06fba0 0x7fef2c071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-20T20:08:37.623 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef2b7fe700 1 --2- 172.21.15.152:0/783393089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef2c06f7d0 0x7fef2c15b1f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fef2c071370 tx=0x7fef1c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f33ec4dc6ee588e2 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:37.623 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef2affd700 1 -- 172.21.15.152:0/783393089 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00b860 con 0x7fef2c06f7d0 2022-09-20T20:08:37.623 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef2affd700 1 -- 172.21.15.152:0/783393089 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef1c00b9c0 con 0x7fef2c06f7d0 2022-09-20T20:08:37.623 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.613+0000 7fef2affd700 1 -- 172.21.15.152:0/783393089 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1c00bd50 con 0x7fef2c06f7d0 2022-09-20T20:08:37.623 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.614+0000 7fef31ce7700 1 -- 172.21.15.152:0/783393089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef2c06f7d0 msgr2=0x7fef2c15b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:37.624 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.614+0000 7fef31ce7700 1 --2- 172.21.15.152:0/783393089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef2c06f7d0 0x7fef2c15b1f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fef2c071370 tx=0x7fef1c009c00 comp rx=0 tx=0).stop 2022-09-20T20:08:37.624 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.614+0000 7fef31ce7700 1 -- 172.21.15.152:0/783393089 shutdown_connections 2022-09-20T20:08:37.624 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.614+0000 7fef31ce7700 1 --2- 172.21.15.152:0/783393089 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef2c06fba0 0x7fef2c071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.624 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.614+0000 7fef31ce7700 1 --2- 172.21.15.152:0/783393089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef2c06f7d0 0x7fef2c15b1f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.625 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.614+0000 7fef31ce7700 1 --2- 172.21.15.152:0/783393089 >> v2:172.21.15.171:3300/0 conn(0x7fef2c0c9ed0 0x7fef2c0ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.625 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.614+0000 7fef31ce7700 1 -- 172.21.15.152:0/783393089 >> 172.21.15.152:0/783393089 conn(0x7fef2c0b04e0 msgr2=0x7fef2c0cdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:37.625 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.614+0000 7fef31ce7700 1 -- 172.21.15.152:0/783393089 shutdown_connections 2022-09-20T20:08:37.625 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.614+0000 7fef31ce7700 1 -- 172.21.15.152:0/783393089 wait complete. 2022-09-20T20:08:37.629 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.616+0000 7fef31ce7700 1 Processor -- start 2022-09-20T20:08:37.629 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.616+0000 7fef31ce7700 1 -- start start 2022-09-20T20:08:37.629 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.616+0000 7fef31ce7700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef2c06f7d0 0x7fef2c142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.630 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.616+0000 7fef31ce7700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef2c06fba0 0x7fef2c14f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.630 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.616+0000 7fef31ce7700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef2c0c9ed0 0x7fef2c14fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.630 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef31ce7700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c14ef20 con 0x7fef2c0c9ed0 2022-09-20T20:08:37.631 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef31ce7700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c150310 con 0x7fef2c06f7d0 2022-09-20T20:08:37.631 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef31ce7700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef2c1505f0 con 0x7fef2c06fba0 2022-09-20T20:08:37.631 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef2bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef2c0c9ed0 0x7fef2c14fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.631 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef2bfff700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef2c0c9ed0 0x7fef2c14fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53990/0 (socket says 172.21.15.152:53990) 2022-09-20T20:08:37.631 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef2bfff700 1 -- 172.21.15.152:0/1901758720 learned_addr learned my addr 172.21.15.152:0/1901758720 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:37.632 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef2b7fe700 1 --2- 172.21.15.152:0/1901758720 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef2c06f7d0 0x7fef2c142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.632 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef23fff700 1 --2- 172.21.15.152:0/1901758720 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef2c06fba0 0x7fef2c14f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.632 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef2bfff700 1 -- 172.21.15.152:0/1901758720 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef2c06fba0 msgr2=0x7fef2c14f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:37.632 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef2bfff700 1 --2- 172.21.15.152:0/1901758720 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef2c06fba0 0x7fef2c14f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.633 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef2bfff700 1 -- 172.21.15.152:0/1901758720 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef2c06f7d0 msgr2=0x7fef2c142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:37.633 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef2bfff700 1 --2- 172.21.15.152:0/1901758720 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef2c06f7d0 0x7fef2c142ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.633 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef2bfff700 1 -- 172.21.15.152:0/1901758720 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef1c009550 con 0x7fef2c0c9ed0 2022-09-20T20:08:37.633 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef2bfff700 1 --2- 172.21.15.152:0/1901758720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef2c0c9ed0 0x7fef2c14fcb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fef24007e10 tx=0x7fef2400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:37.633 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef28ff9700 1 -- 172.21.15.152:0/1901758720 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2400de90 con 0x7fef2c0c9ed0 2022-09-20T20:08:37.634 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef28ff9700 1 -- 172.21.15.152:0/1901758720 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2400f040 con 0x7fef2c0c9ed0 2022-09-20T20:08:37.634 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef31ce7700 1 -- 172.21.15.152:0/1901758720 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef2c1508d0 con 0x7fef2c0c9ed0 2022-09-20T20:08:37.634 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef28ff9700 1 -- 172.21.15.152:0/1901758720 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef24003c60 con 0x7fef2c0c9ed0 2022-09-20T20:08:37.634 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.617+0000 7fef31ce7700 1 -- 172.21.15.152:0/1901758720 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef2c150e90 con 0x7fef2c0c9ed0 2022-09-20T20:08:37.635 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.618+0000 7fef31ce7700 1 -- 172.21.15.152:0/1901758720 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2c04da60 con 0x7fef2c0c9ed0 2022-09-20T20:08:37.635 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.618+0000 7fef28ff9700 1 -- 172.21.15.152:0/1901758720 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7fef2401c030 con 0x7fef2c0c9ed0 2022-09-20T20:08:37.635 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.619+0000 7fef28ff9700 1 --2- 172.21.15.152:0/1901758720 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fef10065a50 0x7fef10067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.635 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.619+0000 7fef28ff9700 1 -- 172.21.15.152:0/1901758720 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fef24082710 con 0x7fef2c0c9ed0 2022-09-20T20:08:37.636 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.619+0000 7fef2b7fe700 1 --2- 172.21.15.152:0/1901758720 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fef10065a50 0x7fef10067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.636 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.619+0000 7fef2b7fe700 1 --2- 172.21.15.152:0/1901758720 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fef10065a50 0x7fef10067f00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef1c000c00 tx=0x7fef1c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:37.636 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.623+0000 7fef28ff9700 1 -- 172.21.15.152:0/1901758720 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7fef240508d0 con 0x7fef2c0c9ed0 2022-09-20T20:08:37.804 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.802+0000 7fef31ce7700 1 -- 172.21.15.152:0/1901758720 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fef2c070400 con 0x7fef2c0c9ed0 2022-09-20T20:08:37.804 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.802+0000 7fef28ff9700 1 -- 172.21.15.152:0/1901758720 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fef2401a0a0 con 0x7fef2c0c9ed0 2022-09-20T20:08:37.805 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 8 2022-09-20T20:08:37.806 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.804+0000 7fef31ce7700 1 -- 172.21.15.152:0/1901758720 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fef10065a50 msgr2=0x7fef10067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:37.806 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.804+0000 7fef31ce7700 1 --2- 172.21.15.152:0/1901758720 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fef10065a50 0x7fef10067f00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fef1c000c00 tx=0x7fef1c008030 comp rx=0 tx=0).stop 2022-09-20T20:08:37.807 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.804+0000 7fef31ce7700 1 -- 172.21.15.152:0/1901758720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef2c0c9ed0 msgr2=0x7fef2c14fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:37.807 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.804+0000 7fef31ce7700 1 --2- 172.21.15.152:0/1901758720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef2c0c9ed0 0x7fef2c14fcb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fef24007e10 tx=0x7fef2400d3b0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.807 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.804+0000 7fef31ce7700 1 -- 172.21.15.152:0/1901758720 shutdown_connections 2022-09-20T20:08:37.807 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.804+0000 7fef31ce7700 1 --2- 172.21.15.152:0/1901758720 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fef10065a50 0x7fef10067f00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.808 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.804+0000 7fef31ce7700 1 --2- 172.21.15.152:0/1901758720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fef2c0c9ed0 0x7fef2c14fcb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.808 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.804+0000 7fef31ce7700 1 --2- 172.21.15.152:0/1901758720 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fef2c06f7d0 0x7fef2c142ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.808 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.804+0000 7fef31ce7700 1 --2- 172.21.15.152:0/1901758720 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fef2c06fba0 0x7fef2c14f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.808 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.804+0000 7fef31ce7700 1 -- 172.21.15.152:0/1901758720 >> 172.21.15.152:0/1901758720 conn(0x7fef2c0b04e0 msgr2=0x7fef2c14dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:37.809 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.804+0000 7fef31ce7700 1 -- 172.21.15.152:0/1901758720 shutdown_connections 2022-09-20T20:08:37.809 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.804+0000 7fef31ce7700 1 -- 172.21.15.152:0/1901758720 wait complete. 2022-09-20T20:08:37.818 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-09-20T20:08:37.940 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.939+0000 7fdd67545700 1 Processor -- start 2022-09-20T20:08:37.941 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.939+0000 7fdd67545700 1 -- start start 2022-09-20T20:08:37.948 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd67545700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd600ada20 0x7fdd60068ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.948 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd67545700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd6015cf60 con 0x7fdd600700b0 2022-09-20T20:08:37.949 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd67545700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd600cdbd0 con 0x7fdd60158ee0 2022-09-20T20:08:37.949 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd67545700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6015db00 con 0x7fdd600ada20 2022-09-20T20:08:37.949 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd65ae2700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fdd600700b0 0x7fdd6006d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:34952/0 (socket says 172.21.15.152:34952) 2022-09-20T20:08:37.949 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd65ae2700 1 -- 172.21.15.152:0/1630727893 learned_addr learned my addr 172.21.15.152:0/1630727893 (peer_addr_for_me v1:172.21.15.152:0/0) 2022-09-20T20:08:37.950 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd5ffff700 1 -- 172.21.15.152:0/1630727893 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390620171 0 0) 0x7fdd6015cf60 con 0x7fdd600700b0 2022-09-20T20:08:37.950 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd64ae0700 1 --2- 172.21.15.152:0/1630727893 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd600ada20 0x7fdd60068ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.950 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd5ffff700 1 -- 172.21.15.152:0/1630727893 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd4c0035b0 con 0x7fdd600700b0 2022-09-20T20:08:37.950 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd5ffff700 1 -- 172.21.15.152:0/1630727893 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1333145767 0 0) 0x7fdd4c0035b0 con 0x7fdd600700b0 2022-09-20T20:08:37.951 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd5ffff700 1 -- 172.21.15.152:0/1630727893 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd600ada20 msgr2=0x7fdd60068ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:37.951 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd5ffff700 1 --2- 172.21.15.152:0/1630727893 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd600ada20 0x7fdd60068ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.951 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd5ffff700 1 -- 172.21.15.152:0/1630727893 >> v1:172.21.15.171:6789/0 conn(0x7fdd60158ee0 legacy=0x7fdd6015d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:37.951 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd5ffff700 1 -- 172.21.15.152:0/1630727893 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd600cdeb0 con 0x7fdd600700b0 2022-09-20T20:08:37.952 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd5ffff700 1 -- 172.21.15.152:0/1630727893 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3495984756 0 0) 0x7fdd500019f0 con 0x7fdd600700b0 2022-09-20T20:08:37.952 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd5ffff700 1 -- 172.21.15.152:0/1630727893 >> v1:172.21.15.152:6789/0 conn(0x7fdd600700b0 legacy=0x7fdd6006d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:37.952 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd5ffff700 1 --2- 172.21.15.152:0/1630727893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd4c003a30 0x7fdd4c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.952 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd5ffff700 1 --2- 172.21.15.152:0/1630727893 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd600ada20 0x7fdd4c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.953 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd5ffff700 1 --2- 172.21.15.152:0/1630727893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd4c004d90 0x7fdd4c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.953 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd5ffff700 1 -- 172.21.15.152:0/1630727893 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd6015db00 con 0x7fdd4c003a30 2022-09-20T20:08:37.954 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd5ffff700 1 -- 172.21.15.152:0/1630727893 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c00ba10 con 0x7fdd4c004d90 2022-09-20T20:08:37.954 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd5ffff700 1 -- 172.21.15.152:0/1630727893 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c00bba0 con 0x7fdd600ada20 2022-09-20T20:08:37.954 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd652e1700 1 --2- 172.21.15.152:0/1630727893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd4c003a30 0x7fdd4c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.955 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.940+0000 7fdd65ae2700 1 --2- 172.21.15.152:0/1630727893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd4c004d90 0x7fdd4c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.955 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.941+0000 7fdd64ae0700 1 --2- 172.21.15.152:0/1630727893 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd600ada20 0x7fdd4c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.956 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.941+0000 7fdd652e1700 1 -- 172.21.15.152:0/1630727893 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd600ada20 msgr2=0x7fdd4c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:37.956 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.941+0000 7fdd652e1700 1 --2- 172.21.15.152:0/1630727893 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd600ada20 0x7fdd4c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.957 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.941+0000 7fdd652e1700 1 -- 172.21.15.152:0/1630727893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd4c004d90 msgr2=0x7fdd4c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:37.957 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.941+0000 7fdd652e1700 1 --2- 172.21.15.152:0/1630727893 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd4c004d90 0x7fdd4c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.957 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.941+0000 7fdd652e1700 1 -- 172.21.15.152:0/1630727893 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c0035b0 con 0x7fdd4c003a30 2022-09-20T20:08:37.958 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.941+0000 7fdd652e1700 1 --2- 172.21.15.152:0/1630727893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd4c003a30 0x7fdd4c003e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdd580018d0 tx=0x7fdd4c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca20cb2b35ab78c server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:37.958 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.941+0000 7fdd5ffff700 1 -- 172.21.15.152:0/1630727893 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5800c690 con 0x7fdd4c003a30 2022-09-20T20:08:37.959 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.941+0000 7fdd5ffff700 1 -- 172.21.15.152:0/1630727893 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5800c810 con 0x7fdd4c003a30 2022-09-20T20:08:37.959 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.941+0000 7fdd5ffff700 1 -- 172.21.15.152:0/1630727893 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5800cbc0 con 0x7fdd4c003a30 2022-09-20T20:08:37.960 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.942+0000 7fdd67545700 1 -- 172.21.15.152:0/1630727893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd4c003a30 msgr2=0x7fdd4c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:37.960 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.942+0000 7fdd67545700 1 --2- 172.21.15.152:0/1630727893 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd4c003a30 0x7fdd4c003e00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdd580018d0 tx=0x7fdd4c005880 comp rx=0 tx=0).stop 2022-09-20T20:08:37.960 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.942+0000 7fdd65ae2700 1 -- 172.21.15.152:0/1630727893 reap_dead start 2022-09-20T20:08:37.962 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.942+0000 7fdd67545700 1 -- 172.21.15.152:0/1630727893 shutdown_connections 2022-09-20T20:08:37.962 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.942+0000 7fdd67545700 1 -- 172.21.15.152:0/1630727893 >> 172.21.15.152:0/1630727893 conn(0x7fdd6006c0a0 msgr2=0x7fdd6006c470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:37.963 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.942+0000 7fdd67545700 1 -- 172.21.15.152:0/1630727893 shutdown_connections 2022-09-20T20:08:37.963 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.942+0000 7fdd67545700 1 -- 172.21.15.152:0/1630727893 wait complete. 2022-09-20T20:08:37.964 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.943+0000 7fdd67545700 1 Processor -- start 2022-09-20T20:08:37.964 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.943+0000 7fdd67545700 1 -- start start 2022-09-20T20:08:37.964 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.944+0000 7fdd67545700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4c003a30 0x7fdd600c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.965 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.944+0000 7fdd67545700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd601553e0 0x7fdd6015b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.965 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.944+0000 7fdd67545700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd6015bf00 0x7fdd60157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.965 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.944+0000 7fdd67545700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600c3d90 con 0x7fdd6015bf00 2022-09-20T20:08:37.966 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.944+0000 7fdd67545700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600c4070 con 0x7fdd601553e0 2022-09-20T20:08:37.966 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.944+0000 7fdd67545700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd600c4350 con 0x7fdd4c003a30 2022-09-20T20:08:37.966 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.944+0000 7fdd65ae2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd6015bf00 0x7fdd60157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.966 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.944+0000 7fdd65ae2700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd6015bf00 0x7fdd60157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54018/0 (socket says 172.21.15.152:54018) 2022-09-20T20:08:37.967 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.944+0000 7fdd65ae2700 1 -- 172.21.15.152:0/1007300263 learned_addr learned my addr 172.21.15.152:0/1007300263 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:37.967 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.944+0000 7fdd652e1700 1 --2- 172.21.15.152:0/1007300263 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4c003a30 0x7fdd600c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.967 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.944+0000 7fdd64ae0700 1 --2- 172.21.15.152:0/1007300263 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd601553e0 0x7fdd6015b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.967 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.945+0000 7fdd65ae2700 1 -- 172.21.15.152:0/1007300263 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4c003a30 msgr2=0x7fdd600c4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:37.968 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.945+0000 7fdd65ae2700 1 --2- 172.21.15.152:0/1007300263 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4c003a30 0x7fdd600c4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.968 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.945+0000 7fdd65ae2700 1 -- 172.21.15.152:0/1007300263 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd601553e0 msgr2=0x7fdd6015b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:37.968 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.945+0000 7fdd65ae2700 1 --2- 172.21.15.152:0/1007300263 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd601553e0 0x7fdd6015b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:37.968 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.945+0000 7fdd65ae2700 1 -- 172.21.15.152:0/1007300263 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd600c4630 con 0x7fdd6015bf00 2022-09-20T20:08:37.969 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.945+0000 7fdd65ae2700 1 --2- 172.21.15.152:0/1007300263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd6015bf00 0x7fdd60157b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdd6006ee30 tx=0x7fdd5000a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:37.969 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.945+0000 7fdd5dffb700 1 -- 172.21.15.152:0/1007300263 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5000ae10 con 0x7fdd6015bf00 2022-09-20T20:08:37.969 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.945+0000 7fdd5dffb700 1 -- 172.21.15.152:0/1007300263 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd500133f0 con 0x7fdd6015bf00 2022-09-20T20:08:37.969 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.945+0000 7fdd67545700 1 -- 172.21.15.152:0/1007300263 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd600c4910 con 0x7fdd6015bf00 2022-09-20T20:08:37.970 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.945+0000 7fdd5dffb700 1 -- 172.21.15.152:0/1007300263 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd500137a0 con 0x7fdd6015bf00 2022-09-20T20:08:37.970 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.945+0000 7fdd67545700 1 -- 172.21.15.152:0/1007300263 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd60155850 con 0x7fdd6015bf00 2022-09-20T20:08:37.970 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.946+0000 7fdd67545700 1 -- 172.21.15.152:0/1007300263 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd60068780 con 0x7fdd6015bf00 2022-09-20T20:08:37.970 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.946+0000 7fdd5dffb700 1 -- 172.21.15.152:0/1007300263 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7fdd50023070 con 0x7fdd6015bf00 2022-09-20T20:08:37.970 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.947+0000 7fdd5dffb700 1 --2- 172.21.15.152:0/1007300263 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fdd40065a50 0x7fdd40067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:37.971 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.947+0000 7fdd652e1700 1 --2- 172.21.15.152:0/1007300263 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fdd40065a50 0x7fdd40067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:37.971 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.947+0000 7fdd5dffb700 1 -- 172.21.15.152:0/1007300263 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fdd500831f0 con 0x7fdd6015bf00 2022-09-20T20:08:37.972 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.947+0000 7fdd652e1700 1 --2- 172.21.15.152:0/1007300263 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fdd40065a50 0x7fdd40067f00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdd58014040 tx=0x7fdd58005040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:37.972 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:37.951+0000 7fdd5dffb700 1 -- 172.21.15.152:0/1007300263 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7fdd500513b0 con 0x7fdd6015bf00 2022-09-20T20:08:38.172 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.170+0000 7fdd67545700 1 -- 172.21.15.152:0/1007300263 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd600cbbc0 con 0x7fdd6015bf00 2022-09-20T20:08:38.172 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.170+0000 7fdd5dffb700 1 -- 172.21.15.152:0/1007300263 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3534 (secure 0 0 0) 0x7fdd50017070 con 0x7fdd6015bf00 2022-09-20T20:08:38.173 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:08:38.173 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/628085993","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":628085993},{"type":"v1","addr":"172.21.15.152:6836","nonce":628085993}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6834/3077020131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":3077020131},{"type":"v1","addr":"172.21.15.171:6834","nonce":3077020131}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4303,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/2421629200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":2421629200},{"type":"v1","addr":"172.21.15.171:6835","nonce":2421629200}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":14177,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/4161682422","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":4161682422},{"type":"v1","addr":"172.21.15.152:6837","nonce":4161682422}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2022-09-20T20:08:38.175 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.172+0000 7fdd67545700 1 -- 172.21.15.152:0/1007300263 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fdd40065a50 msgr2=0x7fdd40067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:38.175 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.172+0000 7fdd67545700 1 --2- 172.21.15.152:0/1007300263 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fdd40065a50 0x7fdd40067f00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdd58014040 tx=0x7fdd58005040 comp rx=0 tx=0).stop 2022-09-20T20:08:38.175 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.172+0000 7fdd67545700 1 -- 172.21.15.152:0/1007300263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd6015bf00 msgr2=0x7fdd60157b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:38.176 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.172+0000 7fdd67545700 1 --2- 172.21.15.152:0/1007300263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd6015bf00 0x7fdd60157b10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdd6006ee30 tx=0x7fdd5000a640 comp rx=0 tx=0).stop 2022-09-20T20:08:38.176 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.172+0000 7fdd67545700 1 -- 172.21.15.152:0/1007300263 shutdown_connections 2022-09-20T20:08:38.176 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.172+0000 7fdd67545700 1 --2- 172.21.15.152:0/1007300263 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fdd40065a50 0x7fdd40067f00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.176 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.172+0000 7fdd67545700 1 --2- 172.21.15.152:0/1007300263 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd4c003a30 0x7fdd600c4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.177 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.172+0000 7fdd67545700 1 --2- 172.21.15.152:0/1007300263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdd6015bf00 0x7fdd60157b10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.177 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.172+0000 7fdd67545700 1 --2- 172.21.15.152:0/1007300263 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd601553e0 0x7fdd6015b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.177 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.172+0000 7fdd67545700 1 -- 172.21.15.152:0/1007300263 >> 172.21.15.152:0/1007300263 conn(0x7fdd6006c0a0 msgr2=0x7fdd60070560 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:38.177 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.172+0000 7fdd67545700 1 -- 172.21.15.152:0/1007300263 shutdown_connections 2022-09-20T20:08:38.177 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.172+0000 7fdd67545700 1 -- 172.21.15.152:0/1007300263 wait complete. 2022-09-20T20:08:38.178 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 3 2022-09-20T20:08:38.187 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-09-20T20:08:38.315 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.306+0000 7f794e3bb700 1 Processor -- start 2022-09-20T20:08:38.316 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.306+0000 7f794e3bb700 1 -- start start 2022-09-20T20:08:38.316 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.307+0000 7f794e3bb700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79480b0bb0 0x7f794815f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.316 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.307+0000 7f794e3bb700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f79480cfb50 0x7f794815ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.316 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.307+0000 7f794e3bb700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794815fbb0 con 0x7f794815b640 2022-09-20T20:08:38.317 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.307+0000 7f794e3bb700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794815ec60 con 0x7f79480cfb50 2022-09-20T20:08:38.317 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.307+0000 7f794e3bb700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794815c180 con 0x7f79480b0bb0 2022-09-20T20:08:38.317 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.307+0000 7f794c958700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f79480cfb50 0x7f794815ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.317 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.307+0000 7f794c958700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f79480cfb50 0x7f794815ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54034/0 (socket says 172.21.15.152:54034) 2022-09-20T20:08:38.318 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.307+0000 7f794c958700 1 -- 172.21.15.152:0/1499254362 learned_addr learned my addr 172.21.15.152:0/1499254362 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:38.318 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.307+0000 7f7947fff700 1 --2- 172.21.15.152:0/1499254362 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79480b0bb0 0x7f794815f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.318 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.307+0000 7f794c958700 1 -- 172.21.15.152:0/1499254362 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79480b0bb0 msgr2=0x7f794815f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:38.318 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.307+0000 7f794c958700 1 --2- 172.21.15.152:0/1499254362 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79480b0bb0 0x7f794815f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.319 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.307+0000 7f794c958700 1 -- 172.21.15.152:0/1499254362 >> v1:172.21.15.171:6789/0 conn(0x7f794815b640 legacy=0x7f79480cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:38.319 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.307+0000 7f794c958700 1 -- 172.21.15.152:0/1499254362 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794815c460 con 0x7f79480cfb50 2022-09-20T20:08:38.319 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.307+0000 7f794c958700 1 --2- 172.21.15.152:0/1499254362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79480cfb50 0x7f794815ba90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7940009e50 tx=0x7f794000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1b522d78f57866 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:38.319 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.307+0000 7f7946ffd700 1 -- 172.21.15.152:0/1499254362 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794000e070 con 0x7f79480cfb50 2022-09-20T20:08:38.320 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.307+0000 7f7946ffd700 1 -- 172.21.15.152:0/1499254362 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794000b9c0 con 0x7f79480cfb50 2022-09-20T20:08:38.320 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.307+0000 7f7946ffd700 1 -- 172.21.15.152:0/1499254362 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794000bd70 con 0x7f79480cfb50 2022-09-20T20:08:38.320 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.308+0000 7f794e3bb700 1 -- 172.21.15.152:0/1499254362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79480cfb50 msgr2=0x7f794815ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:38.320 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.308+0000 7f794e3bb700 1 --2- 172.21.15.152:0/1499254362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79480cfb50 0x7f794815ba90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7940009e50 tx=0x7f794000b330 comp rx=0 tx=0).stop 2022-09-20T20:08:38.320 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.308+0000 7f794e3bb700 1 -- 172.21.15.152:0/1499254362 shutdown_connections 2022-09-20T20:08:38.321 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.308+0000 7f794e3bb700 1 --2- 172.21.15.152:0/1499254362 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79480cfb50 0x7f794815ba90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.321 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.308+0000 7f794e3bb700 1 --2- 172.21.15.152:0/1499254362 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79480b0bb0 0x7f794815f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.321 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.308+0000 7f794e3bb700 1 -- 172.21.15.152:0/1499254362 >> 172.21.15.152:0/1499254362 conn(0x7f7948070d30 msgr2=0x7f794809abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:38.321 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.308+0000 7f794e3bb700 1 -- 172.21.15.152:0/1499254362 shutdown_connections 2022-09-20T20:08:38.322 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.308+0000 7f794e3bb700 1 -- 172.21.15.152:0/1499254362 wait complete. 2022-09-20T20:08:38.322 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.309+0000 7f794e3bb700 1 Processor -- start 2022-09-20T20:08:38.322 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.309+0000 7f794e3bb700 1 -- start start 2022-09-20T20:08:38.322 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.310+0000 7f794e3bb700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79480b0bb0 0x7f79481f00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.322 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.310+0000 7f794e3bb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79480cfb50 0x7f7948148a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.323 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.310+0000 7f794e3bb700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f794815b640 0x7f7948148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.323 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.310+0000 7f794e3bb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79481f05e0 con 0x7f79480cfb50 2022-09-20T20:08:38.323 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.310+0000 7f794e3bb700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79481572e0 con 0x7f794815b640 2022-09-20T20:08:38.323 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.310+0000 7f794e3bb700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7948157580 con 0x7f79480b0bb0 2022-09-20T20:08:38.324 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.310+0000 7f79477fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79480cfb50 0x7f7948148a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.324 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.310+0000 7f79477fe700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79480cfb50 0x7f7948148a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54036/0 (socket says 172.21.15.152:54036) 2022-09-20T20:08:38.324 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.310+0000 7f79477fe700 1 -- 172.21.15.152:0/1633042530 learned_addr learned my addr 172.21.15.152:0/1633042530 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:38.324 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.310+0000 7f794c958700 1 --2- 172.21.15.152:0/1633042530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f794815b640 0x7f7948148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.324 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.310+0000 7f7947fff700 1 --2- 172.21.15.152:0/1633042530 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79480b0bb0 0x7f79481f00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.325 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.310+0000 7f79477fe700 1 -- 172.21.15.152:0/1633042530 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79480b0bb0 msgr2=0x7f79481f00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:38.325 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.310+0000 7f79477fe700 1 --2- 172.21.15.152:0/1633042530 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79480b0bb0 0x7f79481f00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.325 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.310+0000 7f79477fe700 1 -- 172.21.15.152:0/1633042530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f794815b640 msgr2=0x7f7948148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:38.325 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.310+0000 7f79477fe700 1 --2- 172.21.15.152:0/1633042530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f794815b640 0x7f7948148fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.326 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.310+0000 7f79477fe700 1 -- 172.21.15.152:0/1633042530 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7940009b30 con 0x7f79480cfb50 2022-09-20T20:08:38.326 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.311+0000 7f79477fe700 1 --2- 172.21.15.152:0/1633042530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79480cfb50 0x7f7948148a80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f793c00c450 tx=0x7f793c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:38.326 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.311+0000 7f7944ff9700 1 -- 172.21.15.152:0/1633042530 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c0052d0 con 0x7f79480cfb50 2022-09-20T20:08:38.326 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.311+0000 7f7944ff9700 1 -- 172.21.15.152:0/1633042530 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c005430 con 0x7f79480cfb50 2022-09-20T20:08:38.326 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.311+0000 7f794e3bb700 1 -- 172.21.15.152:0/1633042530 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7948157860 con 0x7f79480cfb50 2022-09-20T20:08:38.327 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.311+0000 7f7944ff9700 1 -- 172.21.15.152:0/1633042530 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c0038c0 con 0x7f79480cfb50 2022-09-20T20:08:38.327 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.311+0000 7f794e3bb700 1 -- 172.21.15.152:0/1633042530 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79480b75e0 con 0x7f79480cfb50 2022-09-20T20:08:38.327 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.312+0000 7f794e3bb700 1 -- 172.21.15.152:0/1633042530 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7948068780 con 0x7f79480cfb50 2022-09-20T20:08:38.327 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.312+0000 7f7944ff9700 1 -- 172.21.15.152:0/1633042530 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7f793c019030 con 0x7f79480cfb50 2022-09-20T20:08:38.328 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.312+0000 7f7944ff9700 1 --2- 172.21.15.152:0/1633042530 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f7928065a50 0x7f7928067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.328 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.313+0000 7f7944ff9700 1 -- 172.21.15.152:0/1633042530 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f793c081880 con 0x7f79480cfb50 2022-09-20T20:08:38.328 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.313+0000 7f7947fff700 1 --2- 172.21.15.152:0/1633042530 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f7928065a50 0x7f7928067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.328 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.313+0000 7f7947fff700 1 --2- 172.21.15.152:0/1633042530 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f7928065a50 0x7f7928067f00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f79380099d0 tx=0x7f7938008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:38.329 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.317+0000 7f7944ff9700 1 -- 172.21.15.152:0/1633042530 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7f793c04fa40 con 0x7f79480cfb50 2022-09-20T20:08:38.497 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.495+0000 7f794e3bb700 1 -- 172.21.15.152:0/1633042530 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79480697c0 con 0x7f79480cfb50 2022-09-20T20:08:38.499 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.496+0000 7f7944ff9700 1 -- 172.21.15.152:0/1633042530 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13791 (secure 0 0 0) 0x7f793c017090 con 0x7f79480cfb50 2022-09-20T20:08:38.500 INFO:teuthology.orchestra.run.smithi152.stdout: 2022-09-20T20:08:38.500 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":19,"fsid":"065d03fa-a408-48e8-87c7-c58c779882b2","created":"2022-09-20T20:08:16.965173+0000","modified":"2022-09-20T20:08:37.747354+0000","last_up_change":"2022-09-20T20:08:28.204035+0000","last_in_change":"2022-09-20T20:08:19.551690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-09-20T20:08:28.246838+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-09-20T20:08:35.427528+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"c48a8b9b-3648-4172-8ee8-1ff95e1f0452","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":107512},{"type":"v1","addr":"172.21.15.152:6819","nonce":107512}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6821","nonce":107512},{"type":"v1","addr":"172.21.15.152:6824","nonce":107512}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":107512},{"type":"v1","addr":"172.21.15.152:6831","nonce":107512}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":107512},{"type":"v1","addr":"172.21.15.152:6828","nonce":107512}]},"public_addr":"172.21.15.152:6819/107512","cluster_addr":"172.21.15.152:6824/107512","heartbeat_back_addr":"172.21.15.152:6831/107512","heartbeat_front_addr":"172.21.15.152:6828/107512","state":["exists","up"]},{"osd":1,"uuid":"e272de33-f058-41d6-af3a-3031de13004d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":107513},{"type":"v1","addr":"172.21.15.152:6818","nonce":107513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":107513},{"type":"v1","addr":"172.21.15.152:6822","nonce":107513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6827","nonce":107513},{"type":"v1","addr":"172.21.15.152:6829","nonce":107513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6823","nonce":107513},{"type":"v1","addr":"172.21.15.152:6825","nonce":107513}]},"public_addr":"172.21.15.152:6818/107513","cluster_addr":"172.21.15.152:6822/107513","heartbeat_back_addr":"172.21.15.152:6829/107513","heartbeat_front_addr":"172.21.15.152:6825/107513","state":["exists","up"]},{"osd":2,"uuid":"ab49b061-3e6f-4acb-a402-c687d6b71b7b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":107514},{"type":"v1","addr":"172.21.15.152:6809","nonce":107514}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":107514},{"type":"v1","addr":"172.21.15.152:6811","nonce":107514}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6814","nonce":107514},{"type":"v1","addr":"172.21.15.152:6815","nonce":107514}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":107514},{"type":"v1","addr":"172.21.15.152:6813","nonce":107514}]},"public_addr":"172.21.15.152:6809/107514","cluster_addr":"172.21.15.152:6811/107514","heartbeat_back_addr":"172.21.15.152:6815/107514","heartbeat_front_addr":"172.21.15.152:6813/107514","state":["exists","up"]},{"osd":3,"uuid":"465e8685-6b56-4763-9ce8-937508e05d89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":107515},{"type":"v1","addr":"172.21.15.152:6801","nonce":107515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":107515},{"type":"v1","addr":"172.21.15.152:6803","nonce":107515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6806","nonce":107515},{"type":"v1","addr":"172.21.15.152:6807","nonce":107515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":107515},{"type":"v1","addr":"172.21.15.152:6805","nonce":107515}]},"public_addr":"172.21.15.152:6801/107515","cluster_addr":"172.21.15.152:6803/107515","heartbeat_back_addr":"172.21.15.152:6807/107515","heartbeat_front_addr":"172.21.15.152:6805/107515","state":["exists","up"]},{"osd":4,"uuid":"3f460e6a-25ec-4940-ba11-6cc651fca0b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":107736},{"type":"v1","addr":"172.21.15.171:6801","nonce":107736}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":107736},{"type":"v1","addr":"172.21.15.171:6803","nonce":107736}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":107736},{"type":"v1","addr":"172.21.15.171:6807","nonce":107736}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":107736},{"type":"v1","addr":"172.21.15.171:6805","nonce":107736}]},"public_addr":"172.21.15.171:6801/107736","cluster_addr":"172.21.15.171:6803/107736","heartbeat_back_addr":"172.21.15.171:6807/107736","heartbeat_front_addr":"172.21.15.171:6805/107736","state":["exists","up"]},{"osd":5,"uuid":"8adc5c61-c754-4cdf-8eda-b5d20a09bf5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":107737},{"type":"v1","addr":"172.21.15.171:6809","nonce":107737}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":107737},{"type":"v1","addr":"172.21.15.171:6811","nonce":107737}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":107737},{"type":"v1","addr":"172.21.15.171:6815","nonce":107737}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":107737},{"type":"v1","addr":"172.21.15.171:6813","nonce":107737}]},"public_addr":"172.21.15.171:6809/107737","cluster_addr":"172.21.15.171:6811/107737","heartbeat_back_addr":"172.21.15.171:6815/107737","heartbeat_front_addr":"172.21.15.171:6813/107737","state":["exists","up"]},{"osd":6,"uuid":"be0e8f6c-e8df-4488-a8c2-ffd847668001","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":107767},{"type":"v1","addr":"172.21.15.171:6817","nonce":107767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":107767},{"type":"v1","addr":"172.21.15.171:6819","nonce":107767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":107767},{"type":"v1","addr":"172.21.15.171:6823","nonce":107767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":107767},{"type":"v1","addr":"172.21.15.171:6821","nonce":107767}]},"public_addr":"172.21.15.171:6817/107767","cluster_addr":"172.21.15.171:6819/107767","heartbeat_back_addr":"172.21.15.171:6823/107767","heartbeat_front_addr":"172.21.15.171:6821/107767","state":["exists","up"]},{"osd":7,"uuid":"7841c1e5-c5d4-4b08-917e-a6ff8ef0cc02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":107769},{"type":"v1","addr":"172.21.15.171:6825","nonce":107769}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":107769},{"type":"v1","addr":"172.21.15.171:6827","nonce":107769}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":107769},{"type":"v1","addr":"172.21.15.171:6831","nonce":107769}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":107769},{"type":"v1","addr":"172.21.15.171:6829","nonce":107769}]},"public_addr":"172.21.15.171:6825/107769","cluster_addr":"172.21.15.171:6827/107769","heartbeat_back_addr":"172.21.15.171:6831/107769","heartbeat_front_addr":"172.21.15.171:6829/107769","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.710168+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.695513+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.702054+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.661718+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.695237+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.732826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.747499+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2022-09-20T20:08:24.793589+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-09-20T20:08:38.502 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.498+0000 7f794e3bb700 1 -- 172.21.15.152:0/1633042530 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f7928065a50 msgr2=0x7f7928067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:38.502 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.498+0000 7f794e3bb700 1 --2- 172.21.15.152:0/1633042530 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f7928065a50 0x7f7928067f00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f79380099d0 tx=0x7f7938008040 comp rx=0 tx=0).stop 2022-09-20T20:08:38.502 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.498+0000 7f794e3bb700 1 -- 172.21.15.152:0/1633042530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79480cfb50 msgr2=0x7f7948148a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:38.503 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.498+0000 7f794e3bb700 1 --2- 172.21.15.152:0/1633042530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79480cfb50 0x7f7948148a80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f793c00c450 tx=0x7f793c00c760 comp rx=0 tx=0).stop 2022-09-20T20:08:38.503 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.498+0000 7f794e3bb700 1 -- 172.21.15.152:0/1633042530 shutdown_connections 2022-09-20T20:08:38.503 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.498+0000 7f794e3bb700 1 --2- 172.21.15.152:0/1633042530 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7f7928065a50 0x7f7928067f00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.503 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.498+0000 7f794e3bb700 1 --2- 172.21.15.152:0/1633042530 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f79480b0bb0 0x7f79481f00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.504 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.498+0000 7f794e3bb700 1 --2- 172.21.15.152:0/1633042530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f794815b640 0x7f7948148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.504 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.498+0000 7f794e3bb700 1 --2- 172.21.15.152:0/1633042530 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f79480cfb50 0x7f7948148a80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.504 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.498+0000 7f794e3bb700 1 -- 172.21.15.152:0/1633042530 >> 172.21.15.152:0/1633042530 conn(0x7f7948070d30 msgr2=0x7f794806b450 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:38.504 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.498+0000 7f794e3bb700 1 -- 172.21.15.152:0/1633042530 shutdown_connections 2022-09-20T20:08:38.505 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.498+0000 7f794e3bb700 1 -- 172.21.15.152:0/1633042530 wait complete. 2022-09-20T20:08:38.513 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-09-20T20:08:28.246838+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-09-20T20:08:35.427528+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-09-20T20:08:38.513 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-09-20T20:08:38.636 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.634+0000 7ff6e2b97700 1 Processor -- start 2022-09-20T20:08:38.637 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.634+0000 7ff6e2b97700 1 -- start start 2022-09-20T20:08:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.635+0000 7ff6e2b97700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff6dc155af0 0x7ff6dc0c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.643 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.635+0000 7ff6e2b97700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6dc0b09c0 0x7ff6dc0ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.635+0000 7ff6e2b97700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff6dc0cea10 0x7ff6dc0cb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.635+0000 7ff6e2b97700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6dc0cee50 con 0x7ff6dc155af0 2022-09-20T20:08:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.635+0000 7ff6e2b97700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6dc1586e0 con 0x7ff6dc0cea10 2022-09-20T20:08:38.644 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.635+0000 7ff6e2b97700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc1589c0 con 0x7ff6dc0b09c0 2022-09-20T20:08:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.635+0000 7ff6e0933700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff6dc155af0 0x7ff6dc0c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.635+0000 7ff6e0933700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff6dc155af0 0x7ff6dc0c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54044/0 (socket says 172.21.15.152:54044) 2022-09-20T20:08:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.635+0000 7ff6e0933700 1 -- 172.21.15.152:0/1663133834 learned_addr learned my addr 172.21.15.152:0/1663133834 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:38.645 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6e1134700 1 --2- 172.21.15.152:0/1663133834 >> v2:172.21.15.171:3300/0 conn(0x7ff6dc0cea10 0x7ff6dc0cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6dbfff700 1 --2- 172.21.15.152:0/1663133834 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6dc0b09c0 0x7ff6dc0ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6e0933700 1 -- 172.21.15.152:0/1663133834 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6dc0b09c0 msgr2=0x7ff6dc0ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6e0933700 1 --2- 172.21.15.152:0/1663133834 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6dc0b09c0 0x7ff6dc0ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.646 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6e0933700 1 -- 172.21.15.152:0/1663133834 >> v2:172.21.15.171:3300/0 conn(0x7ff6dc0cea10 msgr2=0x7ff6dc0cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6e0933700 1 --2- 172.21.15.152:0/1663133834 >> v2:172.21.15.171:3300/0 conn(0x7ff6dc0cea10 0x7ff6dc0cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6e0933700 1 -- 172.21.15.152:0/1663133834 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6dc158ca0 con 0x7ff6dc155af0 2022-09-20T20:08:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6e1134700 1 --2- 172.21.15.152:0/1663133834 >> v2:172.21.15.171:3300/0 conn(0x7ff6dc0cea10 0x7ff6dc0cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-20T20:08:38.647 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6e0933700 1 --2- 172.21.15.152:0/1663133834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc155af0 0x7ff6dc0c91a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0b44a0 tx=0x7ff6d000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6554cc8daf6dbea server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:38.648 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6db7fe700 1 -- 172.21.15.152:0/1663133834 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d000dd30 con 0x7ff6dc155af0 2022-09-20T20:08:38.648 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6db7fe700 1 -- 172.21.15.152:0/1663133834 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d000de90 con 0x7ff6dc155af0 2022-09-20T20:08:38.648 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6db7fe700 1 -- 172.21.15.152:0/1663133834 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0010690 con 0x7ff6dc155af0 2022-09-20T20:08:38.648 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6e2b97700 1 -- 172.21.15.152:0/1663133834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc155af0 msgr2=0x7ff6dc0c91a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:38.649 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6e2b97700 1 --2- 172.21.15.152:0/1663133834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc155af0 0x7ff6dc0c91a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc0b44a0 tx=0x7ff6d000be70 comp rx=0 tx=0).stop 2022-09-20T20:08:38.649 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6e2b97700 1 -- 172.21.15.152:0/1663133834 shutdown_connections 2022-09-20T20:08:38.649 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6e2b97700 1 --2- 172.21.15.152:0/1663133834 >> v2:172.21.15.171:3300/0 conn(0x7ff6dc0cea10 0x7ff6dc0cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.649 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6e2b97700 1 --2- 172.21.15.152:0/1663133834 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc155af0 0x7ff6dc0c91a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.650 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6e2b97700 1 --2- 172.21.15.152:0/1663133834 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6dc0b09c0 0x7ff6dc0ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.650 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6e2b97700 1 -- 172.21.15.152:0/1663133834 >> 172.21.15.152:0/1663133834 conn(0x7ff6dc069df0 msgr2=0x7ff6dc06a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:38.650 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6e2b97700 1 -- 172.21.15.152:0/1663133834 shutdown_connections 2022-09-20T20:08:38.650 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.636+0000 7ff6e2b97700 1 -- 172.21.15.152:0/1663133834 wait complete. 2022-09-20T20:08:38.651 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.638+0000 7ff6e2b97700 1 Processor -- start 2022-09-20T20:08:38.651 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.638+0000 7ff6e2b97700 1 -- start start 2022-09-20T20:08:38.651 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.638+0000 7ff6e2b97700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc0b09c0 0x7ff6dc14b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.652 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.638+0000 7ff6e2b97700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6dc0cea10 0x7ff6dc1ecab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.652 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.638+0000 7ff6e2b97700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6dc155af0 0x7ff6dc0b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.653 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.638+0000 7ff6e2b97700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc0c37a0 con 0x7ff6dc0b09c0 2022-09-20T20:08:38.653 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.638+0000 7ff6e2b97700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc1ecff0 con 0x7ff6dc155af0 2022-09-20T20:08:38.654 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.638+0000 7ff6e2b97700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc0c4000 con 0x7ff6dc0cea10 2022-09-20T20:08:38.654 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.639+0000 7ff6e0933700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc0b09c0 0x7ff6dc14b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.655 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.639+0000 7ff6e0933700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc0b09c0 0x7ff6dc14b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54050/0 (socket says 172.21.15.152:54050) 2022-09-20T20:08:38.655 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.639+0000 7ff6e0933700 1 -- 172.21.15.152:0/1963994920 learned_addr learned my addr 172.21.15.152:0/1963994920 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:38.656 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.639+0000 7ff6dbfff700 1 --2- 172.21.15.152:0/1963994920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6dc0cea10 0x7ff6dc1ecab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.656 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.639+0000 7ff6e1134700 1 --2- 172.21.15.152:0/1963994920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6dc155af0 0x7ff6dc0b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.656 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.639+0000 7ff6e0933700 1 -- 172.21.15.152:0/1963994920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6dc0cea10 msgr2=0x7ff6dc1ecab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:38.657 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.639+0000 7ff6e0933700 1 --2- 172.21.15.152:0/1963994920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6dc0cea10 0x7ff6dc1ecab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.657 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.639+0000 7ff6e0933700 1 -- 172.21.15.152:0/1963994920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6dc155af0 msgr2=0x7ff6dc0b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:38.658 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.639+0000 7ff6e0933700 1 --2- 172.21.15.152:0/1963994920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6dc155af0 0x7ff6dc0b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.658 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.639+0000 7ff6e0933700 1 -- 172.21.15.152:0/1963994920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d000b7f0 con 0x7ff6dc0b09c0 2022-09-20T20:08:38.658 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.639+0000 7ff6dbfff700 1 --2- 172.21.15.152:0/1963994920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6dc0cea10 0x7ff6dc1ecab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-20T20:08:38.659 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.639+0000 7ff6e0933700 1 --2- 172.21.15.152:0/1963994920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc0b09c0 0x7ff6dc14b7b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000beb0 tx=0x7ff6d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:38.659 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.639+0000 7ff6d97fa700 1 -- 172.21.15.152:0/1963994920 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d001d070 con 0x7ff6dc0b09c0 2022-09-20T20:08:38.660 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.639+0000 7ff6d97fa700 1 -- 172.21.15.152:0/1963994920 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d001e040 con 0x7ff6dc0b09c0 2022-09-20T20:08:38.660 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.639+0000 7ff6e2b97700 1 -- 172.21.15.152:0/1963994920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6dc0c6cf0 con 0x7ff6dc0b09c0 2022-09-20T20:08:38.660 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.639+0000 7ff6d97fa700 1 -- 172.21.15.152:0/1963994920 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0010470 con 0x7ff6dc0b09c0 2022-09-20T20:08:38.661 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.639+0000 7ff6e2b97700 1 -- 172.21.15.152:0/1963994920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6dc0c3c90 con 0x7ff6dc0b09c0 2022-09-20T20:08:38.661 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.640+0000 7ff6e2b97700 1 -- 172.21.15.152:0/1963994920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6dc0c42e0 con 0x7ff6dc0b09c0 2022-09-20T20:08:38.661 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.641+0000 7ff6d97fa700 1 -- 172.21.15.152:0/1963994920 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7ff6d0023460 con 0x7ff6dc0b09c0 2022-09-20T20:08:38.661 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.641+0000 7ff6d97fa700 1 --2- 172.21.15.152:0/1963994920 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7ff6c4065a50 0x7ff6c4067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.662 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.641+0000 7ff6d97fa700 1 -- 172.21.15.152:0/1963994920 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff6d0086260 con 0x7ff6dc0b09c0 2022-09-20T20:08:38.662 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.641+0000 7ff6dbfff700 1 --2- 172.21.15.152:0/1963994920 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7ff6c4065a50 0x7ff6c4067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.662 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.641+0000 7ff6dbfff700 1 --2- 172.21.15.152:0/1963994920 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7ff6c4065a50 0x7ff6c4067f00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009970 tx=0x7ff6c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:38.663 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.645+0000 7ff6d97fa700 1 -- 172.21.15.152:0/1963994920 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7ff6d00543c0 con 0x7ff6dc0b09c0 2022-09-20T20:08:38.825 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.823+0000 7ff6e2b97700 1 -- 172.21.15.152:0/1963994920 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6dc0c3e20 con 0x7ff6dc0b09c0 2022-09-20T20:08:38.826 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.823+0000 7ff6d97fa700 1 -- 172.21.15.152:0/1963994920 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6d00579e0 con 0x7ff6dc0b09c0 2022-09-20T20:08:38.826 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2022-09-20T20:08:38.828 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.825+0000 7ff6e2b97700 1 -- 172.21.15.152:0/1963994920 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7ff6c4065a50 msgr2=0x7ff6c4067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:38.828 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.825+0000 7ff6e2b97700 1 --2- 172.21.15.152:0/1963994920 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7ff6c4065a50 0x7ff6c4067f00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009970 tx=0x7ff6c8008040 comp rx=0 tx=0).stop 2022-09-20T20:08:38.830 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.825+0000 7ff6e2b97700 1 -- 172.21.15.152:0/1963994920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc0b09c0 msgr2=0x7ff6dc14b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:38.831 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.825+0000 7ff6e2b97700 1 --2- 172.21.15.152:0/1963994920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc0b09c0 0x7ff6dc14b7b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000beb0 tx=0x7ff6d0004750 comp rx=0 tx=0).stop 2022-09-20T20:08:38.831 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.825+0000 7ff6e2b97700 1 -- 172.21.15.152:0/1963994920 shutdown_connections 2022-09-20T20:08:38.832 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.825+0000 7ff6e2b97700 1 --2- 172.21.15.152:0/1963994920 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7ff6c4065a50 0x7ff6c4067f00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.832 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.825+0000 7ff6e2b97700 1 --2- 172.21.15.152:0/1963994920 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff6dc155af0 0x7ff6dc0b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.833 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.825+0000 7ff6e2b97700 1 --2- 172.21.15.152:0/1963994920 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6dc0b09c0 0x7ff6dc14b7b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.833 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.825+0000 7ff6e2b97700 1 --2- 172.21.15.152:0/1963994920 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff6dc0cea10 0x7ff6dc1ecab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.834 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.825+0000 7ff6e2b97700 1 -- 172.21.15.152:0/1963994920 >> 172.21.15.152:0/1963994920 conn(0x7ff6dc069df0 msgr2=0x7ff6dc0ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:38.834 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.825+0000 7ff6e2b97700 1 -- 172.21.15.152:0/1963994920 shutdown_connections 2022-09-20T20:08:38.835 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.825+0000 7ff6e2b97700 1 -- 172.21.15.152:0/1963994920 wait complete. 2022-09-20T20:08:38.840 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-09-20T20:08:38.965 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.962+0000 7fe2bfbfb700 1 Processor -- start 2022-09-20T20:08:38.965 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.963+0000 7fe2bfbfb700 1 -- start start 2022-09-20T20:08:38.976 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.963+0000 7fe2bfbfb700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2b8155af0 0x7fe2b80c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.976 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.963+0000 7fe2bfbfb700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe2b80cebe0 0x7fe2b80cb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.977 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.963+0000 7fe2bfbfb700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b81586e0 con 0x7fe2b80b09c0 2022-09-20T20:08:38.977 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.963+0000 7fe2bfbfb700 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b81589c0 con 0x7fe2b80cebe0 2022-09-20T20:08:38.977 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.963+0000 7fe2bfbfb700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b8158ca0 con 0x7fe2b8155af0 2022-09-20T20:08:38.978 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.963+0000 7fe2be198700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe2b80cebe0 0x7fe2b80cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.978 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.963+0000 7fe2be198700 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe2b80cebe0 0x7fe2b80cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54058/0 (socket says 172.21.15.152:54058) 2022-09-20T20:08:38.978 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.963+0000 7fe2be198700 1 -- 172.21.15.152:0/1315965726 learned_addr learned my addr 172.21.15.152:0/1315965726 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:38.979 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.964+0000 7fe2be198700 1 -- 172.21.15.152:0/1315965726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2b8155af0 msgr2=0x7fe2b80c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:38.979 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.964+0000 7fe2bd997700 1 --2- 172.21.15.152:0/1315965726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2b8155af0 0x7fe2b80c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.979 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.964+0000 7fe2be198700 1 --2- 172.21.15.152:0/1315965726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2b8155af0 0x7fe2b80c91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.980 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.964+0000 7fe2be198700 1 -- 172.21.15.152:0/1315965726 >> v1:172.21.15.171:6789/0 conn(0x7fe2b80b09c0 legacy=0x7fe2b80ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:38.980 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.964+0000 7fe2be198700 1 -- 172.21.15.152:0/1315965726 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b8158f80 con 0x7fe2b80cebe0 2022-09-20T20:08:38.980 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.964+0000 7fe2be198700 1 --2- 172.21.15.152:0/1315965726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b80cebe0 0x7fe2b80cb010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000d150 tx=0x7fe2b000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e00036f2dc473c0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:38.980 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.964+0000 7fe2bc995700 1 -- 172.21.15.152:0/1315965726 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0010070 con 0x7fe2b80cebe0 2022-09-20T20:08:38.981 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.964+0000 7fe2bc995700 1 -- 172.21.15.152:0/1315965726 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b000dd80 con 0x7fe2b80cebe0 2022-09-20T20:08:38.981 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.964+0000 7fe2bc995700 1 -- 172.21.15.152:0/1315965726 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b000b310 con 0x7fe2b80cebe0 2022-09-20T20:08:38.981 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.965+0000 7fe2bfbfb700 1 -- 172.21.15.152:0/1315965726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b80cebe0 msgr2=0x7fe2b80cb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:38.981 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.965+0000 7fe2bfbfb700 1 --2- 172.21.15.152:0/1315965726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b80cebe0 0x7fe2b80cb010 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000d150 tx=0x7fe2b000d460 comp rx=0 tx=0).stop 2022-09-20T20:08:38.982 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.965+0000 7fe2bfbfb700 1 -- 172.21.15.152:0/1315965726 shutdown_connections 2022-09-20T20:08:38.982 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.965+0000 7fe2bfbfb700 1 --2- 172.21.15.152:0/1315965726 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b80cebe0 0x7fe2b80cb010 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.982 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.965+0000 7fe2bfbfb700 1 --2- 172.21.15.152:0/1315965726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2b8155af0 0x7fe2b80c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.983 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.965+0000 7fe2bfbfb700 1 -- 172.21.15.152:0/1315965726 >> 172.21.15.152:0/1315965726 conn(0x7fe2b8069df0 msgr2=0x7fe2b806a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:38.983 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.965+0000 7fe2bfbfb700 1 -- 172.21.15.152:0/1315965726 shutdown_connections 2022-09-20T20:08:38.983 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.965+0000 7fe2bfbfb700 1 -- 172.21.15.152:0/1315965726 wait complete. 2022-09-20T20:08:38.983 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.966+0000 7fe2bfbfb700 1 Processor -- start 2022-09-20T20:08:38.984 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.966+0000 7fe2bfbfb700 1 -- start start 2022-09-20T20:08:38.984 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.966+0000 7fe2bfbfb700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2b80b09c0 0x7fe2b80c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.984 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.966+0000 7fe2bfbfb700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2b80cebe0 0x7fe2b8152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.985 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2bfbfb700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b8155af0 0x7fe2b814ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.985 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2bfbfb700 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b8150da0 con 0x7fe2b8155af0 2022-09-20T20:08:38.985 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2bfbfb700 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b80c55b0 con 0x7fe2b80cebe0 2022-09-20T20:08:38.986 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2bfbfb700 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b814ef50 con 0x7fe2b80b09c0 2022-09-20T20:08:38.986 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2be198700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b8155af0 0x7fe2b814ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.987 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2be198700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b8155af0 0x7fe2b814ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:54068/0 (socket says 172.21.15.152:54068) 2022-09-20T20:08:38.987 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2be198700 1 -- 172.21.15.152:0/2319695247 learned_addr learned my addr 172.21.15.152:0/2319695247 (peer_addr_for_me v2:172.21.15.152:0/0) 2022-09-20T20:08:38.987 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2bd997700 1 --2- 172.21.15.152:0/2319695247 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2b80b09c0 0x7fe2b80c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.987 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2bd196700 1 --2- 172.21.15.152:0/2319695247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2b80cebe0 0x7fe2b8152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.988 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2be198700 1 -- 172.21.15.152:0/2319695247 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2b80b09c0 msgr2=0x7fe2b80c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:38.988 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2be198700 1 --2- 172.21.15.152:0/2319695247 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2b80b09c0 0x7fe2b80c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.988 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2be198700 1 -- 172.21.15.152:0/2319695247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2b80cebe0 msgr2=0x7fe2b8152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:38.988 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2be198700 1 --2- 172.21.15.152:0/2319695247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2b80cebe0 0x7fe2b8152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:38.989 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2be198700 1 -- 172.21.15.152:0/2319695247 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b000bd40 con 0x7fe2b8155af0 2022-09-20T20:08:38.989 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2bd196700 1 --2- 172.21.15.152:0/2319695247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2b80cebe0 0x7fe2b8152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-20T20:08:38.989 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2be198700 1 --2- 172.21.15.152:0/2319695247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b8155af0 0x7fe2b814ea10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0004000 tx=0x7fe2b0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:38.990 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2a67fc700 1 -- 172.21.15.152:0/2319695247 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0009a10 con 0x7fe2b8155af0 2022-09-20T20:08:38.990 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2a67fc700 1 -- 172.21.15.152:0/2319695247 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b0009b90 con 0x7fe2b8155af0 2022-09-20T20:08:38.990 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2bfbfb700 1 -- 172.21.15.152:0/2319695247 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b80c57c0 con 0x7fe2b8155af0 2022-09-20T20:08:38.990 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2a67fc700 1 -- 172.21.15.152:0/2319695247 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0004030 con 0x7fe2b8155af0 2022-09-20T20:08:38.991 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.967+0000 7fe2bfbfb700 1 -- 172.21.15.152:0/2319695247 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b80c5d80 con 0x7fe2b8155af0 2022-09-20T20:08:38.991 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.968+0000 7fe2bfbfb700 1 -- 172.21.15.152:0/2319695247 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b8064f60 con 0x7fe2b8155af0 2022-09-20T20:08:38.991 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.969+0000 7fe2a67fc700 1 -- 172.21.15.152:0/2319695247 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) v1 ==== 83910+0+0 (secure 0 0 0) 0x7fe2b0004190 con 0x7fe2b8155af0 2022-09-20T20:08:38.992 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.969+0000 7fe2a67fc700 1 --2- 172.21.15.152:0/2319695247 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fe298065a50 0x7fe298067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:38.992 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.969+0000 7fe2a67fc700 1 -- 172.21.15.152:0/2319695247 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe2b0085ed0 con 0x7fe2b8155af0 2022-09-20T20:08:38.992 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.969+0000 7fe2bd997700 1 --2- 172.21.15.152:0/2319695247 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fe298065a50 0x7fe298067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:38.992 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.969+0000 7fe2bd997700 1 --2- 172.21.15.152:0/2319695247 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fe298065a50 0x7fe298067f00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8006fd0 tx=0x7fe2a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:38.992 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:38.973+0000 7fe2a67fc700 1 -- 172.21.15.152:0/2319695247 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+170563 (secure 0 0 0) 0x7fe2b0054090 con 0x7fe2b8155af0 2022-09-20T20:08:39.150 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.148+0000 7fe2bfbfb700 1 -- 172.21.15.152:0/2319695247 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe2b804da60 con 0x7fe2b8155af0 2022-09-20T20:08:39.151 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.149+0000 7fe2a67fc700 1 -- 172.21.15.152:0/2319695247 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe2b00576b0 con 0x7fe2b8155af0 2022-09-20T20:08:39.151 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 8 2022-09-20T20:08:39.153 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.151+0000 7fe2bfbfb700 1 -- 172.21.15.152:0/2319695247 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fe298065a50 msgr2=0x7fe298067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:39.154 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.151+0000 7fe2bfbfb700 1 --2- 172.21.15.152:0/2319695247 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fe298065a50 0x7fe298067f00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8006fd0 tx=0x7fe2a8008040 comp rx=0 tx=0).stop 2022-09-20T20:08:39.154 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.151+0000 7fe2bfbfb700 1 -- 172.21.15.152:0/2319695247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b8155af0 msgr2=0x7fe2b814ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:39.154 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.151+0000 7fe2bfbfb700 1 --2- 172.21.15.152:0/2319695247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b8155af0 0x7fe2b814ea10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0004000 tx=0x7fe2b0004ad0 comp rx=0 tx=0).stop 2022-09-20T20:08:39.155 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.151+0000 7fe2bfbfb700 1 -- 172.21.15.152:0/2319695247 shutdown_connections 2022-09-20T20:08:39.155 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.151+0000 7fe2bfbfb700 1 --2- 172.21.15.152:0/2319695247 >> [v2:172.21.15.152:6832/107206,v1:172.21.15.152:6833/107206] conn(0x7fe298065a50 0x7fe298067f00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:39.156 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.151+0000 7fe2bfbfb700 1 --2- 172.21.15.152:0/2319695247 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe2b80b09c0 0x7fe2b80c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:39.156 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.151+0000 7fe2bfbfb700 1 --2- 172.21.15.152:0/2319695247 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b8155af0 0x7fe2b814ea10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:39.157 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.151+0000 7fe2bfbfb700 1 --2- 172.21.15.152:0/2319695247 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe2b80cebe0 0x7fe2b8152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:39.157 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.151+0000 7fe2bfbfb700 1 -- 172.21.15.152:0/2319695247 >> 172.21.15.152:0/2319695247 conn(0x7fe2b8069df0 msgr2=0x7fe2b80caf10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:39.157 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.151+0000 7fe2bfbfb700 1 -- 172.21.15.152:0/2319695247 shutdown_connections 2022-09-20T20:08:39.158 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.151+0000 7fe2bfbfb700 1 -- 172.21.15.152:0/2319695247 wait complete. 2022-09-20T20:08:39.165 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-09-20T20:08:39.285 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.283+0000 7fc85caee700 1 Processor -- start 2022-09-20T20:08:39.286 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.283+0000 7fc85caee700 1 -- start start 2022-09-20T20:08:39.289 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.284+0000 7fc85caee700 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc8580cb530 0x7fc858162d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:39.290 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.284+0000 7fc85caee700 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85814f340 con 0x7fc85815c700 2022-09-20T20:08:39.290 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.284+0000 7fc85caee700 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc858158740 con 0x7fc85815bc20 2022-09-20T20:08:39.290 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.284+0000 7fc85caee700 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc858158a20 con 0x7fc8580cb530 2022-09-20T20:08:39.290 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.284+0000 7fc855d9b700 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc85815c700 0x7fc8580cae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:34954/0 (socket says 172.21.15.152:34954) 2022-09-20T20:08:39.291 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.284+0000 7fc855d9b700 1 -- 172.21.15.152:0/4125573562 learned_addr learned my addr 172.21.15.152:0/4125573562 (peer_addr_for_me v1:172.21.15.152:0/0) 2022-09-20T20:08:39.291 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85559a700 1 -- 172.21.15.152:0/4125573562 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150812330 0 0) 0x7fc848001110 con 0x7fc85815c700 2022-09-20T20:08:39.291 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc856d9d700 1 --2- 172.21.15.152:0/4125573562 >> v2:172.21.15.171:3300/0 conn(0x7fc8580cb530 0x7fc858162d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:39.291 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85559a700 1 -- 172.21.15.152:0/4125573562 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc83c0035b0 con 0x7fc85815c700 2022-09-20T20:08:39.292 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85559a700 1 -- 172.21.15.152:0/4125573562 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2627779377 0 0) 0x7fc83c0035b0 con 0x7fc85815c700 2022-09-20T20:08:39.292 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85559a700 1 -- 172.21.15.152:0/4125573562 >> v2:172.21.15.171:3300/0 conn(0x7fc8580cb530 msgr2=0x7fc858162d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:39.292 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85559a700 1 --2- 172.21.15.152:0/4125573562 >> v2:172.21.15.171:3300/0 conn(0x7fc8580cb530 0x7fc858162d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:39.292 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85559a700 1 -- 172.21.15.152:0/4125573562 >> v1:172.21.15.171:6789/0 conn(0x7fc85815bc20 legacy=0x7fc85815bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:39.292 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85559a700 1 -- 172.21.15.152:0/4125573562 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc858158d00 con 0x7fc85815c700 2022-09-20T20:08:39.293 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85559a700 1 -- 172.21.15.152:0/4125573562 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3495984756 0 0) 0x7fc848001800 con 0x7fc85815c700 2022-09-20T20:08:39.293 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85559a700 1 -- 172.21.15.152:0/4125573562 >> v1:172.21.15.152:6789/0 conn(0x7fc85815c700 legacy=0x7fc8580cae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:39.293 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85559a700 1 --2- 172.21.15.152:0/4125573562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc83c003a00 0x7fc83c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:39.293 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85559a700 1 --2- 172.21.15.152:0/4125573562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc83c004850 0x7fc83c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:39.294 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85559a700 1 --2- 172.21.15.152:0/4125573562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc83c005200 0x7fc83c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:39.294 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85559a700 1 -- 172.21.15.152:0/4125573562 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc858158a20 con 0x7fc83c003a00 2022-09-20T20:08:39.294 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85559a700 1 -- 172.21.15.152:0/4125573562 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c00c110 con 0x7fc83c004850 2022-09-20T20:08:39.295 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85559a700 1 -- 172.21.15.152:0/4125573562 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c00c2d0 con 0x7fc83c005200 2022-09-20T20:08:39.295 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85659c700 1 --2- 172.21.15.152:0/4125573562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc83c003a00 0x7fc83c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:39.295 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc855d9b700 1 --2- 172.21.15.152:0/4125573562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc83c004850 0x7fc83c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:39.295 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc856d9d700 1 --2- 172.21.15.152:0/4125573562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc83c005200 0x7fc83c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-09-20T20:08:39.296 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85659c700 1 -- 172.21.15.152:0/4125573562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc83c005200 msgr2=0x7fc83c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:39.296 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85659c700 1 --2- 172.21.15.152:0/4125573562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc83c005200 0x7fc83c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:39.296 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85659c700 1 -- 172.21.15.152:0/4125573562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc83c004850 msgr2=0x7fc83c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-09-20T20:08:39.296 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85659c700 1 --2- 172.21.15.152:0/4125573562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc83c004850 0x7fc83c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:39.296 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85659c700 1 -- 172.21.15.152:0/4125573562 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c0035b0 con 0x7fc83c003a00 2022-09-20T20:08:39.297 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc856d9d700 1 --2- 172.21.15.152:0/4125573562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc83c005200 0x7fc83c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-09-20T20:08:39.297 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc856d9d700 1 -- 172.21.15.152:0/4125573562 reap_dead start 2022-09-20T20:08:39.298 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.285+0000 7fc85659c700 1 --2- 172.21.15.152:0/4125573562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc83c003a00 0x7fc83c003e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0017c0 tx=0x7fc83c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114690e09a8915c4 server_cookie=0 in_seq=0 out_seq=0 2022-09-20T20:08:39.298 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.286+0000 7fc85559a700 1 -- 172.21.15.152:0/4125573562 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0052d0 con 0x7fc83c003a00 2022-09-20T20:08:39.298 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.286+0000 7fc85559a700 1 -- 172.21.15.152:0/4125573562 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c005430 con 0x7fc83c003a00 2022-09-20T20:08:39.298 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.286+0000 7fc85559a700 1 -- 172.21.15.152:0/4125573562 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c0038c0 con 0x7fc83c003a00 2022-09-20T20:08:39.299 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.286+0000 7fc85caee700 1 -- 172.21.15.152:0/4125573562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc83c003a00 msgr2=0x7fc83c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-09-20T20:08:39.299 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.286+0000 7fc85caee700 1 --2- 172.21.15.152:0/4125573562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc83c003a00 0x7fc83c003e10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc84c0017c0 tx=0x7fc83c005880 comp rx=0 tx=0).stop 2022-09-20T20:08:39.299 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.286+0000 7fc85caee700 1 -- 172.21.15.152:0/4125573562 shutdown_connections 2022-09-20T20:08:39.299 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.286+0000 7fc85caee700 1 --2- 172.21.15.152:0/4125573562 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc83c003a00 0x7fc83c003e10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-09-20T20:08:39.300 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.286+0000 7fc85caee700 1 -- 172.21.15.152:0/4125573562 >> 172.21.15.152:0/4125573562 conn(0x7fc85806c0a0 msgr2=0x7fc85806c470 unknown :-1 s=STATE_NONE l=0).mark_down 2022-09-20T20:08:39.300 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.286+0000 7fc85caee700 1 -- 172.21.15.152:0/4125573562 shutdown_connections 2022-09-20T20:08:39.300 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.286+0000 7fc85caee700 1 -- 172.21.15.152:0/4125573562 wait complete. 2022-09-20T20:08:39.300 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.288+0000 7fc85caee700 1 Processor -- start 2022-09-20T20:08:39.301 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.288+0000 7fc85caee700 1 -- start start 2022-09-20T20:08:39.304 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.288+0000 7fc85caee700 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc83c003a00 0x7fc8580b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:39.304 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.288+0000 7fc85caee700 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc8581f4c90 0x7fc858146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-09-20T20:08:39.304 INFO:teuthology.orchestra.run.smithi152.stderr:2022-09-20T20:08:39.288+0000 7fc85caee700 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc858156e90 0x7fc858157310 unknown