2024-03-13T21:03:00.827 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-13T21:03:00.827 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} --name pdonnell-2024-03-13_20:49:58-fs-wip-batrick-testing-20240310.014948-distro-default-smithi --archive /home/teuthworker/archive/pdonnell-2024-03-13_20:49:58-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7599076 --owner scheduled_pdonnell@teuthology --verbose -- /home/teuthworker/archive/pdonnell-2024-03-13_20:49:58-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7599076/orig.config.yaml 2024-03-13T21:03:00.876 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-13T21:03:00.957 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-03-13_20:49:58-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7599076 branch: wip-batrick-testing-20240310.014948 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev} email: pdonnell@redhat.com first_in_suite: false job_id: '7599076' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-03-13_20:49:58-fs-wip-batrick-testing-20240310.014948-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-batrick-testing-20240310.014948 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: d16d1766eb379253122a6acda1cdd17a0b9c3aa3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d16d1766eb379253122a6acda1cdd17a0b9c3aa3 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20240310.014948 sha1: 32d4e26ee101db040501914293e54a3c24a95078 owner: scheduled_pdonnell@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6353 sha1: d16d1766eb379253122a6acda1cdd17a0b9c3aa3 sleep_before_teardown: 0 subset: 383/512 suite: fs suite_branch: wip-batrick-testing-20240310.014948 suite_path: /home/teuthworker/src/github.com_batrick_ceph_32d4e26ee101db040501914293e54a3c24a95078/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 32d4e26ee101db040501914293e54a3c24a95078 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi107.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOZxHcA86ARQd6MPWVKCTPUi0oGlMriafLFoAvI3Pl22si158mDSGLl3Vx045nPTRFc0Ask67FTW8ndsVCpkwP0= smithi195.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCc1sGTqdXRxUtV8KU0dAcVQf0q3mNEx7nEdcJekZ+2lHu4LHLcOEC4PwEBT7xn+h15il8X/B478BiMJB1OqrVs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-13_20:49:58 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-13T21:03:00.958 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_32d4e26ee101db040501914293e54a3c24a95078/qa; will attempt to use it 2024-03-13T21:03:00.958 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_32d4e26ee101db040501914293e54a3c24a95078/qa/tasks 2024-03-13T21:03:00.959 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-13T21:03:00.960 INFO:teuthology.task.internal:Checking packages... 2024-03-13T21:03:00.985 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd16d1766eb379253122a6acda1cdd17a0b9c3aa3' 2024-03-13T21:03:00.985 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-13T21:03:00.985 INFO:teuthology.packaging:ref: None 2024-03-13T21:03:00.985 INFO:teuthology.packaging:tag: None 2024-03-13T21:03:00.985 INFO:teuthology.packaging:branch: wip-batrick-testing-20240310.014948 2024-03-13T21:03:00.985 INFO:teuthology.packaging:sha1: d16d1766eb379253122a6acda1cdd17a0b9c3aa3 2024-03-13T21:03:00.986 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-batrick-testing-20240310.014948 2024-03-13T21:03:01.340 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2040.gd16d1766 2024-03-13T21:03:01.341 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-13T21:03:01.349 INFO:teuthology.task.internal:no buildpackages task found 2024-03-13T21:03:01.349 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-13T21:03:01.357 INFO:teuthology.task.internal:Saving configuration 2024-03-13T21:03:01.373 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-13T21:03:01.381 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-13T21:03:01.404 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi107.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-13_20:49:58-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7599076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-13 20:58:09.062971', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOZxHcA86ARQd6MPWVKCTPUi0oGlMriafLFoAvI3Pl22si158mDSGLl3Vx045nPTRFc0Ask67FTW8ndsVCpkwP0='} 2024-03-13T21:03:01.424 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-13_20:49:58-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7599076', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-13 20:58:09.061428', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCc1sGTqdXRxUtV8KU0dAcVQf0q3mNEx7nEdcJekZ+2lHu4LHLcOEC4PwEBT7xn+h15il8X/B478BiMJB1OqrVs='} 2024-03-13T21:03:01.424 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-13T21:03:01.431 INFO:teuthology.task.internal:roles: ubuntu@smithi107.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-13T21:03:01.432 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-13T21:03:01.432 INFO:teuthology.run_tasks:Running task console_log... 2024-03-13T21:03:01.502 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8722723160>, signals=[15]) 2024-03-13T21:03:01.503 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-13T21:03:01.510 INFO:teuthology.task.internal:Opening connections... 2024-03-13T21:03:01.510 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi107.front.sepia.ceph.com 2024-03-13T21:03:01.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T21:03:01.604 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2024-03-13T21:03:01.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T21:03:01.692 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-13T21:03:01.699 DEBUG:teuthology.orchestra.run.smithi107:> uname -m 2024-03-13T21:03:01.717 INFO:teuthology.orchestra.run.smithi107.stdout:x86_64 2024-03-13T21:03:01.718 DEBUG:teuthology.orchestra.run.smithi107:> cat /etc/os-release 2024-03-13T21:03:01.774 INFO:teuthology.orchestra.run.smithi107.stdout:NAME="CentOS Stream" 2024-03-13T21:03:01.774 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION="9" 2024-03-13T21:03:01.774 INFO:teuthology.orchestra.run.smithi107.stdout:ID="centos" 2024-03-13T21:03:01.774 INFO:teuthology.orchestra.run.smithi107.stdout:ID_LIKE="rhel fedora" 2024-03-13T21:03:01.774 INFO:teuthology.orchestra.run.smithi107.stdout:VERSION_ID="9" 2024-03-13T21:03:01.774 INFO:teuthology.orchestra.run.smithi107.stdout:PLATFORM_ID="platform:el9" 2024-03-13T21:03:01.774 INFO:teuthology.orchestra.run.smithi107.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-13T21:03:01.775 INFO:teuthology.orchestra.run.smithi107.stdout:ANSI_COLOR="0;31" 2024-03-13T21:03:01.775 INFO:teuthology.orchestra.run.smithi107.stdout:LOGO="fedora-logo-icon" 2024-03-13T21:03:01.775 INFO:teuthology.orchestra.run.smithi107.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-13T21:03:01.775 INFO:teuthology.orchestra.run.smithi107.stdout:HOME_URL="https://centos.org/" 2024-03-13T21:03:01.775 INFO:teuthology.orchestra.run.smithi107.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T21:03:01.775 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-13T21:03:01.775 INFO:teuthology.orchestra.run.smithi107.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-13T21:03:01.776 INFO:teuthology.lock.ops:Updating smithi107.front.sepia.ceph.com on lock server 2024-03-13T21:03:01.798 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2024-03-13T21:03:01.815 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2024-03-13T21:03:01.816 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2024-03-13T21:03:01.872 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="CentOS Stream" 2024-03-13T21:03:01.872 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="9" 2024-03-13T21:03:01.872 INFO:teuthology.orchestra.run.smithi195.stdout:ID="centos" 2024-03-13T21:03:01.872 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="rhel fedora" 2024-03-13T21:03:01.872 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="9" 2024-03-13T21:03:01.872 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el9" 2024-03-13T21:03:01.872 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-13T21:03:01.872 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2024-03-13T21:03:01.872 INFO:teuthology.orchestra.run.smithi195.stdout:LOGO="fedora-logo-icon" 2024-03-13T21:03:01.872 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-13T21:03:01.872 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://centos.org/" 2024-03-13T21:03:01.873 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-13T21:03:01.873 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-13T21:03:01.873 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-13T21:03:01.873 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2024-03-13T21:03:01.898 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-13T21:03:01.907 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-13T21:03:01.918 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-13T21:03:01.918 DEBUG:teuthology.orchestra.run.smithi107:> test '!' -e /home/ubuntu/cephtest 2024-03-13T21:03:01.921 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2024-03-13T21:03:01.936 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-13T21:03:01.947 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-13T21:03:01.947 DEBUG:teuthology.orchestra.run.smithi107:> test -z $(ls -A /var/lib/ceph) 2024-03-13T21:03:01.977 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2024-03-13T21:03:02.053 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-13T21:03:02.105 INFO:teuthology.run_tasks:Running task kernel... 2024-03-13T21:03:02.125 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-13T21:03:02.125 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-13T21:03:02.125 DEBUG:teuthology.orchestra.run.smithi107:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-13T21:03:02.125 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-13T21:03:02.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-13T21:03:02.142 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-03-13T21:03:02.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-13T21:03:02.143 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-03-13T21:03:02.199 INFO:teuthology.orchestra.run.smithi195.stdout:5.14.0-361.el9.x86_64 2024-03-13T21:03:02.199 INFO:teuthology.task.kernel:Running kernel on smithi195: 5.14.0-361.el9.x86_64 2024-03-13T21:03:02.199 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum install -y kernel 2024-03-13T21:03:02.200 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-361.el9.x86_64 2024-03-13T21:03:02.200 INFO:teuthology.task.kernel:Running kernel on smithi107: 5.14.0-361.el9.x86_64 2024-03-13T21:03:02.200 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum install -y kernel 2024-03-13T21:03:04.350 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-13T21:03:04.504 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS-9 - AppStream 10 MB/s | 6.7 MB 00:00 2024-03-13T21:03:05.859 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS-9 - BaseOS 5.2 MB/s | 2.0 MB 00:00 2024-03-13T21:03:05.971 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS-9 - BaseOS 5.5 MB/s | 2.0 MB 00:00 2024-03-13T21:03:06.669 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.0 MB 00:00 2024-03-13T21:03:07.103 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-03-13T21:03:10.559 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 6.7 MB/s | 19 MB 00:02 2024-03-13T21:03:16.109 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.1 MB 00:02 2024-03-13T21:03:17.802 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 15 kB 00:00 2024-03-13T21:03:19.012 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-03-13T21:03:23.953 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-03-13T21:03:26.143 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-13T21:03:26.144 INFO:teuthology.orchestra.run.smithi195.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-13T21:03:26.241 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-13T21:03:26.257 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-13T21:03:26.257 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2024-03-13T21:03:26.257 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-13T21:03:26.257 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-03-13T21:03:26.257 INFO:teuthology.orchestra.run.smithi195.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-13T21:03:26.257 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-03-13T21:03:26.257 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-13T21:03:26.257 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-13T21:03:26.257 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-13T21:03:26.258 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:03:26.258 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-03-13T21:03:26.258 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2024-03-13T21:03:26.258 INFO:teuthology.orchestra.run.smithi195.stdout:Install 4 Packages 2024-03-13T21:03:26.258 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:03:26.258 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 100 M 2024-03-13T21:03:26.259 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 123 M 2024-03-13T21:03:26.259 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-03-13T21:03:32.592 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 791 kB/s | 19 MB 00:24 2024-03-13T21:03:34.728 INFO:teuthology.orchestra.run.smithi195.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 729 kB/s | 6.0 MB 00:08 2024-03-13T21:03:36.683 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 9.8 MB/s | 6.1 MB 00:00 2024-03-13T21:03:38.309 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 15 kB 00:00 2024-03-13T21:03:55.176 INFO:teuthology.orchestra.run.smithi195.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 739 kB/s | 21 MB 00:28 2024-03-13T21:04:20.981 INFO:teuthology.orchestra.run.smithi195.stdout:(3/4): kernel-modules-core-5.14.0-427.el9.x86_6 740 kB/s | 33 MB 00:46 2024-03-13T21:04:21.298 INFO:teuthology.orchestra.run.smithi195.stdout:(4/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 732 kB/s | 39 MB 00:54 2024-03-13T21:04:21.298 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-03-13T21:04:21.298 INFO:teuthology.orchestra.run.smithi195.stdout:Total 1.8 MB/s | 100 MB 00:55 2024-03-13T21:04:22.187 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-03-13T21:04:22.547 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-03-13T21:04:22.547 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-03-13T21:04:23.898 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-03-13T21:04:23.899 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-03-13T21:04:26.796 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-03-13T21:04:27.417 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-13T21:04:27.549 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-13T21:04:30.309 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-13T21:04:30.492 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-13T21:04:35.197 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-13T21:04:35.386 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-13T21:04:40.130 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-13T21:05:09.224 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-13T21:05:09.224 INFO:teuthology.orchestra.run.smithi195.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-13T21:05:09.224 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:05:09.308 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-13T21:05:09.773 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-13T21:05:09.773 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-13T21:05:09.773 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-13T21:05:09.773 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-13T21:05:10.217 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-13T21:05:10.217 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:05:10.218 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-03-13T21:05:10.218 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-13T21:05:10.218 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-13T21:05:10.218 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-13T21:05:10.218 INFO:teuthology.orchestra.run.smithi195.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-13T21:05:10.218 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:05:10.218 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-13T21:05:10.710 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2024-03-13T21:05:10.853 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-13T21:05:10.854 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-13T21:05:10.854 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-13T21:05:10.854 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-13T21:05:10.854 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-13T21:05:10.854 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-03-13T21:05:10.854 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi195.front.sepia.ceph.com, path=None, version=distro) 2024-03-13T21:05:10.854 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q kernel | sort -rV | head -n 1 2024-03-13T21:05:10.975 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-13T21:05:10.975 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-13T21:05:10.975 DEBUG:teuthology.orchestra.run.smithi195:> sudo rpm -qi grub2-tools 2024-03-13T21:05:11.008 INFO:teuthology.orchestra.run.smithi195.stdout:Name : grub2-tools 2024-03-13T21:05:11.008 INFO:teuthology.orchestra.run.smithi195.stdout:Epoch : 1 2024-03-13T21:05:11.009 INFO:teuthology.orchestra.run.smithi195.stdout:Version : 2.06 2024-03-13T21:05:11.009 INFO:teuthology.orchestra.run.smithi195.stdout:Release : 68.el9 2024-03-13T21:05:11.009 INFO:teuthology.orchestra.run.smithi195.stdout:Architecture: x86_64 2024-03-13T21:05:11.009 INFO:teuthology.orchestra.run.smithi195.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-13T21:05:11.009 INFO:teuthology.orchestra.run.smithi195.stdout:Group : Unspecified 2024-03-13T21:05:11.009 INFO:teuthology.orchestra.run.smithi195.stdout:Size : 8264254 2024-03-13T21:05:11.009 INFO:teuthology.orchestra.run.smithi195.stdout:License : GPLv3+ 2024-03-13T21:05:11.009 INFO:teuthology.orchestra.run.smithi195.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-13T21:05:11.009 INFO:teuthology.orchestra.run.smithi195.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-13T21:05:11.009 INFO:teuthology.orchestra.run.smithi195.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-13T21:05:11.009 INFO:teuthology.orchestra.run.smithi195.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-13T21:05:11.009 INFO:teuthology.orchestra.run.smithi195.stdout:Packager : builder@centos.org 2024-03-13T21:05:11.009 INFO:teuthology.orchestra.run.smithi195.stdout:Vendor : CentOS 2024-03-13T21:05:11.009 INFO:teuthology.orchestra.run.smithi195.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-13T21:05:11.009 INFO:teuthology.orchestra.run.smithi195.stdout:Summary : Support tools for GRUB. 2024-03-13T21:05:11.010 INFO:teuthology.orchestra.run.smithi195.stdout:Description : 2024-03-13T21:05:11.010 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:05:11.010 INFO:teuthology.orchestra.run.smithi195.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-13T21:05:11.010 INFO:teuthology.orchestra.run.smithi195.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-13T21:05:11.010 INFO:teuthology.orchestra.run.smithi195.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-13T21:05:11.010 INFO:teuthology.orchestra.run.smithi195.stdout:hardware devices. 2024-03-13T21:05:11.010 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:05:11.010 INFO:teuthology.orchestra.run.smithi195.stdout:This subpackage provides tools for support of all platforms. 2024-03-13T21:05:11.011 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-13T21:05:11.011 INFO:teuthology.task.kernel:Updating grub on smithi195 to boot 5.14.0-427.el9.x86_64 2024-03-13T21:05:11.011 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-13T21:05:11.615 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2024-03-13T21:05:13.060 INFO:teuthology.orchestra.run.smithi195.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-13T21:05:13.089 INFO:teuthology.orchestra.run.smithi195.stderr:done 2024-03-13T21:05:13.098 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2024-03-13T21:05:13.114 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.f63CisbEFi 2024-03-13T21:05:13.114 DEBUG:teuthology.orchestra.run.smithi195:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.f63CisbEFi 2024-03-13T21:05:13.183 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.f63CisbEFi 2024-03-13T21:05:13.319 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.f63CisbEFi is 6KB 2024-03-13T21:05:13.368 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.f63CisbEFi 2024-03-13T21:05:13.383 DEBUG:teuthology.orchestra.run.smithi195:> sudo /bin/ls /boot/loader/entries || true 2024-03-13T21:05:13.447 INFO:teuthology.orchestra.run.smithi195.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-13T21:05:13.447 INFO:teuthology.orchestra.run.smithi195.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-13T21:05:13.448 INFO:teuthology.orchestra.run.smithi195.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-13T21:05:13.448 INFO:teuthology.orchestra.run.smithi195.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-13T21:05:13.449 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-13T21:05:13.599 DEBUG:teuthology.orchestra.run.smithi195:> sudo shutdown -r now 2024-03-13T21:05:43.602 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-13T21:05:43.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-03-13T21:05:43.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T21:05:56.984 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 152 kB/s | 21 MB 02:18 2024-03-13T21:06:01.824 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-03-13T21:06:02.142 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2024-03-13T21:06:03.997 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-13T21:06:03.997 INFO:teuthology.orchestra.run.smithi107.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-13T21:06:04.097 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-03-13T21:06:04.104 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-03-13T21:06:04.104 INFO:teuthology.orchestra.run.smithi107.stdout: Package Architecture Version Repository Size 2024-03-13T21:06:04.104 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-03-13T21:06:04.104 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-03-13T21:06:04.104 INFO:teuthology.orchestra.run.smithi107.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-13T21:06:04.104 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-03-13T21:06:04.104 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-13T21:06:04.104 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-13T21:06:04.104 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-13T21:06:04.104 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:06:04.104 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-03-13T21:06:04.104 INFO:teuthology.orchestra.run.smithi107.stdout:================================================================================ 2024-03-13T21:06:04.105 INFO:teuthology.orchestra.run.smithi107.stdout:Install 4 Packages 2024-03-13T21:06:04.105 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:06:04.105 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 100 M 2024-03-13T21:06:04.105 INFO:teuthology.orchestra.run.smithi107.stdout:Installed size: 123 M 2024-03-13T21:06:04.105 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-03-13T21:06:11.143 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-03-13T21:06:11.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T21:06:12.699 INFO:teuthology.orchestra.run.smithi107.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 718 kB/s | 6.0 MB 00:08 2024-03-13T21:06:17.548 INFO:teuthology.orchestra.run.smithi107.stdout:(2/4): kernel-modules-core-5.14.0-427.el9.x86_6 6.9 MB/s | 33 MB 00:04 2024-03-13T21:06:17.748 INFO:teuthology.orchestra.run.smithi107.stdout:(3/4): kernel-core-5.14.0-427.el9.x86_64.rpm 1.5 MB/s | 21 MB 00:13 2024-03-13T21:06:18.740 INFO:teuthology.orchestra.run.smithi107.stdout:(4/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 2.7 MB/s | 39 MB 00:14 2024-03-13T21:06:18.740 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-03-13T21:06:18.740 INFO:teuthology.orchestra.run.smithi107.stdout:Total 6.8 MB/s | 100 MB 00:14 2024-03-13T21:06:19.619 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-03-13T21:06:20.001 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-03-13T21:06:20.001 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-03-13T21:06:21.650 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-03-13T21:06:21.650 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-03-13T21:06:24.368 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-03-13T21:06:25.011 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-13T21:06:25.148 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-13T21:06:27.889 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-13T21:06:28.075 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-13T21:06:33.028 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-13T21:06:33.168 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-13T21:06:37.944 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-13T21:07:07.182 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-13T21:07:07.182 INFO:teuthology.orchestra.run.smithi107.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-13T21:07:07.182 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:07:07.266 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-13T21:07:07.691 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-13T21:07:07.691 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-13T21:07:07.692 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-13T21:07:07.692 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-13T21:07:08.144 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-13T21:07:08.144 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:07:08.144 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-03-13T21:07:08.144 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-13T21:07:08.144 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-13T21:07:08.144 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-13T21:07:08.144 INFO:teuthology.orchestra.run.smithi107.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-13T21:07:08.144 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:07:08.144 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-03-13T21:07:08.650 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-03-13T21:07:08.834 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-13T21:07:08.834 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-13T21:07:08.835 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-13T21:07:08.835 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-13T21:07:08.835 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-13T21:07:08.835 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-13T21:07:08.835 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi107.front.sepia.ceph.com, path=None, version=distro) 2024-03-13T21:07:08.835 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q kernel | sort -rV | head -n 1 2024-03-13T21:07:08.955 INFO:teuthology.orchestra.run.smithi107.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-13T21:07:08.955 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-13T21:07:08.955 DEBUG:teuthology.orchestra.run.smithi107:> sudo rpm -qi grub2-tools 2024-03-13T21:07:08.989 INFO:teuthology.orchestra.run.smithi107.stdout:Name : grub2-tools 2024-03-13T21:07:08.989 INFO:teuthology.orchestra.run.smithi107.stdout:Epoch : 1 2024-03-13T21:07:08.990 INFO:teuthology.orchestra.run.smithi107.stdout:Version : 2.06 2024-03-13T21:07:08.990 INFO:teuthology.orchestra.run.smithi107.stdout:Release : 68.el9 2024-03-13T21:07:08.990 INFO:teuthology.orchestra.run.smithi107.stdout:Architecture: x86_64 2024-03-13T21:07:08.990 INFO:teuthology.orchestra.run.smithi107.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-13T21:07:08.990 INFO:teuthology.orchestra.run.smithi107.stdout:Group : Unspecified 2024-03-13T21:07:08.990 INFO:teuthology.orchestra.run.smithi107.stdout:Size : 8264254 2024-03-13T21:07:08.990 INFO:teuthology.orchestra.run.smithi107.stdout:License : GPLv3+ 2024-03-13T21:07:08.990 INFO:teuthology.orchestra.run.smithi107.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-13T21:07:08.990 INFO:teuthology.orchestra.run.smithi107.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-13T21:07:08.990 INFO:teuthology.orchestra.run.smithi107.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-13T21:07:08.990 INFO:teuthology.orchestra.run.smithi107.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-13T21:07:08.990 INFO:teuthology.orchestra.run.smithi107.stdout:Packager : builder@centos.org 2024-03-13T21:07:08.990 INFO:teuthology.orchestra.run.smithi107.stdout:Vendor : CentOS 2024-03-13T21:07:08.991 INFO:teuthology.orchestra.run.smithi107.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-13T21:07:08.991 INFO:teuthology.orchestra.run.smithi107.stdout:Summary : Support tools for GRUB. 2024-03-13T21:07:08.991 INFO:teuthology.orchestra.run.smithi107.stdout:Description : 2024-03-13T21:07:08.991 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:07:08.991 INFO:teuthology.orchestra.run.smithi107.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-13T21:07:08.991 INFO:teuthology.orchestra.run.smithi107.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-13T21:07:08.991 INFO:teuthology.orchestra.run.smithi107.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-13T21:07:08.991 INFO:teuthology.orchestra.run.smithi107.stdout:hardware devices. 2024-03-13T21:07:08.991 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:07:08.991 INFO:teuthology.orchestra.run.smithi107.stdout:This subpackage provides tools for support of all platforms. 2024-03-13T21:07:08.992 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-13T21:07:08.992 INFO:teuthology.task.kernel:Updating grub on smithi107 to boot 5.14.0-427.el9.x86_64 2024-03-13T21:07:08.993 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-13T21:07:09.616 INFO:teuthology.orchestra.run.smithi107.stderr:Generating grub configuration file ... 2024-03-13T21:07:10.998 INFO:teuthology.orchestra.run.smithi107.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-13T21:07:11.028 INFO:teuthology.orchestra.run.smithi107.stderr:done 2024-03-13T21:07:11.030 DEBUG:teuthology.orchestra.run.smithi107:> mktemp 2024-03-13T21:07:11.045 INFO:teuthology.orchestra.run.smithi107.stdout:/tmp/tmp.W5ciyHdJzv 2024-03-13T21:07:11.046 DEBUG:teuthology.orchestra.run.smithi107:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.W5ciyHdJzv 2024-03-13T21:07:11.114 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0666 /tmp/tmp.W5ciyHdJzv 2024-03-13T21:07:11.146 DEBUG:teuthology.orchestra.remote:timed out 2024-03-13T21:07:11.264 DEBUG:teuthology.orchestra.remote:smithi107:/tmp/tmp.W5ciyHdJzv is 6KB 2024-03-13T21:07:11.313 DEBUG:teuthology.orchestra.run.smithi107:> rm -fr /tmp/tmp.W5ciyHdJzv 2024-03-13T21:07:11.327 DEBUG:teuthology.orchestra.run.smithi107:> sudo /bin/ls /boot/loader/entries || true 2024-03-13T21:07:11.392 INFO:teuthology.orchestra.run.smithi107.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-13T21:07:11.392 INFO:teuthology.orchestra.run.smithi107.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-13T21:07:11.393 INFO:teuthology.orchestra.run.smithi107.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-13T21:07:11.393 INFO:teuthology.orchestra.run.smithi107.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-13T21:07:11.394 DEBUG:teuthology.orchestra.run.smithi107:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-13T21:07:11.547 DEBUG:teuthology.orchestra.run.smithi107:> sudo shutdown -r now 2024-03-13T21:07:23.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-03-13T21:07:23.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T21:07:23.562 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-03-13T21:07:23.969 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-03-13T21:07:23.969 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-427.el9.x86_64"... 2024-03-13T21:07:23.970 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2024-03-13T21:07:23.985 INFO:teuthology.orchestra.run.smithi195.stdout:5.14.0-427.el9.x86_64 2024-03-13T21:07:23.985 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-13T21:07:23.985 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-13T21:07:23.985 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-13T21:07:24.986 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-13T21:07:24.986 DEBUG:teuthology.orchestra.run.smithi195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-13T21:07:25.062 INFO:teuthology.orchestra.run.smithi195.stdout:ttyS1 2024-03-13T21:07:25.096 DEBUG:teuthology.parallel:result is None 2024-03-13T21:07:41.551 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-13T21:07:41.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-03-13T21:07:41.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T21:07:59.902 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-03-13T21:08:08.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-03-13T21:08:08.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T21:08:11.966 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.107 2024-03-13T21:08:23.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-03-13T21:08:23.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T21:09:23.971 DEBUG:teuthology.orchestra.remote:timed out 2024-03-13T21:09:38.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-03-13T21:09:38.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T21:09:39.400 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-03-13T21:09:39.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-03-13T21:09:39.810 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-427.el9.x86_64"... 2024-03-13T21:09:39.810 DEBUG:teuthology.orchestra.run.smithi107:> uname -r 2024-03-13T21:09:39.826 INFO:teuthology.orchestra.run.smithi107.stdout:5.14.0-427.el9.x86_64 2024-03-13T21:09:39.826 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-13T21:09:39.826 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-13T21:09:39.826 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-13T21:09:40.827 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-13T21:09:40.828 DEBUG:teuthology.orchestra.run.smithi107:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-13T21:09:40.887 INFO:teuthology.orchestra.run.smithi107.stdout:ttyS1 2024-03-13T21:09:40.930 DEBUG:teuthology.parallel:result is None 2024-03-13T21:09:40.930 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-13T21:09:40.937 INFO:teuthology.task.internal:Creating test directory... 2024-03-13T21:09:40.938 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-13T21:09:40.940 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-13T21:09:40.958 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-13T21:09:40.965 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-13T21:09:40.971 INFO:teuthology.task.internal:Creating archive directory... 2024-03-13T21:09:40.971 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-13T21:09:40.998 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-13T21:09:41.077 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-13T21:09:41.083 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-13T21:09:41.083 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-13T21:09:41.086 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-13T21:09:41.118 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-13T21:09:41.126 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-13T21:09:41.131 INFO:teuthology.orchestra.run.smithi107.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-13T21:09:41.140 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-13T21:09:41.142 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-13T21:09:41.149 INFO:teuthology.task.internal:Configuring sudo... 2024-03-13T21:09:41.149 DEBUG:teuthology.orchestra.run.smithi107:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-13T21:09:41.175 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-13T21:09:41.212 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-13T21:09:41.221 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-13T21:09:41.222 DEBUG:teuthology.orchestra.run.smithi107:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-13T21:09:41.244 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-13T21:09:41.268 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-13T21:09:41.342 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-13T21:09:41.387 DEBUG:teuthology.orchestra.run.smithi107:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-13T21:09:41.471 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-13T21:09:41.514 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:09:41.514 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-13T21:09:41.580 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-13T21:09:41.626 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-13T21:09:41.680 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-13T21:09:41.765 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-13T21:09:41.809 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:09:41.809 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-13T21:09:41.877 DEBUG:teuthology.orchestra.run.smithi107:> sudo service rsyslog restart 2024-03-13T21:09:41.879 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2024-03-13T21:09:41.919 INFO:teuthology.orchestra.run.smithi107.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-13T21:09:41.973 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-13T21:09:42.407 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-13T21:09:42.416 INFO:teuthology.task.internal:Starting timer... 2024-03-13T21:09:42.416 INFO:teuthology.run_tasks:Running task pcp... 2024-03-13T21:09:42.425 INFO:teuthology.run_tasks:Running task selinux... 2024-03-13T21:09:42.434 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-03-13T21:09:42.434 DEBUG:teuthology.orchestra.run.smithi107:> sudo service auditd rotate 2024-03-13T21:09:42.492 INFO:teuthology.orchestra.run.smithi107.stdout:Rotating logs: 2024-03-13T21:09:42.494 DEBUG:teuthology.orchestra.run.smithi195:> sudo service auditd rotate 2024-03-13T21:09:42.556 INFO:teuthology.orchestra.run.smithi195.stdout:Rotating logs: 2024-03-13T21:09:42.558 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-13T21:09:42.559 DEBUG:teuthology.orchestra.run.smithi107:> /usr/sbin/getenforce 2024-03-13T21:09:42.577 INFO:teuthology.orchestra.run.smithi107.stdout:Permissive 2024-03-13T21:09:42.578 DEBUG:teuthology.orchestra.run.smithi195:> /usr/sbin/getenforce 2024-03-13T21:09:42.602 INFO:teuthology.orchestra.run.smithi195.stdout:Permissive 2024-03-13T21:09:42.602 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi107.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi195.front.sepia.ceph.com': 'permissive'} 2024-03-13T21:09:42.602 DEBUG:teuthology.orchestra.run.smithi107:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-13T21:09:42.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-13T21:09:42.646 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-13T21:09:42.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-13T21:09:42.674 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-13T21:09:42.674 DEBUG:teuthology.orchestra.run.smithi107:> sudo /usr/sbin/setenforce permissive 2024-03-13T21:09:42.721 DEBUG:teuthology.orchestra.run.smithi195:> sudo /usr/sbin/setenforce permissive 2024-03-13T21:09:42.753 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-13T21:09:42.764 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-13T21:09:42.770 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-13T21:09:42.886 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-13T21:09:42.902 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-13T21:09:42.904 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi107.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-13T21:13:54.115 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi107.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2024-03-13T21:13:54.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-03-13T21:13:54.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi107.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T21:13:54.210 DEBUG:teuthology.orchestra.run.smithi107:> true 2024-03-13T21:13:54.286 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi107.front.sepia.ceph.com' 2024-03-13T21:13:54.287 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-03-13T21:13:54.288 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-13T21:13:54.375 DEBUG:teuthology.orchestra.run.smithi195:> true 2024-03-13T21:13:54.462 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2024-03-13T21:13:54.462 INFO:teuthology.run_tasks:Running task clock... 2024-03-13T21:13:54.473 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-13T21:13:54.473 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-13T21:13:54.474 DEBUG:teuthology.orchestra.run.smithi107:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-13T21:13:54.476 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-13T21:13:54.476 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-13T21:13:54.505 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-13T21:13:54.522 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-13T21:13:54.533 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-13T21:13:54.549 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-13T21:13:54.552 INFO:teuthology.orchestra.run.smithi107.stderr:sudo: ntpd: command not found 2024-03-13T21:13:54.565 INFO:teuthology.orchestra.run.smithi107.stdout:506 Cannot talk to daemon 2024-03-13T21:13:54.578 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: ntpd: command not found 2024-03-13T21:13:54.582 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-13T21:13:54.592 INFO:teuthology.orchestra.run.smithi195.stdout:506 Cannot talk to daemon 2024-03-13T21:13:54.598 INFO:teuthology.orchestra.run.smithi107.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-13T21:13:54.609 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-13T21:13:54.624 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-13T21:13:54.651 INFO:teuthology.orchestra.run.smithi107.stderr:bash: line 1: ntpq: command not found 2024-03-13T21:13:54.655 INFO:teuthology.orchestra.run.smithi107.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-13T21:13:54.655 INFO:teuthology.orchestra.run.smithi107.stdout:=============================================================================== 2024-03-13T21:13:54.655 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-13T21:13:54.655 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-13T21:13:54.655 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-13T21:13:54.655 INFO:teuthology.orchestra.run.smithi107.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-13T21:13:54.675 INFO:teuthology.orchestra.run.smithi195.stderr:bash: line 1: ntpq: command not found 2024-03-13T21:13:54.678 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-13T21:13:54.678 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2024-03-13T21:13:54.678 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-13T21:13:54.679 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-13T21:13:54.679 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-13T21:13:54.679 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-13T21:13:54.680 INFO:teuthology.run_tasks:Running task install... 2024-03-13T21:13:54.688 DEBUG:teuthology.task.install:project ceph 2024-03-13T21:13:54.688 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd16d1766eb379253122a6acda1cdd17a0b9c3aa3'}} 2024-03-13T21:13:54.688 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd16d1766eb379253122a6acda1cdd17a0b9c3aa3'} 2024-03-13T21:13:54.688 INFO:teuthology.task.install:Using flavor: default 2024-03-13T21:13:54.693 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-13T21:13:54.694 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-13T21:13:54.694 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd16d1766eb379253122a6acda1cdd17a0b9c3aa3', 'tag': None, 'wait_for_package': False} 2024-03-13T21:13:54.695 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d16d1766eb379253122a6acda1cdd17a0b9c3aa3 2024-03-13T21:13:54.697 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd16d1766eb379253122a6acda1cdd17a0b9c3aa3', 'tag': None, 'wait_for_package': False} 2024-03-13T21:13:54.697 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d16d1766eb379253122a6acda1cdd17a0b9c3aa3 2024-03-13T21:13:54.952 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240310.014948/d16d1766eb379253122a6acda1cdd17a0b9c3aa3/centos/9/flavors/default/ 2024-03-13T21:13:54.952 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2040.gd16d1766 2024-03-13T21:13:54.956 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240310.014948/d16d1766eb379253122a6acda1cdd17a0b9c3aa3/centos/9/flavors/default/ 2024-03-13T21:13:54.956 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2040.gd16d1766 2024-03-13T21:13:55.067 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240310.014948/d16d1766eb379253122a6acda1cdd17a0b9c3aa3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240310.014948/d16d1766eb379253122a6acda1cdd17a0b9c3aa3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240310.014948/d16d1766eb379253122a6acda1cdd17a0b9c3aa3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-13T21:13:55.067 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:13:55.067 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-13T21:13:55.095 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-13T21:13:55.095 DEBUG:teuthology.orchestra.run.smithi107:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d16d1766eb379253122a6acda1cdd17a0b9c3aa3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-13T21:13:55.162 DEBUG:teuthology.orchestra.run.smithi107:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-13T21:13:55.168 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240310.014948/d16d1766eb379253122a6acda1cdd17a0b9c3aa3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240310.014948/d16d1766eb379253122a6acda1cdd17a0b9c3aa3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-batrick-testing-20240310.014948/d16d1766eb379253122a6acda1cdd17a0b9c3aa3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-13T21:13:55.168 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:13:55.168 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-13T21:13:55.197 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-13T21:13:55.198 DEBUG:teuthology.orchestra.run.smithi195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d16d1766eb379253122a6acda1cdd17a0b9c3aa3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-13T21:13:55.242 DEBUG:teuthology.orchestra.run.smithi107:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-13T21:13:55.267 DEBUG:teuthology.orchestra.run.smithi195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-13T21:13:55.308 INFO:teuthology.orchestra.run.smithi107.stdout:check_obsoletes = 1 2024-03-13T21:13:55.310 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum clean all 2024-03-13T21:13:55.348 DEBUG:teuthology.orchestra.run.smithi195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-13T21:13:55.415 INFO:teuthology.orchestra.run.smithi195.stdout:check_obsoletes = 1 2024-03-13T21:13:55.416 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum clean all 2024-03-13T21:13:55.555 INFO:teuthology.orchestra.run.smithi107.stdout:74 files removed 2024-03-13T21:13:55.581 DEBUG:teuthology.orchestra.run.smithi107:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-13T21:13:55.651 INFO:teuthology.orchestra.run.smithi195.stdout:74 files removed 2024-03-13T21:13:55.677 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-13T21:13:56.403 INFO:teuthology.orchestra.run.smithi107.stdout:ceph packages for x86_64 162 kB/s | 82 kB 00:00 2024-03-13T21:13:56.694 INFO:teuthology.orchestra.run.smithi195.stdout:ceph packages for x86_64 117 kB/s | 82 kB 00:00 2024-03-13T21:13:56.854 INFO:teuthology.orchestra.run.smithi107.stdout:ceph noarch packages 25 kB/s | 10 kB 00:00 2024-03-13T21:13:57.286 INFO:teuthology.orchestra.run.smithi195.stdout:ceph noarch packages 19 kB/s | 10 kB 00:00 2024-03-13T21:13:57.429 INFO:teuthology.orchestra.run.smithi107.stdout:ceph source packages 3.5 kB/s | 1.9 kB 00:00 2024-03-13T21:13:57.895 INFO:teuthology.orchestra.run.smithi195.stdout:ceph source packages 3.3 kB/s | 1.9 kB 00:00 2024-03-13T21:13:58.157 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS-9 - AppStream 9.7 MB/s | 6.7 MB 00:00 2024-03-13T21:13:58.705 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS-9 - AppStream 8.7 MB/s | 6.7 MB 00:00 2024-03-13T21:13:59.707 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS-9 - BaseOS 4.6 MB/s | 2.0 MB 00:00 2024-03-13T21:14:00.789 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS-9 - BaseOS 2.1 MB/s | 2.0 MB 00:00 2024-03-13T21:14:01.442 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - BaseOS 5.7 MB/s | 8.0 MB 00:01 2024-03-13T21:14:01.557 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.0 MB 00:00 2024-03-13T21:14:11.322 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - AppStream 2.1 MB/s | 19 MB 00:08 2024-03-13T21:14:11.340 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - AppStream 2.2 MB/s | 19 MB 00:08 2024-03-13T21:14:15.975 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - CRB 5.2 MB/s | 6.1 MB 00:01 2024-03-13T21:14:17.234 INFO:teuthology.orchestra.run.smithi195.stdout:CentOS Stream 9 - Extras packages 120 kB/s | 15 kB 00:00 2024-03-13T21:14:17.424 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - CRB 2.3 MB/s | 6.1 MB 00:02 2024-03-13T21:14:19.001 INFO:teuthology.orchestra.run.smithi107.stdout:CentOS Stream 9 - Extras packages 34 kB/s | 15 kB 00:00 2024-03-13T21:14:19.979 INFO:teuthology.orchestra.run.smithi107.stdout:Extra Packages for Enterprise Linux 24 MB/s | 21 MB 00:00 2024-03-13T21:14:24.976 INFO:teuthology.orchestra.run.smithi107.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-03-13T21:14:27.581 INFO:teuthology.orchestra.run.smithi107.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-13T21:14:27.582 INFO:teuthology.orchestra.run.smithi107.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-13T21:14:27.596 INFO:teuthology.orchestra.run.smithi107.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-13T21:14:27.597 INFO:teuthology.orchestra.run.smithi107.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-13T21:14:27.598 INFO:teuthology.orchestra.run.smithi107.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-13T21:14:27.599 INFO:teuthology.orchestra.run.smithi107.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-13T21:14:27.601 INFO:teuthology.orchestra.run.smithi107.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-13T21:14:27.604 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-13T21:14:27.606 INFO:teuthology.orchestra.run.smithi107.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-13T21:14:27.686 INFO:teuthology.orchestra.run.smithi107.stdout:Dependencies resolved. 2024-03-13T21:14:27.698 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================================ 2024-03-13T21:14:27.698 INFO:teuthology.orchestra.run.smithi107.stdout: Package Arch Version Repository Size 2024-03-13T21:14:27.698 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================================ 2024-03-13T21:14:27.698 INFO:teuthology.orchestra.run.smithi107.stdout:Installing: 2024-03-13T21:14:27.698 INFO:teuthology.orchestra.run.smithi107.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-13T21:14:27.699 INFO:teuthology.orchestra.run.smithi107.stdout: ceph x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 6.6 k 2024-03-13T21:14:27.699 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 5.4 M 2024-03-13T21:14:27.699 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 888 k 2024-03-13T21:14:27.699 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 145 k 2024-03-13T21:14:27.699 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 1.5 M 2024-03-13T21:14:27.699 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 139 k 2024-03-13T21:14:27.699 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 1.8 M 2024-03-13T21:14:27.699 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 7.4 M 2024-03-13T21:14:27.699 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 49 k 2024-03-13T21:14:27.699 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 9.8 M 2024-03-13T21:14:27.699 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 47 M 2024-03-13T21:14:27.699 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 264 k 2024-03-13T21:14:27.699 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 749 k 2024-03-13T21:14:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 221 k 2024-03-13T21:14:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-shell x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 27 k 2024-03-13T21:14:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 18 k 2024-03-13T21:14:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-13T21:14:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-13T21:14:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-13T21:14:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 32 k 2024-03-13T21:14:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2 x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 744 k 2024-03-13T21:14:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 127 k 2024-03-13T21:14:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-13T21:14:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-13T21:14:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-13T21:14:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-13T21:14:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-13T21:14:27.700 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-13T21:14:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 162 k 2024-03-13T21:14:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 320 k 2024-03-13T21:14:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 298 k 2024-03-13T21:14:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 99 k 2024-03-13T21:14:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 85 k 2024-03-13T21:14:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 3.1 M 2024-03-13T21:14:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 170 k 2024-03-13T21:14:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-13T21:14:27.701 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrading: 2024-03-13T21:14:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-13T21:14:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-13T21:14:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-13T21:14:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-13T21:14:27.701 INFO:teuthology.orchestra.run.smithi107.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-13T21:14:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-13T21:14:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-13T21:14:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-13T21:14:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-13T21:14:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-13T21:14:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-13T21:14:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-13T21:14:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-13T21:14:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: librados2 x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 3.4 M 2024-03-13T21:14:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1 x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 3.1 M 2024-03-13T21:14:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-13T21:14:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-13T21:14:27.702 INFO:teuthology.orchestra.run.smithi107.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-13T21:14:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-13T21:14:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-13T21:14:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-13T21:14:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-13T21:14:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-13T21:14:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-13T21:14:27.703 INFO:teuthology.orchestra.run.smithi107.stdout:Installing dependencies: 2024-03-13T21:14:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-13T21:14:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-13T21:14:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-13T21:14:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 20 M 2024-03-13T21:14:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 34 k 2024-03-13T21:14:27.703 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 2.2 M 2024-03-13T21:14:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 248 k 2024-03-13T21:14:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 4.7 M 2024-03-13T21:14:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 17 M 2024-03-13T21:14:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 16 k 2024-03-13T21:14:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 25 k 2024-03-13T21:14:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-13T21:14:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-13T21:14:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-13T21:14:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-13T21:14:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-13T21:14:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-13T21:14:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-13T21:14:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-13T21:14:27.704 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-13T21:14:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 163 k 2024-03-13T21:14:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-13T21:14:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-13T21:14:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-13T21:14:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-13T21:14:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-13T21:14:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1 x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 501 k 2024-03-13T21:14:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-13T21:14:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2 x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 5.1 M 2024-03-13T21:14:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-13T21:14:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-13T21:14:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-13T21:14:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-13T21:14:27.705 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-13T21:14:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-13T21:14:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-13T21:14:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-13T21:14:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-13T21:14:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-13T21:14:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-13T21:14:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-13T21:14:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-13T21:14:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-13T21:14:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-13T21:14:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-13T21:14:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-13T21:14:27.706 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-13T21:14:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 45 k 2024-03-13T21:14:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 131 k 2024-03-13T21:14:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-13T21:14:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-13T21:14:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-13T21:14:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-13T21:14:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-13T21:14:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-13T21:14:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-13T21:14:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-13T21:14:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-13T21:14:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-13T21:14:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-13T21:14:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-13T21:14:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-13T21:14:27.707 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-13T21:14:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-13T21:14:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-13T21:14:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-13T21:14:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-13T21:14:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-13T21:14:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-13T21:14:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-13T21:14:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-13T21:14:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-13T21:14:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-13T21:14:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-13T21:14:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-13T21:14:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-13T21:14:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-13T21:14:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-13T21:14:27.708 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-13T21:14:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-13T21:14:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-13T21:14:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-13T21:14:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-13T21:14:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-13T21:14:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-13T21:14:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-13T21:14:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-13T21:14:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-13T21:14:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-13T21:14:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-13T21:14:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-13T21:14:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-13T21:14:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-13T21:14:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-13T21:14:27.709 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-13T21:14:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-13T21:14:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-13T21:14:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-13T21:14:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-13T21:14:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-13T21:14:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-13T21:14:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-13T21:14:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-13T21:14:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-13T21:14:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-13T21:14:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-13T21:14:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-13T21:14:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-13T21:14:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-13T21:14:27.710 INFO:teuthology.orchestra.run.smithi107.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-13T21:14:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-13T21:14:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-13T21:14:27.711 INFO:teuthology.orchestra.run.smithi107.stdout:Installing weak dependencies: 2024-03-13T21:14:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-13T21:14:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:14:27.711 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction Summary 2024-03-13T21:14:27.711 INFO:teuthology.orchestra.run.smithi107.stdout:============================================================================================ 2024-03-13T21:14:27.711 INFO:teuthology.orchestra.run.smithi107.stdout:Install 150 Packages 2024-03-13T21:14:27.711 INFO:teuthology.orchestra.run.smithi107.stdout:Upgrade 24 Packages 2024-03-13T21:14:27.711 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:14:27.712 INFO:teuthology.orchestra.run.smithi107.stdout:Total download size: 224 M 2024-03-13T21:14:27.712 INFO:teuthology.orchestra.run.smithi107.stdout:Downloading Packages: 2024-03-13T21:14:28.618 INFO:teuthology.orchestra.run.smithi107.stdout:(1/174): ceph-19.0.0-2040.gd16d1766.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-03-13T21:14:28.835 INFO:teuthology.orchestra.run.smithi107.stdout:(2/174): ceph-fuse-19.0.0-2040.gd16d1766.el9.x8 4.0 MB/s | 888 kB 00:00 2024-03-13T21:14:28.894 INFO:teuthology.orchestra.run.smithi107.stdout:(3/174): ceph-immutable-object-cache-19.0.0-204 2.4 MB/s | 145 kB 00:00 2024-03-13T21:14:29.219 INFO:teuthology.orchestra.run.smithi107.stdout:(4/174): ceph-mds-19.0.0-2040.gd16d1766.el9.x86 6.7 MB/s | 2.2 MB 00:00 2024-03-13T21:14:29.302 INFO:teuthology.orchestra.run.smithi107.stdout:(5/174): ceph-base-19.0.0-2040.gd16d1766.el9.x8 6.3 MB/s | 5.4 MB 00:00 2024-03-13T21:14:29.478 INFO:teuthology.orchestra.run.smithi107.stdout:(6/174): ceph-mgr-19.0.0-2040.gd16d1766.el9.x86 5.8 MB/s | 1.5 MB 00:00 2024-03-13T21:14:29.836 INFO:teuthology.orchestra.run.smithi107.stdout:(7/174): ceph-mon-19.0.0-2040.gd16d1766.el9.x86 8.8 MB/s | 4.7 MB 00:00 2024-03-13T21:14:30.686 INFO:teuthology.orchestra.run.smithi107.stdout:(8/174): ceph-common-19.0.0-2040.gd16d1766.el9. 9.0 MB/s | 20 MB 00:02 2024-03-13T21:14:30.745 INFO:teuthology.orchestra.run.smithi107.stdout:(9/174): ceph-selinux-19.0.0-2040.gd16d1766.el9 434 kB/s | 25 kB 00:00 2024-03-13T21:14:30.912 INFO:teuthology.orchestra.run.smithi107.stdout:(10/174): ceph-radosgw-19.0.0-2040.gd16d1766.el 9.1 MB/s | 9.8 MB 00:01 2024-03-13T21:14:30.987 INFO:teuthology.orchestra.run.smithi107.stdout:(11/174): cephfs-mirror-19.0.0-2040.gd16d1766.e 2.9 MB/s | 221 kB 00:00 2024-03-13T21:14:31.054 INFO:teuthology.orchestra.run.smithi107.stdout:(12/174): cephfs-shell-19.0.0-2040.gd16d1766.el 405 kB/s | 27 kB 00:00 2024-03-13T21:14:31.121 INFO:teuthology.orchestra.run.smithi107.stdout:(13/174): libcephfs-devel-19.0.0-2040.gd16d1766 475 kB/s | 32 kB 00:00 2024-03-13T21:14:31.288 INFO:teuthology.orchestra.run.smithi107.stdout:(14/174): libcephfs2-19.0.0-2040.gd16d1766.el9. 4.4 MB/s | 744 kB 00:00 2024-03-13T21:14:31.363 INFO:teuthology.orchestra.run.smithi107.stdout:(15/174): libcephsqlite-19.0.0-2040.gd16d1766.e 2.1 MB/s | 163 kB 00:00 2024-03-13T21:14:31.539 INFO:teuthology.orchestra.run.smithi107.stdout:(16/174): ceph-osd-19.0.0-2040.gd16d1766.el9.x8 8.2 MB/s | 17 MB 00:02 2024-03-13T21:14:31.564 INFO:teuthology.orchestra.run.smithi107.stdout:(17/174): librados-devel-19.0.0-2040.gd16d1766. 633 kB/s | 127 kB 00:00 2024-03-13T21:14:31.614 INFO:teuthology.orchestra.run.smithi107.stdout:(18/174): libradosstriper1-19.0.0-2040.gd16d176 6.5 MB/s | 501 kB 00:00 2024-03-13T21:14:31.681 INFO:teuthology.orchestra.run.smithi107.stdout:(19/174): python3-ceph-argparse-19.0.0-2040.gd1 680 kB/s | 45 kB 00:00 2024-03-13T21:14:31.748 INFO:teuthology.orchestra.run.smithi107.stdout:(20/174): python3-ceph-common-19.0.0-2040.gd16d 1.9 MB/s | 131 kB 00:00 2024-03-13T21:14:31.823 INFO:teuthology.orchestra.run.smithi107.stdout:(21/174): python3-cephfs-19.0.0-2040.gd16d1766. 2.1 MB/s | 162 kB 00:00 2024-03-13T21:14:31.907 INFO:teuthology.orchestra.run.smithi107.stdout:(22/174): python3-rados-19.0.0-2040.gd16d1766.e 3.8 MB/s | 320 kB 00:00 2024-03-13T21:14:31.990 INFO:teuthology.orchestra.run.smithi107.stdout:(23/174): python3-rbd-19.0.0-2040.gd16d1766.el9 3.5 MB/s | 298 kB 00:00 2024-03-13T21:14:32.107 INFO:teuthology.orchestra.run.smithi107.stdout:(24/174): librgw2-19.0.0-2040.gd16d1766.el9.x86 9.5 MB/s | 5.1 MB 00:00 2024-03-13T21:14:32.132 INFO:teuthology.orchestra.run.smithi107.stdout:(25/174): python3-rgw-19.0.0-2040.gd16d1766.el9 701 kB/s | 99 kB 00:00 2024-03-13T21:14:32.166 INFO:teuthology.orchestra.run.smithi107.stdout:(26/174): rbd-fuse-19.0.0-2040.gd16d1766.el9.x8 1.4 MB/s | 85 kB 00:00 2024-03-13T21:14:32.233 INFO:teuthology.orchestra.run.smithi107.stdout:(27/174): rbd-nbd-19.0.0-2040.gd16d1766.el9.x86 2.5 MB/s | 170 kB 00:00 2024-03-13T21:14:32.308 INFO:teuthology.orchestra.run.smithi107.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2040.g 453 kB/s | 34 kB 00:00 2024-03-13T21:14:32.375 INFO:teuthology.orchestra.run.smithi107.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2040.gd16d176 2.0 MB/s | 139 kB 00:00 2024-03-13T21:14:32.542 INFO:teuthology.orchestra.run.smithi107.stdout:(30/174): rbd-mirror-19.0.0-2040.gd16d1766.el9. 7.5 MB/s | 3.1 MB 00:00 2024-03-13T21:14:32.603 INFO:teuthology.orchestra.run.smithi107.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2040.gd16d1 7.9 MB/s | 1.8 MB 00:00 2024-03-13T21:14:32.701 INFO:teuthology.orchestra.run.smithi107.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2040.gd1 2.5 MB/s | 248 kB 00:00 2024-03-13T21:14:32.776 INFO:teuthology.orchestra.run.smithi107.stdout:(33/174): ceph-mgr-rook-19.0.0-2040.gd16d1766.e 660 kB/s | 49 kB 00:00 2024-03-13T21:14:32.852 INFO:teuthology.orchestra.run.smithi107.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2040.gd 219 kB/s | 16 kB 00:00 2024-03-13T21:14:32.935 INFO:teuthology.orchestra.run.smithi107.stdout:(35/174): ceph-volume-19.0.0-2040.gd16d1766.el9 3.1 MB/s | 264 kB 00:00 2024-03-13T21:14:33.094 INFO:teuthology.orchestra.run.smithi107.stdout:(36/174): cephadm-19.0.0-2040.gd16d1766.el9.noa 4.6 MB/s | 749 kB 00:00 2024-03-13T21:14:33.169 INFO:teuthology.orchestra.run.smithi107.stdout:(37/174): cephfs-top-19.0.0-2040.gd16d1766.el9. 244 kB/s | 18 kB 00:00 2024-03-13T21:14:33.319 INFO:teuthology.orchestra.run.smithi107.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 4.3 MB/s | 662 kB 00:00 2024-03-13T21:14:33.403 INFO:teuthology.orchestra.run.smithi107.stdout:(39/174): ceph-mgr-diskprediction-local-19.0.0- 8.6 MB/s | 7.4 MB 00:00 2024-03-13T21:14:33.436 INFO:teuthology.orchestra.run.smithi107.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 7.7 MB/s | 920 kB 00:00 2024-03-13T21:14:33.453 INFO:teuthology.orchestra.run.smithi107.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 2.2 MB/s | 106 kB 00:00 2024-03-13T21:14:33.478 INFO:teuthology.orchestra.run.smithi107.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2024-03-13T21:14:33.505 INFO:teuthology.orchestra.run.smithi107.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 637 kB/s | 32 kB 00:00 2024-03-13T21:14:33.563 INFO:teuthology.orchestra.run.smithi107.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 36 MB/s | 3.0 MB 00:00 2024-03-13T21:14:33.588 INFO:teuthology.orchestra.run.smithi107.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 211 kB/s | 17 kB 00:00 2024-03-13T21:14:33.613 INFO:teuthology.orchestra.run.smithi107.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 201 kB/s | 10 kB 00:00 2024-03-13T21:14:33.638 INFO:teuthology.orchestra.run.smithi107.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-03-13T21:14:33.664 INFO:teuthology.orchestra.run.smithi107.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 885 kB/s | 44 kB 00:00 2024-03-13T21:14:33.689 INFO:teuthology.orchestra.run.smithi107.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-03-13T21:14:33.733 INFO:teuthology.orchestra.run.smithi107.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 8.4 MB/s | 578 kB 00:00 2024-03-13T21:14:33.756 INFO:teuthology.orchestra.run.smithi107.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 703 kB/s | 46 kB 00:00 2024-03-13T21:14:33.781 INFO:teuthology.orchestra.run.smithi107.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 282 kB 00:00 2024-03-13T21:14:33.807 INFO:teuthology.orchestra.run.smithi107.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-03-13T21:14:33.824 INFO:teuthology.orchestra.run.smithi107.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.1 MB/s | 217 kB 00:00 2024-03-13T21:14:33.840 INFO:teuthology.orchestra.run.smithi107.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2024-03-13T21:14:34.283 INFO:teuthology.orchestra.run.smithi107.stdout:(56/174): ceph-test-19.0.0-2040.gd16d1766.el9.x 13 MB/s | 47 MB 00:03 2024-03-13T21:14:34.358 INFO:teuthology.orchestra.run.smithi107.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 8.9 MB/s | 4.7 MB 00:00 2024-03-13T21:14:34.400 INFO:teuthology.orchestra.run.smithi107.stdout:(58/174): postgresql-13.11-1.el9.x86_64.rpm 2.7 MB/s | 1.5 MB 00:00 2024-03-13T21:14:34.425 INFO:teuthology.orchestra.run.smithi107.stdout:(59/174): postgresql-contrib-13.11-1.el9.x86_64 5.8 MB/s | 811 kB 00:00 2024-03-13T21:14:34.450 INFO:teuthology.orchestra.run.smithi107.stdout:(60/174): postgresql-private-libs-13.11-1.el9.x 1.5 MB/s | 134 kB 00:00 2024-03-13T21:14:34.517 INFO:teuthology.orchestra.run.smithi107.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-03-13T21:14:34.592 INFO:teuthology.orchestra.run.smithi107.stdout:(62/174): postgresql-server-13.11-1.el9.x86_64. 34 MB/s | 5.7 MB 00:00 2024-03-13T21:14:34.617 INFO:teuthology.orchestra.run.smithi107.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 473 kB/s | 78 kB 00:00 2024-03-13T21:14:34.709 INFO:teuthology.orchestra.run.smithi107.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 5.8 MB 00:00 2024-03-13T21:14:34.734 INFO:teuthology.orchestra.run.smithi107.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 214 kB/s | 24 kB 00:00 2024-03-13T21:14:34.760 INFO:teuthology.orchestra.run.smithi107.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 130 kB/s | 18 kB 00:00 2024-03-13T21:14:34.785 INFO:teuthology.orchestra.run.smithi107.stdout:(67/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-03-13T21:14:34.810 INFO:teuthology.orchestra.run.smithi107.stdout:(68/174): python3-markupsafe-1.1.1-12.el9.x86_6 636 kB/s | 32 kB 00:00 2024-03-13T21:14:34.877 INFO:teuthology.orchestra.run.smithi107.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 41 MB/s | 4.8 MB 00:00 2024-03-13T21:14:34.902 INFO:teuthology.orchestra.run.smithi107.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.9 MB/s | 217 kB 00:00 2024-03-13T21:14:34.927 INFO:teuthology.orchestra.run.smithi107.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 174 kB 00:00 2024-03-13T21:14:34.953 INFO:teuthology.orchestra.run.smithi107.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 920 kB/s | 69 kB 00:00 2024-03-13T21:14:34.978 INFO:teuthology.orchestra.run.smithi107.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 824 kB/s | 41 kB 00:00 2024-03-13T21:14:35.003 INFO:teuthology.orchestra.run.smithi107.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-03-13T21:14:35.020 INFO:teuthology.orchestra.run.smithi107.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2024-03-13T21:14:35.045 INFO:teuthology.orchestra.run.smithi107.stdout:(76/174): python3-pyasn1-modules-0.4.8-6.el9.no 4.9 MB/s | 211 kB 00:00 2024-03-13T21:14:35.070 INFO:teuthology.orchestra.run.smithi107.stdout:(77/174): python3-pytz-2021.1-5.el9.noarch.rpm 710 kB/s | 47 kB 00:00 2024-03-13T21:14:35.104 INFO:teuthology.orchestra.run.smithi107.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 512 kB/s | 43 kB 00:00 2024-03-13T21:14:35.146 INFO:teuthology.orchestra.run.smithi107.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 513 kB/s | 39 kB 00:00 2024-03-13T21:14:35.388 INFO:teuthology.orchestra.run.smithi107.stdout:(80/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 49 MB/s | 16 MB 00:00 2024-03-13T21:14:35.413 INFO:teuthology.orchestra.run.smithi107.stdout:(81/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 134 kB/s | 41 kB 00:00 2024-03-13T21:14:35.439 INFO:teuthology.orchestra.run.smithi107.stdout:(82/174): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 300 kB 00:00 2024-03-13T21:14:35.463 INFO:teuthology.orchestra.run.smithi107.stdout:(83/174): uuid-1.6.2-55.el9.x86_64.rpm 756 kB/s | 56 kB 00:00 2024-03-13T21:14:35.489 INFO:teuthology.orchestra.run.smithi107.stdout:(84/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-03-13T21:14:35.514 INFO:teuthology.orchestra.run.smithi107.stdout:(85/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 588 kB/s | 44 kB 00:00 2024-03-13T21:14:35.539 INFO:teuthology.orchestra.run.smithi107.stdout:(86/174): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-03-13T21:14:35.565 INFO:teuthology.orchestra.run.smithi107.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-13T21:14:35.598 INFO:teuthology.orchestra.run.smithi107.stdout:(88/174): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-03-13T21:14:35.623 INFO:teuthology.orchestra.run.smithi107.stdout:(89/174): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-03-13T21:14:35.648 INFO:teuthology.orchestra.run.smithi107.stdout:(90/174): python3-pycparser-2.20-6.el9.noarch.r 2.4 MB/s | 124 kB 00:00 2024-03-13T21:14:35.674 INFO:teuthology.orchestra.run.smithi107.stdout:(91/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2024-03-13T21:14:35.807 INFO:teuthology.orchestra.run.smithi107.stdout:(92/174): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2024-03-13T21:14:35.832 INFO:teuthology.orchestra.run.smithi107.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-03-13T21:14:35.858 INFO:teuthology.orchestra.run.smithi107.stdout:(94/174): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-03-13T21:14:35.908 INFO:teuthology.orchestra.run.smithi107.stdout:(95/174): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-03-13T21:14:35.933 INFO:teuthology.orchestra.run.smithi107.stdout:(96/174): elfutils-libelf-devel-0.190-2.el9.x86 214 kB/s | 21 kB 00:00 2024-03-13T21:14:35.958 INFO:teuthology.orchestra.run.smithi107.stdout:(97/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 254 kB/s | 25 kB 00:00 2024-03-13T21:14:36.075 INFO:teuthology.orchestra.run.smithi107.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-03-13T21:14:36.101 INFO:teuthology.orchestra.run.smithi107.stdout:(99/174): python3-jinja2-2.11.3-5.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-03-13T21:14:36.126 INFO:teuthology.orchestra.run.smithi107.stdout:(100/174): qatlib-23.11.0-1.el9.x86_64.rpm 4.2 MB/s | 216 kB 00:00 2024-03-13T21:14:36.151 INFO:teuthology.orchestra.run.smithi107.stdout:(101/174): qatlib-service-23.11.0-1.el9.x86_64. 698 kB/s | 35 kB 00:00 2024-03-13T21:14:36.176 INFO:teuthology.orchestra.run.smithi107.stdout:(102/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 885 kB/s | 44 kB 00:00 2024-03-13T21:14:36.202 INFO:teuthology.orchestra.run.smithi107.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-03-13T21:14:36.444 INFO:teuthology.orchestra.run.smithi107.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 84 kB/s | 22 kB 00:00 2024-03-13T21:14:36.827 INFO:teuthology.orchestra.run.smithi107.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 1.3 MB/s | 863 kB 00:00 2024-03-13T21:14:36.952 INFO:teuthology.orchestra.run.smithi107.stdout:(106/174): openssl-devel-3.0.7-27.el9.x86_64.rp 4.0 MB/s | 4.1 MB 00:01 2024-03-13T21:14:37.077 INFO:teuthology.orchestra.run.smithi107.stdout:(107/174): abseil-cpp-20211102.0-3.el9.x86_64.r 865 kB/s | 548 kB 00:00 2024-03-13T21:14:37.194 INFO:teuthology.orchestra.run.smithi107.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 80 kB/s | 19 kB 00:00 2024-03-13T21:14:37.328 INFO:teuthology.orchestra.run.smithi107.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 195 kB/s | 26 kB 00:00 2024-03-13T21:14:37.403 INFO:teuthology.orchestra.run.smithi107.stdout:(110/174): gperftools-libs-2.9.1-2.el9.x86_64.r 537 kB/s | 309 kB 00:00 2024-03-13T21:14:37.487 INFO:teuthology.orchestra.run.smithi107.stdout:(111/174): libarrow-9.0.0-10.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-03-13T21:14:37.520 INFO:teuthology.orchestra.run.smithi107.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 574 kB/s | 67 kB 00:00 2024-03-13T21:14:37.546 INFO:teuthology.orchestra.run.smithi107.stdout:(113/174): liboath-2.6.7-2.el9.x86_64.rpm 223 kB/s | 49 kB 00:00 2024-03-13T21:14:37.579 INFO:teuthology.orchestra.run.smithi107.stdout:(114/174): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-03-13T21:14:37.680 INFO:teuthology.orchestra.run.smithi107.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 434 kB/s | 43 kB 00:00 2024-03-13T21:14:37.763 INFO:teuthology.orchestra.run.smithi107.stdout:(116/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.4 MB/s | 838 kB 00:00 2024-03-13T21:14:37.788 INFO:teuthology.orchestra.run.smithi107.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 297 kB/s | 32 kB 00:00 2024-03-13T21:14:37.855 INFO:teuthology.orchestra.run.smithi107.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 163 kB/s | 15 kB 00:00 2024-03-13T21:14:37.881 INFO:teuthology.orchestra.run.smithi107.stdout:(119/174): python3-asyncssh-2.13.2-4.el9.noarch 1.6 MB/s | 548 kB 00:00 2024-03-13T21:14:37.906 INFO:teuthology.orchestra.run.smithi107.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-03-13T21:14:37.973 INFO:teuthology.orchestra.run.smithi107.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-03-13T21:14:37.990 INFO:teuthology.orchestra.run.smithi107.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 422 kB/s | 35 kB 00:00 2024-03-13T21:14:38.015 INFO:teuthology.orchestra.run.smithi107.stdout:(123/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-03-13T21:14:38.074 INFO:teuthology.orchestra.run.smithi107.stdout:(124/174): python3-google-auth-2.28.0-1.el9.noa 2.0 MB/s | 203 kB 00:00 2024-03-13T21:14:38.124 INFO:teuthology.orchestra.run.smithi107.stdout:(125/174): python3-grpcio-1.46.7-10.el9.x86_64. 15 MB/s | 2.0 MB 00:00 2024-03-13T21:14:38.149 INFO:teuthology.orchestra.run.smithi107.stdout:(126/174): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-03-13T21:14:38.174 INFO:teuthology.orchestra.run.smithi107.stdout:(127/174): python3-jaraco-8.2.1-3.el9.noarch.rp 106 kB/s | 11 kB 00:00 2024-03-13T21:14:38.216 INFO:teuthology.orchestra.run.smithi107.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-03-13T21:14:38.241 INFO:teuthology.orchestra.run.smithi107.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 251 kB/s | 23 kB 00:00 2024-03-13T21:14:38.267 INFO:teuthology.orchestra.run.smithi107.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-03-13T21:14:38.309 INFO:teuthology.orchestra.run.smithi107.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2024-03-13T21:14:38.367 INFO:teuthology.orchestra.run.smithi107.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 463 kB/s | 46 kB 00:00 2024-03-13T21:14:38.401 INFO:teuthology.orchestra.run.smithi107.stdout:(133/174): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-03-13T21:14:38.426 INFO:teuthology.orchestra.run.smithi107.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 673 kB/s | 79 kB 00:00 2024-03-13T21:14:38.468 INFO:teuthology.orchestra.run.smithi107.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 575 kB/s | 58 kB 00:00 2024-03-13T21:14:38.510 INFO:teuthology.orchestra.run.smithi107.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-03-13T21:14:38.535 INFO:teuthology.orchestra.run.smithi107.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2024-03-13T21:14:38.569 INFO:teuthology.orchestra.run.smithi107.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 894 kB/s | 90 kB 00:00 2024-03-13T21:14:38.602 INFO:teuthology.orchestra.run.smithi107.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 307 kB/s | 28 kB 00:00 2024-03-13T21:14:38.628 INFO:teuthology.orchestra.run.smithi107.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-03-13T21:14:38.678 INFO:teuthology.orchestra.run.smithi107.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-03-13T21:14:38.703 INFO:teuthology.orchestra.run.smithi107.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 587 kB/s | 59 kB 00:00 2024-03-13T21:14:38.728 INFO:teuthology.orchestra.run.smithi107.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 356 kB/s | 36 kB 00:00 2024-03-13T21:14:38.778 INFO:teuthology.orchestra.run.smithi107.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 507 kB/s | 51 kB 00:00 2024-03-13T21:14:38.804 INFO:teuthology.orchestra.run.smithi107.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-03-13T21:14:38.829 INFO:teuthology.orchestra.run.smithi107.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 891 kB/s | 90 kB 00:00 2024-03-13T21:14:38.896 INFO:teuthology.orchestra.run.smithi107.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-03-13T21:14:38.921 INFO:teuthology.orchestra.run.smithi107.stdout:(148/174): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-03-13T21:14:38.947 INFO:teuthology.orchestra.run.smithi107.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-03-13T21:14:39.072 INFO:teuthology.orchestra.run.smithi107.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-03-13T21:14:39.114 INFO:teuthology.orchestra.run.smithi107.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 7.6 MB/s | 321 kB 00:00 2024-03-13T21:14:39.314 INFO:teuthology.orchestra.run.smithi107.stdout:(152/174): librbd1-19.0.0-2040.gd16d1766.el9.x8 8.5 MB/s | 3.1 MB 00:00 2024-03-13T21:14:39.381 INFO:teuthology.orchestra.run.smithi107.stdout:(153/174): librados2-19.0.0-2040.gd16d1766.el9. 7.4 MB/s | 3.4 MB 00:00 2024-03-13T21:14:39.473 INFO:teuthology.orchestra.run.smithi107.stdout:(154/174): NetworkManager-1.46.0-1.el9.x86_64.r 6.4 MB/s | 2.3 MB 00:00 2024-03-13T21:14:39.523 INFO:teuthology.orchestra.run.smithi107.stdout:(155/174): NetworkManager-team-1.46.0-1.el9.x86 299 kB/s | 42 kB 00:00 2024-03-13T21:14:39.548 INFO:teuthology.orchestra.run.smithi107.stdout:(156/174): NetworkManager-tui-1.46.0-1.el9.x86_ 3.2 MB/s | 248 kB 00:00 2024-03-13T21:14:39.590 INFO:teuthology.orchestra.run.smithi107.stdout:(157/174): NetworkManager-libnm-1.46.0-1.el9.x8 6.6 MB/s | 1.8 MB 00:00 2024-03-13T21:14:39.615 INFO:teuthology.orchestra.run.smithi107.stdout:(158/174): acl-2.3.1-4.el9.x86_64.rpm 774 kB/s | 71 kB 00:00 2024-03-13T21:14:39.632 INFO:teuthology.orchestra.run.smithi107.stdout:(159/174): elfutils-debuginfod-client-0.190-2.e 436 kB/s | 36 kB 00:00 2024-03-13T21:14:39.658 INFO:teuthology.orchestra.run.smithi107.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-03-13T21:14:39.674 INFO:teuthology.orchestra.run.smithi107.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 550 kB/s | 23 kB 00:00 2024-03-13T21:14:39.700 INFO:teuthology.orchestra.run.smithi107.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.5 MB/s | 108 kB 00:00 2024-03-13T21:14:39.725 INFO:teuthology.orchestra.run.smithi107.stdout:(163/174): elfutils-libs-0.190-2.el9.x86_64.rpm 2.3 MB/s | 256 kB 00:00 2024-03-13T21:14:39.750 INFO:teuthology.orchestra.run.smithi107.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.0 MB/s | 155 kB 00:00 2024-03-13T21:14:39.767 INFO:teuthology.orchestra.run.smithi107.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 64 kB 00:00 2024-03-13T21:14:39.792 INFO:teuthology.orchestra.run.smithi107.stdout:(166/174): libmount-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 136 kB 00:00 2024-03-13T21:14:39.809 INFO:teuthology.orchestra.run.smithi107.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 488 kB/s | 29 kB 00:00 2024-03-13T21:14:39.843 INFO:teuthology.orchestra.run.smithi107.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 16 MB/s | 1.2 MB 00:00 2024-03-13T21:14:39.885 INFO:teuthology.orchestra.run.smithi107.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 23 MB/s | 2.2 MB 00:00 2024-03-13T21:14:39.910 INFO:teuthology.orchestra.run.smithi107.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 6.8 MB/s | 465 kB 00:00 2024-03-13T21:14:39.935 INFO:teuthology.orchestra.run.smithi107.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 622 kB/s | 31 kB 00:00 2024-03-13T21:14:39.994 INFO:teuthology.orchestra.run.smithi107.stdout:(172/174): util-linux-2.37.4-18.el9.x86_64.rpm 12 MB/s | 2.3 MB 00:00 2024-03-13T21:14:40.019 INFO:teuthology.orchestra.run.smithi107.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 892 kB/s | 74 kB 00:00 2024-03-13T21:14:40.053 INFO:teuthology.orchestra.run.smithi107.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 7.5 MB/s | 1.1 MB 00:00 2024-03-13T21:14:40.056 INFO:teuthology.orchestra.run.smithi107.stdout:-------------------------------------------------------------------------------- 2024-03-13T21:14:40.056 INFO:teuthology.orchestra.run.smithi107.stdout:Total 18 MB/s | 224 MB 00:12 2024-03-13T21:14:40.537 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction check 2024-03-13T21:14:40.843 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction check succeeded. 2024-03-13T21:14:40.844 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction test 2024-03-13T21:14:42.826 INFO:teuthology.orchestra.run.smithi107.stdout:Transaction test succeeded. 2024-03-13T21:14:42.826 INFO:teuthology.orchestra.run.smithi107.stdout:Running transaction 2024-03-13T21:14:49.754 INFO:teuthology.orchestra.run.smithi107.stdout: Preparing : 1/1 2024-03-13T21:14:49.875 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-13T21:14:49.916 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-13T21:14:49.996 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-13T21:14:50.038 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-13T21:14:50.213 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-13T21:14:50.267 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-13T21:14:50.307 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-13T21:14:50.349 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-13T21:14:50.407 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-13T21:14:50.742 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-13T21:14:50.800 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librados2-2:19.0.0-2040.gd16d1766.el9.x86_64 10/198 2024-03-13T21:14:50.921 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:19.0.0-2040.gd16d1766.el9.x86_64 10/198 2024-03-13T21:14:50.951 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs2-2:19.0.0-2040.gd16d1766.el9.x86_64 11/198 2024-03-13T21:14:51.042 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephfs2-2:19.0.0-2040.gd16d1766.el9.x86_64 11/198 2024-03-13T21:14:51.078 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rados-2:19.0.0-2040.gd16d1766.el9.x86_64 12/198 2024-03-13T21:14:51.120 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-13T21:14:51.298 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-13T21:14:51.344 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-13T21:14:51.364 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephsqlite-2:19.0.0-2040.gd16d1766.el9.x86_64 16/198 2024-03-13T21:14:51.467 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2040.gd16d1766.el9.x86_64 16/198 2024-03-13T21:14:51.490 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libradosstriper1-2:19.0.0-2040.gd16d1766.el9.x86 17/198 2024-03-13T21:14:51.555 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2040.gd16d1766.el9.x86 17/198 2024-03-13T21:14:51.602 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-13T21:14:51.624 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-13T21:14:51.640 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-13T21:14:51.832 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-13T21:14:51.864 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-13T21:14:51.913 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-13T21:14:52.102 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-13T21:14:52.280 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-13T21:14:52.568 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-13T21:14:52.720 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-13T21:14:52.792 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-13T21:14:53.017 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-13T21:14:53.124 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-13T21:14:53.215 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-13T21:14:53.247 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-13T21:14:53.273 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-13T21:14:53.309 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-13T21:14:53.399 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-13T21:14:53.453 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-13T21:14:53.491 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-13T21:14:53.555 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-13T21:14:53.591 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-13T21:14:53.634 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-13T21:14:53.675 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-13T21:14:53.703 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-13T21:14:53.773 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-13T21:14:53.808 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-common-2:19.0.0-2040.gd16d1766.el9. 39/198 2024-03-13T21:14:53.851 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ceph-argparse-2:19.0.0-2040.gd16d1766.el 40/198 2024-03-13T21:14:53.880 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cephfs-2:19.0.0-2040.gd16d1766.el9.x86_6 41/198 2024-03-13T21:14:53.948 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-13T21:14:53.994 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-13T21:14:54.067 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-13T21:14:54.200 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-13T21:14:54.254 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-13T21:14:54.770 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-13T21:14:54.850 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-13T21:14:54.939 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-13T21:14:54.995 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-13T21:14:55.004 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-13T21:14:55.035 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-13T21:14:55.084 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-13T21:14:55.122 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librados-devel-2:19.0.0-2040.gd16d1766.el9.x86_6 53/198 2024-03-13T21:14:55.152 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-13T21:14:55.648 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-13T21:14:55.838 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-13T21:14:55.912 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-13T21:14:55.955 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-13T21:14:56.103 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-13T21:14:56.150 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-13T21:14:56.205 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-13T21:14:56.278 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-13T21:14:56.309 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-13T21:14:56.346 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-13T21:14:56.392 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-13T21:14:56.437 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-13T21:14:56.480 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-13T21:14:56.521 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-13T21:14:56.655 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-13T21:14:56.702 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-13T21:14:56.732 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-13T21:14:56.774 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-13T21:14:56.876 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-13T21:14:56.907 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-13T21:14:56.947 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-13T21:14:56.973 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-13T21:14:56.997 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-13T21:14:57.101 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-13T21:14:57.222 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-13T21:14:57.329 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-13T21:14:57.372 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-13T21:14:57.420 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-13T21:14:57.476 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-13T21:14:57.659 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-13T21:14:57.709 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-13T21:14:57.838 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-13T21:14:57.882 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 87/198 2024-03-13T21:14:57.916 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-13T21:14:57.947 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-13T21:14:57.975 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-13T21:14:58.018 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-13T21:14:58.057 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-13T21:14:58.089 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-13T21:14:58.119 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-13T21:14:58.194 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-13T21:14:58.229 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-13T21:14:58.263 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-13T21:14:58.304 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-13T21:14:58.339 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-13T21:14:58.427 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-13T21:14:58.518 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-13T21:14:58.561 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-13T21:14:58.593 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-13T21:14:58.632 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-13T21:14:58.729 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-13T21:14:58.778 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-13T21:14:59.495 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-13T21:14:59.542 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-13T21:14:59.573 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-13T21:14:59.621 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-13T21:14:59.700 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-13T21:14:59.732 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-13T21:14:59.917 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-13T21:14:59.939 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-13T21:15:00.016 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-13T21:15:00.660 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-13T21:15:00.778 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-13T21:15:01.979 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-13T21:15:02.057 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-13T21:15:02.088 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-13T21:15:02.119 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-13T21:15:02.147 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-13T21:15:02.458 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-13T21:15:02.485 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : librbd1-2:19.0.0-2040.gd16d1766.el9.x86_64 124/198 2024-03-13T21:15:02.577 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:19.0.0-2040.gd16d1766.el9.x86_64 124/198 2024-03-13T21:15:02.607 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rbd-2:19.0.0-2040.gd16d1766.el9.x86_64 125/198 2024-03-13T21:15:02.643 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-13T21:15:03.092 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-13T21:15:03.122 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : librgw2-2:19.0.0-2040.gd16d1766.el9.x86_64 128/198 2024-03-13T21:15:03.194 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librgw2-2:19.0.0-2040.gd16d1766.el9.x86_64 128/198 2024-03-13T21:15:03.224 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : python3-rgw-2:19.0.0-2040.gd16d1766.el9.x86_64 129/198 2024-03-13T21:15:05.406 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.0.0-2040.gd16d1766.el9.x86_64 130/198 2024-03-13T21:15:05.445 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-common-2:19.0.0-2040.gd16d1766.el9.x86_64 130/198 2024-03-13T21:15:05.982 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-common-2:19.0.0-2040.gd16d1766.el9.x86_64 130/198 2024-03-13T21:15:06.023 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-base-2:19.0.0-2040.gd16d1766.el9.x86_64 131/198 2024-03-13T21:15:06.114 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-base-2:19.0.0-2040.gd16d1766.el9.x86_64 131/198 2024-03-13T21:15:06.114 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-13T21:15:06.114 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-13T21:15:06.114 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:15:06.158 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-selinux-2:19.0.0-2040.gd16d1766.el9.x86_64 132/198 2024-03-13T21:15:18.126 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2040.gd16d1766.el9.x86_64 132/198 2024-03-13T21:15:18.126 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /sys 2024-03-13T21:15:18.126 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /proc 2024-03-13T21:15:18.126 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /mnt 2024-03-13T21:15:18.126 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /var/tmp 2024-03-13T21:15:18.126 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /home 2024-03-13T21:15:18.127 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /root 2024-03-13T21:15:18.127 INFO:teuthology.orchestra.run.smithi107.stdout:skipping the directory /tmp 2024-03-13T21:15:18.127 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:15:18.290 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-volume-2:19.0.0-2040.gd16d1766.el9.noarch 133/198 2024-03-13T21:15:18.306 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-volume-2:19.0.0-2040.gd16d1766.el9.noarch 133/198 2024-03-13T21:15:18.306 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-13T21:15:18.306 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-13T21:15:18.306 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:15:19.802 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-osd-2:19.0.0-2040.gd16d1766.el9.x86_64 134/198 2024-03-13T21:15:19.828 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-osd-2:19.0.0-2040.gd16d1766.el9.x86_64 134/198 2024-03-13T21:15:19.828 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-13T21:15:19.828 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-13T21:15:19.828 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-13T21:15:19.828 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-13T21:15:19.828 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:15:20.036 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mds-2:19.0.0-2040.gd16d1766.el9.x86_64 135/198 2024-03-13T21:15:20.058 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mds-2:19.0.0-2040.gd16d1766.el9.x86_64 135/198 2024-03-13T21:15:20.058 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-13T21:15:20.059 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-13T21:15:20.059 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-13T21:15:20.059 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-13T21:15:20.059 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:15:20.503 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mon-2:19.0.0-2040.gd16d1766.el9.x86_64 136/198 2024-03-13T21:15:20.526 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mon-2:19.0.0-2040.gd16d1766.el9.x86_64 136/198 2024-03-13T21:15:20.526 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-13T21:15:20.526 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-13T21:15:20.526 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-13T21:15:20.526 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-13T21:15:20.526 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:15:20.613 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-13T21:15:21.064 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephadm-2:19.0.0-2040.gd16d1766.el9.noarch 138/198 2024-03-13T21:15:21.095 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephadm-2:19.0.0-2040.gd16d1766.el9.noarch 138/198 2024-03-13T21:15:21.127 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2040.gd16d1766.e 139/198 2024-03-13T21:15:21.196 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2040.gd16d1766. 140/198 2024-03-13T21:15:21.218 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2040.gd16d1766.el9.noa 141/198 2024-03-13T21:15:21.451 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2040.gd16d1766.el9.noa 141/198 2024-03-13T21:15:21.486 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2040.gd16d1766.el9.n 142/198 2024-03-13T21:15:22.445 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2040.gd16d1766.el9.n 142/198 2024-03-13T21:15:22.470 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2040.gd16 143/198 2024-03-13T21:15:22.571 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2040.gd16 143/198 2024-03-13T21:15:22.732 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2040.gd16d1766.el 144/198 2024-03-13T21:15:22.763 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-2:19.0.0-2040.gd16d1766.el9.x86_64 145/198 2024-03-13T21:15:22.787 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2040.gd16d1766.el9.x86_64 145/198 2024-03-13T21:15:22.787 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-13T21:15:22.787 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-13T21:15:22.787 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-13T21:15:22.787 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-13T21:15:22.787 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:15:22.831 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-mgr-rook-2:19.0.0-2040.gd16d1766.el9.noarch 146/198 2024-03-13T21:15:22.842 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2040.gd16d1766.el9.noarch 146/198 2024-03-13T21:15:22.890 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-2:19.0.0-2040.gd16d1766.el9.x86_64 147/198 2024-03-13T21:15:23.778 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-13T21:15:23.808 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-radosgw-2:19.0.0-2040.gd16d1766.el9.x86_64 149/198 2024-03-13T21:15:23.831 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2040.gd16d1766.el9.x86_64 149/198 2024-03-13T21:15:23.831 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-13T21:15:23.831 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-13T21:15:23.831 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-13T21:15:23.831 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-13T21:15:23.831 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:15:23.876 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2040.gd16d1 150/198 2024-03-13T21:15:23.898 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2040.gd16d1 150/198 2024-03-13T21:15:23.898 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-13T21:15:23.898 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-13T21:15:23.898 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:15:23.943 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-mirror-2:19.0.0-2040.gd16d1766.el9.x86_64 151/198 2024-03-13T21:15:23.965 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2040.gd16d1766.el9.x86_64 151/198 2024-03-13T21:15:23.965 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-13T21:15:23.966 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-13T21:15:23.966 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-13T21:15:23.966 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-13T21:15:23.966 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:15:24.277 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-mirror-2:19.0.0-2040.gd16d1766.el9.x86_64 152/198 2024-03-13T21:15:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2040.gd16d1766.el9.x86_64 152/198 2024-03-13T21:15:24.300 INFO:teuthology.orchestra.run.smithi107.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-13T21:15:24.300 INFO:teuthology.orchestra.run.smithi107.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-13T21:15:24.300 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-13T21:15:24.300 INFO:teuthology.orchestra.run.smithi107.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-13T21:15:24.300 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:15:28.723 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-test-2:19.0.0-2040.gd16d1766.el9.x86_64 153/198 2024-03-13T21:15:28.764 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-fuse-2:19.0.0-2040.gd16d1766.el9.x86_64 154/198 2024-03-13T21:15:28.795 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : rbd-nbd-2:19.0.0-2040.gd16d1766.el9.x86_64 155/198 2024-03-13T21:15:28.822 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-13T21:15:29.003 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-shell-2:19.0.0-2040.gd16d1766.el9.x86_64 157/198 2024-03-13T21:15:29.121 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-13T21:15:29.171 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : ceph-fuse-2:19.0.0-2040.gd16d1766.el9.x86_64 159/198 2024-03-13T21:15:29.224 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-13T21:15:29.279 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-13T21:15:29.306 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-13T21:15:29.338 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libcephfs-devel-2:19.0.0-2040.gd16d1766.el9.x86_ 163/198 2024-03-13T21:15:29.383 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-13T21:15:29.417 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-13T21:15:29.488 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-13T21:15:29.564 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-13T21:15:29.608 INFO:teuthology.orchestra.run.smithi107.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-13T21:15:30.227 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-13T21:15:30.264 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-13T21:15:30.285 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-13T21:15:31.090 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : cephfs-top-2:19.0.0-2040.gd16d1766.el9.noarch 170/198 2024-03-13T21:15:31.176 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-13T21:15:31.217 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-13T21:15:31.307 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-13T21:15:31.364 INFO:teuthology.orchestra.run.smithi107.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-13T21:15:31.388 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-13T21:15:31.414 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-13T21:15:31.441 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-13T21:15:31.441 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-13T21:15:31.512 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-13T21:15:31.541 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-13T21:15:31.542 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-13T21:15:31.634 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-13T21:15:31.660 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-13T21:15:31.703 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-13T21:15:31.728 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-13T21:15:31.753 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-13T21:15:31.793 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-13T21:15:31.834 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-13T21:15:31.866 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-13T21:15:31.891 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-13T21:15:31.917 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-13T21:15:31.942 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-13T21:15:31.967 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-13T21:15:31.974 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-13T21:15:31.974 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-13T21:15:32.162 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-13T21:15:32.163 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-13T21:15:32.262 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-13T21:15:32.287 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-13T21:15:32.312 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-13T21:15:32.344 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-13T21:15:32.371 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-13T21:15:32.437 INFO:teuthology.orchestra.run.smithi107.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-13T21:15:37.258 INFO:teuthology.orchestra.run.smithi107.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-13T21:15:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-2:19.0.0-2040.gd16d1766.el9.x86_64 1/198 2024-03-13T21:15:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-base-2:19.0.0-2040.gd16d1766.el9.x86_64 2/198 2024-03-13T21:15:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-common-2:19.0.0-2040.gd16d1766.el9.x86_64 3/198 2024-03-13T21:15:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-fuse-2:19.0.0-2040.gd16d1766.el9.x86_64 4/198 2024-03-13T21:15:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2040.gd16d1 5/198 2024-03-13T21:15:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mds-2:19.0.0-2040.gd16d1766.el9.x86_64 6/198 2024-03-13T21:15:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-2:19.0.0-2040.gd16d1766.el9.x86_64 7/198 2024-03-13T21:15:37.259 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mon-2:19.0.0-2040.gd16d1766.el9.x86_64 8/198 2024-03-13T21:15:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-osd-2:19.0.0-2040.gd16d1766.el9.x86_64 9/198 2024-03-13T21:15:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-radosgw-2:19.0.0-2040.gd16d1766.el9.x86_64 10/198 2024-03-13T21:15:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-selinux-2:19.0.0-2040.gd16d1766.el9.x86_64 11/198 2024-03-13T21:15:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-test-2:19.0.0-2040.gd16d1766.el9.x86_64 12/198 2024-03-13T21:15:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-mirror-2:19.0.0-2040.gd16d1766.el9.x86_64 13/198 2024-03-13T21:15:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-shell-2:19.0.0-2040.gd16d1766.el9.x86_64 14/198 2024-03-13T21:15:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs-devel-2:19.0.0-2040.gd16d1766.el9.x86_ 15/198 2024-03-13T21:15:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephfs2-2:19.0.0-2040.gd16d1766.el9.x86_64 16/198 2024-03-13T21:15:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libcephsqlite-2:19.0.0-2040.gd16d1766.el9.x86_64 17/198 2024-03-13T21:15:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados-devel-2:19.0.0-2040.gd16d1766.el9.x86_6 18/198 2024-03-13T21:15:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libradosstriper1-2:19.0.0-2040.gd16d1766.el9.x86 19/198 2024-03-13T21:15:37.260 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librgw2-2:19.0.0-2040.gd16d1766.el9.x86_64 20/198 2024-03-13T21:15:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2040.gd16d1766.el 21/198 2024-03-13T21:15:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ceph-common-2:19.0.0-2040.gd16d1766.el9. 22/198 2024-03-13T21:15:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cephfs-2:19.0.0-2040.gd16d1766.el9.x86_6 23/198 2024-03-13T21:15:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rados-2:19.0.0-2040.gd16d1766.el9.x86_64 24/198 2024-03-13T21:15:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rbd-2:19.0.0-2040.gd16d1766.el9.x86_64 25/198 2024-03-13T21:15:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rgw-2:19.0.0-2040.gd16d1766.el9.x86_64 26/198 2024-03-13T21:15:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-fuse-2:19.0.0-2040.gd16d1766.el9.x86_64 27/198 2024-03-13T21:15:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-mirror-2:19.0.0-2040.gd16d1766.el9.x86_64 28/198 2024-03-13T21:15:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : rbd-nbd-2:19.0.0-2040.gd16d1766.el9.x86_64 29/198 2024-03-13T21:15:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2040.gd16d1766. 30/198 2024-03-13T21:15:37.261 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2040.gd16d1766.el9.noa 31/198 2024-03-13T21:15:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2040.gd16d1766.el9.n 32/198 2024-03-13T21:15:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2040.gd16 33/198 2024-03-13T21:15:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2040.gd16d1766.el 34/198 2024-03-13T21:15:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2040.gd16d1766.el9.noarch 35/198 2024-03-13T21:15:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2040.gd16d1766.e 36/198 2024-03-13T21:15:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : ceph-volume-2:19.0.0-2040.gd16d1766.el9.noarch 37/198 2024-03-13T21:15:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephadm-2:19.0.0-2040.gd16d1766.el9.noarch 38/198 2024-03-13T21:15:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : cephfs-top-2:19.0.0-2040.gd16d1766.el9.noarch 39/198 2024-03-13T21:15:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-13T21:15:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-13T21:15:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-13T21:15:37.262 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-13T21:15:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-13T21:15:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-13T21:15:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-13T21:15:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-13T21:15:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-13T21:15:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-13T21:15:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-13T21:15:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-13T21:15:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-13T21:15:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-13T21:15:37.263 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-13T21:15:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-13T21:15:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-13T21:15:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-13T21:15:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-13T21:15:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-13T21:15:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-13T21:15:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-13T21:15:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-13T21:15:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-13T21:15:37.264 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-13T21:15:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-13T21:15:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-13T21:15:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-13T21:15:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-13T21:15:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-13T21:15:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-13T21:15:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-13T21:15:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-13T21:15:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-13T21:15:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-13T21:15:37.265 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-13T21:15:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-13T21:15:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-13T21:15:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-13T21:15:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-13T21:15:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-13T21:15:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-13T21:15:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-13T21:15:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-13T21:15:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-13T21:15:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-13T21:15:37.266 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-13T21:15:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-13T21:15:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-13T21:15:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-13T21:15:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-13T21:15:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-13T21:15:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-13T21:15:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-13T21:15:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-13T21:15:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-13T21:15:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-13T21:15:37.267 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-13T21:15:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-13T21:15:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-13T21:15:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-13T21:15:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-13T21:15:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-13T21:15:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-13T21:15:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-13T21:15:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-13T21:15:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-13T21:15:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-13T21:15:37.268 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-13T21:15:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-13T21:15:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-13T21:15:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-13T21:15:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-13T21:15:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-13T21:15:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-13T21:15:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-13T21:15:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-13T21:15:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-13T21:15:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-13T21:15:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-13T21:15:37.269 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-13T21:15:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-13T21:15:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-13T21:15:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-13T21:15:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-13T21:15:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-13T21:15:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-13T21:15:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-13T21:15:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-13T21:15:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-13T21:15:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-13T21:15:37.270 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-13T21:15:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-13T21:15:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-13T21:15:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-13T21:15:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-13T21:15:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-13T21:15:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-13T21:15:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-13T21:15:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-13T21:15:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-13T21:15:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-13T21:15:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-13T21:15:37.271 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-13T21:15:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-13T21:15:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-13T21:15:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-13T21:15:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-13T21:15:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-13T21:15:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-13T21:15:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-13T21:15:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:19.0.0-2040.gd16d1766.el9.x86_64 151/198 2024-03-13T21:15:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-13T21:15:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:19.0.0-2040.gd16d1766.el9.x86_64 153/198 2024-03-13T21:15:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-13T21:15:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-13T21:15:37.272 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-13T21:15:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/198 2024-03-13T21:15:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-13T21:15:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/198 2024-03-13T21:15:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-13T21:15:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/198 2024-03-13T21:15:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-13T21:15:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/198 2024-03-13T21:15:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-13T21:15:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-13T21:15:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-13T21:15:37.273 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-13T21:15:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-13T21:15:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-13T21:15:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-13T21:15:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-13T21:15:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-13T21:15:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-13T21:15:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-13T21:15:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-13T21:15:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-13T21:15:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-13T21:15:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-13T21:15:37.274 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-13T21:15:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-13T21:15:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-13T21:15:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-13T21:15:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-13T21:15:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-13T21:15:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-13T21:15:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-13T21:15:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-13T21:15:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-13T21:15:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-13T21:15:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-13T21:15:37.275 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-13T21:15:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-13T21:15:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-13T21:15:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-13T21:15:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-13T21:15:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-13T21:15:37.276 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-13T21:15:40.416 INFO:teuthology.orchestra.run.smithi107.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-13T21:15:40.416 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:15:40.416 INFO:teuthology.orchestra.run.smithi107.stdout:Upgraded: 2024-03-13T21:15:40.416 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-13T21:15:40.416 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-13T21:15:40.416 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-13T21:15:40.416 INFO:teuthology.orchestra.run.smithi107.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-13T21:15:40.416 INFO:teuthology.orchestra.run.smithi107.stdout: acl-2.3.1-4.el9.x86_64 2024-03-13T21:15:40.416 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-13T21:15:40.416 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-13T21:15:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-13T21:15:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-13T21:15:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-13T21:15:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-13T21:15:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-13T21:15:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-13T21:15:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: librados2-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: librbd1-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-13T21:15:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-13T21:15:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-13T21:15:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-13T21:15:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-13T21:15:40.417 INFO:teuthology.orchestra.run.smithi107.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-13T21:15:40.418 INFO:teuthology.orchestra.run.smithi107.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-13T21:15:40.418 INFO:teuthology.orchestra.run.smithi107.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-13T21:15:40.418 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-13T21:15:40.418 INFO:teuthology.orchestra.run.smithi107.stdout:Installed: 2024-03-13T21:15:40.418 INFO:teuthology.orchestra.run.smithi107.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-13T21:15:40.418 INFO:teuthology.orchestra.run.smithi107.stdout: automake-1.16.2-8.el9.noarch 2024-03-13T21:15:40.418 INFO:teuthology.orchestra.run.smithi107.stdout: bison-3.7.4-5.el9.x86_64 2024-03-13T21:15:40.418 INFO:teuthology.orchestra.run.smithi107.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-13T21:15:40.418 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.418 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-base-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.418 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-common-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-fuse-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-grafana-dashboards-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:15:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-immutable-object-cache-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mds-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-cephadm-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:15:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-dashboard-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:15:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:15:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-modules-core-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:15:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mgr-rook-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:15:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-mon-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-osd-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.419 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-prometheus-alerts-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:15:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-radosgw-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-selinux-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-test-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: ceph-volume-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:15:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: cephadm-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:15:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-mirror-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-shell-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: cephfs-top-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:15:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-13T21:15:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: flex-2.6.4-9.el9.x86_64 2024-03-13T21:15:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-13T21:15:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-13T21:15:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-13T21:15:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-13T21:15:40.420 INFO:teuthology.orchestra.run.smithi107.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-13T21:15:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-13T21:15:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: jq-1.6-16.el9.x86_64 2024-03-13T21:15:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-13T21:15:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-13T21:15:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-13T21:15:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs-devel-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: libcephfs2-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: libcephsqlite-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-13T21:15:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-13T21:15:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-13T21:15:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-13T21:15:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-13T21:15:40.421 INFO:teuthology.orchestra.run.smithi107.stdout: librados-devel-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: libradosstriper1-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-13T21:15:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: librgw2-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-13T21:15:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-13T21:15:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-13T21:15:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-13T21:15:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-13T21:15:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: lua-5.4.4-4.el9.x86_64 2024-03-13T21:15:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-13T21:15:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-13T21:15:40.422 INFO:teuthology.orchestra.run.smithi107.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-13T21:15:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-13T21:15:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-13T21:15:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-13T21:15:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-13T21:15:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-13.11-1.el9.x86_64 2024-03-13T21:15:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-13T21:15:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-13T21:15:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-13T21:15:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-13T21:15:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-13T21:15:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-13T21:15:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-13T21:15:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-13T21:15:40.423 INFO:teuthology.orchestra.run.smithi107.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-13T21:15:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-13T21:15:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-argparse-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ceph-common-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cephfs-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-13T21:15:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-13T21:15:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-13T21:15:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-13T21:15:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-13T21:15:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-13T21:15:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-13T21:15:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-13T21:15:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-13T21:15:40.424 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-13T21:15:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-13T21:15:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-13T21:15:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-13T21:15:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-13T21:15:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-13T21:15:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-13T21:15:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-13T21:15:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-13T21:15:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-13T21:15:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-13T21:15:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-13T21:15:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-13T21:15:40.425 INFO:teuthology.orchestra.run.smithi107.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-13T21:15:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-13T21:15:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-13T21:15:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-13T21:15:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-13T21:15:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-13T21:15:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-13T21:15:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-13T21:15:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: python3-ply-3.11-14.el9.noarch 2024-03-13T21:15:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-13T21:15:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-13T21:15:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-13T21:15:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-13T21:15:40.426 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-13T21:15:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-13T21:15:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-13T21:15:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-13T21:15:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-13T21:15:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rados-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rbd-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-13T21:15:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-13T21:15:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-13T21:15:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rgw-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-13T21:15:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-13T21:15:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-13T21:15:40.427 INFO:teuthology.orchestra.run.smithi107.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-13T21:15:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-13T21:15:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-13T21:15:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-13T21:15:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-13T21:15:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-13T21:15:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-13T21:15:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-13T21:15:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-13T21:15:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-13T21:15:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-13T21:15:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-13T21:15:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-fuse-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-mirror-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.428 INFO:teuthology.orchestra.run.smithi107.stdout: rbd-nbd-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:15:40.429 INFO:teuthology.orchestra.run.smithi107.stdout: re2-1:20211101-3.el9.x86_64 2024-03-13T21:15:40.429 INFO:teuthology.orchestra.run.smithi107.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-13T21:15:40.429 INFO:teuthology.orchestra.run.smithi107.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-13T21:15:40.429 INFO:teuthology.orchestra.run.smithi107.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-13T21:15:40.429 INFO:teuthology.orchestra.run.smithi107.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-13T21:15:40.429 INFO:teuthology.orchestra.run.smithi107.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-13T21:15:40.429 INFO:teuthology.orchestra.run.smithi107.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-13T21:15:40.429 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:15:40.429 INFO:teuthology.orchestra.run.smithi107.stdout:Complete! 2024-03-13T21:15:40.880 DEBUG:teuthology.parallel:result is None 2024-03-13T21:18:10.922 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 90 kB/s | 21 MB 03:53 2024-03-13T21:18:15.837 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-03-13T21:18:18.318 INFO:teuthology.orchestra.run.smithi195.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-13T21:18:18.319 INFO:teuthology.orchestra.run.smithi195.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-13T21:18:18.334 INFO:teuthology.orchestra.run.smithi195.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-13T21:18:18.335 INFO:teuthology.orchestra.run.smithi195.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-13T21:18:18.336 INFO:teuthology.orchestra.run.smithi195.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-13T21:18:18.337 INFO:teuthology.orchestra.run.smithi195.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-13T21:18:18.339 INFO:teuthology.orchestra.run.smithi195.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-13T21:18:18.342 INFO:teuthology.orchestra.run.smithi195.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-13T21:18:18.343 INFO:teuthology.orchestra.run.smithi195.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-13T21:18:18.422 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2024-03-13T21:18:18.437 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================ 2024-03-13T21:18:18.438 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2024-03-13T21:18:18.438 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================ 2024-03-13T21:18:18.438 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2024-03-13T21:18:18.438 INFO:teuthology.orchestra.run.smithi195.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-13T21:18:18.438 INFO:teuthology.orchestra.run.smithi195.stdout: ceph x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 6.6 k 2024-03-13T21:18:18.438 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 5.4 M 2024-03-13T21:18:18.438 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 888 k 2024-03-13T21:18:18.438 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 145 k 2024-03-13T21:18:18.438 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 1.5 M 2024-03-13T21:18:18.438 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 139 k 2024-03-13T21:18:18.438 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 1.8 M 2024-03-13T21:18:18.439 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 7.4 M 2024-03-13T21:18:18.439 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 49 k 2024-03-13T21:18:18.439 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 9.8 M 2024-03-13T21:18:18.439 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 47 M 2024-03-13T21:18:18.439 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 264 k 2024-03-13T21:18:18.439 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 749 k 2024-03-13T21:18:18.439 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 221 k 2024-03-13T21:18:18.439 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-shell x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 27 k 2024-03-13T21:18:18.439 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-top noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 18 k 2024-03-13T21:18:18.439 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-13T21:18:18.439 INFO:teuthology.orchestra.run.smithi195.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-13T21:18:18.439 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-13T21:18:18.440 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 32 k 2024-03-13T21:18:18.440 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 744 k 2024-03-13T21:18:18.440 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 127 k 2024-03-13T21:18:18.440 INFO:teuthology.orchestra.run.smithi195.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-13T21:18:18.440 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-13T21:18:18.440 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-13T21:18:18.440 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-13T21:18:18.440 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-13T21:18:18.440 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-13T21:18:18.440 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 162 k 2024-03-13T21:18:18.440 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 320 k 2024-03-13T21:18:18.441 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 298 k 2024-03-13T21:18:18.441 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 99 k 2024-03-13T21:18:18.441 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 85 k 2024-03-13T21:18:18.441 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 3.1 M 2024-03-13T21:18:18.441 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 170 k 2024-03-13T21:18:18.441 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-13T21:18:18.441 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrading: 2024-03-13T21:18:18.441 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-13T21:18:18.441 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-13T21:18:18.441 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-13T21:18:18.441 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-13T21:18:18.442 INFO:teuthology.orchestra.run.smithi195.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-13T21:18:18.442 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-13T21:18:18.442 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-13T21:18:18.442 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-13T21:18:18.442 INFO:teuthology.orchestra.run.smithi195.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-13T21:18:18.442 INFO:teuthology.orchestra.run.smithi195.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-13T21:18:18.442 INFO:teuthology.orchestra.run.smithi195.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-13T21:18:18.442 INFO:teuthology.orchestra.run.smithi195.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-13T21:18:18.442 INFO:teuthology.orchestra.run.smithi195.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-13T21:18:18.442 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 3.4 M 2024-03-13T21:18:18.443 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1 x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 3.1 M 2024-03-13T21:18:18.443 INFO:teuthology.orchestra.run.smithi195.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-13T21:18:18.443 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-13T21:18:18.443 INFO:teuthology.orchestra.run.smithi195.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-13T21:18:18.443 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-13T21:18:18.443 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-13T21:18:18.443 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-13T21:18:18.443 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-13T21:18:18.443 INFO:teuthology.orchestra.run.smithi195.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-13T21:18:18.443 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-13T21:18:18.443 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2024-03-13T21:18:18.443 INFO:teuthology.orchestra.run.smithi195.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-13T21:18:18.444 INFO:teuthology.orchestra.run.smithi195.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-13T21:18:18.444 INFO:teuthology.orchestra.run.smithi195.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-13T21:18:18.444 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 20 M 2024-03-13T21:18:18.444 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 34 k 2024-03-13T21:18:18.444 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 2.2 M 2024-03-13T21:18:18.444 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 248 k 2024-03-13T21:18:18.444 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 4.7 M 2024-03-13T21:18:18.444 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 17 M 2024-03-13T21:18:18.444 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2040.gd16d1766.el9 ceph-noarch 16 k 2024-03-13T21:18:18.444 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 25 k 2024-03-13T21:18:18.444 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-13T21:18:18.444 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-13T21:18:18.445 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-13T21:18:18.445 INFO:teuthology.orchestra.run.smithi195.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-13T21:18:18.445 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-13T21:18:18.445 INFO:teuthology.orchestra.run.smithi195.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-13T21:18:18.445 INFO:teuthology.orchestra.run.smithi195.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-13T21:18:18.445 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-13T21:18:18.445 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-13T21:18:18.445 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 163 k 2024-03-13T21:18:18.445 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-13T21:18:18.445 INFO:teuthology.orchestra.run.smithi195.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-13T21:18:18.445 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-13T21:18:18.446 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-13T21:18:18.446 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-13T21:18:18.446 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 501 k 2024-03-13T21:18:18.446 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-13T21:18:18.446 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 5.1 M 2024-03-13T21:18:18.446 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-13T21:18:18.446 INFO:teuthology.orchestra.run.smithi195.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-13T21:18:18.446 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-13T21:18:18.446 INFO:teuthology.orchestra.run.smithi195.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-13T21:18:18.446 INFO:teuthology.orchestra.run.smithi195.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-13T21:18:18.446 INFO:teuthology.orchestra.run.smithi195.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-13T21:18:18.446 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-13T21:18:18.447 INFO:teuthology.orchestra.run.smithi195.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-13T21:18:18.447 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-13T21:18:18.447 INFO:teuthology.orchestra.run.smithi195.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-13T21:18:18.447 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-13T21:18:18.447 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-13T21:18:18.447 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-13T21:18:18.447 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-13T21:18:18.447 INFO:teuthology.orchestra.run.smithi195.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-13T21:18:18.447 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-13T21:18:18.447 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-13T21:18:18.447 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-13T21:18:18.447 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 45 k 2024-03-13T21:18:18.447 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common x86_64 2:19.0.0-2040.gd16d1766.el9 ceph 131 k 2024-03-13T21:18:18.447 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-13T21:18:18.448 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-13T21:18:18.448 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-13T21:18:18.448 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-13T21:18:18.448 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-13T21:18:18.448 INFO:teuthology.orchestra.run.smithi195.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-13T21:18:18.448 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-13T21:18:18.448 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-13T21:18:18.448 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-13T21:18:18.448 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-13T21:18:18.448 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-13T21:18:18.448 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-13T21:18:18.448 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-13T21:18:18.448 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-13T21:18:18.449 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-13T21:18:18.449 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-13T21:18:18.449 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-13T21:18:18.449 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-13T21:18:18.449 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-13T21:18:18.449 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-13T21:18:18.449 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-13T21:18:18.449 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-13T21:18:18.449 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-13T21:18:18.449 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-13T21:18:18.449 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-13T21:18:18.449 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-13T21:18:18.449 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-13T21:18:18.450 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-13T21:18:18.450 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-13T21:18:18.450 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-13T21:18:18.450 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-13T21:18:18.450 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-13T21:18:18.450 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-13T21:18:18.450 INFO:teuthology.orchestra.run.smithi195.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-13T21:18:18.450 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-13T21:18:18.450 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-13T21:18:18.450 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-13T21:18:18.450 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-13T21:18:18.450 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-13T21:18:18.451 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-13T21:18:18.451 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-13T21:18:18.451 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-13T21:18:18.451 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-13T21:18:18.451 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-13T21:18:18.451 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-13T21:18:18.451 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-13T21:18:18.451 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-13T21:18:18.451 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-13T21:18:18.451 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-13T21:18:18.451 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-13T21:18:18.451 INFO:teuthology.orchestra.run.smithi195.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-13T21:18:18.451 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-13T21:18:18.451 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-13T21:18:18.452 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-13T21:18:18.452 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-13T21:18:18.452 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-13T21:18:18.452 INFO:teuthology.orchestra.run.smithi195.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-13T21:18:18.452 INFO:teuthology.orchestra.run.smithi195.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-13T21:18:18.452 INFO:teuthology.orchestra.run.smithi195.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-13T21:18:18.452 INFO:teuthology.orchestra.run.smithi195.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-13T21:18:18.452 INFO:teuthology.orchestra.run.smithi195.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-13T21:18:18.452 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-13T21:18:18.452 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-13T21:18:18.452 INFO:teuthology.orchestra.run.smithi195.stdout:Installing weak dependencies: 2024-03-13T21:18:18.452 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-13T21:18:18.452 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:18:18.453 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2024-03-13T21:18:18.453 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================ 2024-03-13T21:18:18.453 INFO:teuthology.orchestra.run.smithi195.stdout:Install 150 Packages 2024-03-13T21:18:18.453 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrade 24 Packages 2024-03-13T21:18:18.453 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:18:18.453 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 224 M 2024-03-13T21:18:18.453 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2024-03-13T21:18:19.072 INFO:teuthology.orchestra.run.smithi195.stdout:(1/174): ceph-19.0.0-2040.gd16d1766.el9.x86_64. 40 kB/s | 6.6 kB 00:00 2024-03-13T21:18:19.256 INFO:teuthology.orchestra.run.smithi195.stdout:(2/174): ceph-fuse-19.0.0-2040.gd16d1766.el9.x8 4.7 MB/s | 888 kB 00:00 2024-03-13T21:18:19.314 INFO:teuthology.orchestra.run.smithi195.stdout:(3/174): ceph-immutable-object-cache-19.0.0-204 2.4 MB/s | 145 kB 00:00 2024-03-13T21:18:19.573 INFO:teuthology.orchestra.run.smithi195.stdout:(4/174): ceph-base-19.0.0-2040.gd16d1766.el9.x8 8.0 MB/s | 5.4 MB 00:00 2024-03-13T21:18:19.623 INFO:teuthology.orchestra.run.smithi195.stdout:(5/174): ceph-mds-19.0.0-2040.gd16d1766.el9.x86 7.0 MB/s | 2.2 MB 00:00 2024-03-13T21:18:19.698 INFO:teuthology.orchestra.run.smithi195.stdout:(6/174): ceph-mgr-19.0.0-2040.gd16d1766.el9.x86 12 MB/s | 1.5 MB 00:00 2024-03-13T21:18:20.073 INFO:teuthology.orchestra.run.smithi195.stdout:(7/174): ceph-mon-19.0.0-2040.gd16d1766.el9.x86 10 MB/s | 4.7 MB 00:00 2024-03-13T21:18:21.151 INFO:teuthology.orchestra.run.smithi195.stdout:(8/174): ceph-osd-19.0.0-2040.gd16d1766.el9.x86 12 MB/s | 17 MB 00:01 2024-03-13T21:18:21.257 INFO:teuthology.orchestra.run.smithi195.stdout:(9/174): ceph-radosgw-19.0.0-2040.gd16d1766.el9 8.3 MB/s | 9.8 MB 00:01 2024-03-13T21:18:21.291 INFO:teuthology.orchestra.run.smithi195.stdout:(10/174): ceph-selinux-19.0.0-2040.gd16d1766.el 180 kB/s | 25 kB 00:00 2024-03-13T21:18:21.349 INFO:teuthology.orchestra.run.smithi195.stdout:(11/174): cephfs-mirror-19.0.0-2040.gd16d1766.e 3.7 MB/s | 221 kB 00:00 2024-03-13T21:18:21.408 INFO:teuthology.orchestra.run.smithi195.stdout:(12/174): cephfs-shell-19.0.0-2040.gd16d1766.el 464 kB/s | 27 kB 00:00 2024-03-13T21:18:21.475 INFO:teuthology.orchestra.run.smithi195.stdout:(13/174): libcephfs-devel-19.0.0-2040.gd16d1766 475 kB/s | 32 kB 00:00 2024-03-13T21:18:21.600 INFO:teuthology.orchestra.run.smithi195.stdout:(14/174): libcephfs2-19.0.0-2040.gd16d1766.el9. 5.8 MB/s | 744 kB 00:00 2024-03-13T21:18:21.667 INFO:teuthology.orchestra.run.smithi195.stdout:(15/174): libcephsqlite-19.0.0-2040.gd16d1766.e 2.4 MB/s | 163 kB 00:00 2024-03-13T21:18:21.734 INFO:teuthology.orchestra.run.smithi195.stdout:(16/174): librados-devel-19.0.0-2040.gd16d1766. 1.9 MB/s | 127 kB 00:00 2024-03-13T21:18:21.817 INFO:teuthology.orchestra.run.smithi195.stdout:(17/174): libradosstriper1-19.0.0-2040.gd16d176 5.9 MB/s | 501 kB 00:00 2024-03-13T21:18:22.293 INFO:teuthology.orchestra.run.smithi195.stdout:(18/174): librgw2-19.0.0-2040.gd16d1766.el9.x86 11 MB/s | 5.1 MB 00:00 2024-03-13T21:18:22.360 INFO:teuthology.orchestra.run.smithi195.stdout:(19/174): python3-ceph-argparse-19.0.0-2040.gd1 678 kB/s | 45 kB 00:00 2024-03-13T21:18:22.435 INFO:teuthology.orchestra.run.smithi195.stdout:(20/174): python3-ceph-common-19.0.0-2040.gd16d 1.7 MB/s | 131 kB 00:00 2024-03-13T21:18:22.510 INFO:teuthology.orchestra.run.smithi195.stdout:(21/174): python3-cephfs-19.0.0-2040.gd16d1766. 2.1 MB/s | 162 kB 00:00 2024-03-13T21:18:22.602 INFO:teuthology.orchestra.run.smithi195.stdout:(22/174): python3-rados-19.0.0-2040.gd16d1766.e 3.4 MB/s | 320 kB 00:00 2024-03-13T21:18:22.699 INFO:teuthology.orchestra.run.smithi195.stdout:(23/174): python3-rbd-19.0.0-2040.gd16d1766.el9 3.0 MB/s | 298 kB 00:00 2024-03-13T21:18:22.761 INFO:teuthology.orchestra.run.smithi195.stdout:(24/174): python3-rgw-19.0.0-2040.gd16d1766.el9 1.6 MB/s | 99 kB 00:00 2024-03-13T21:18:22.837 INFO:teuthology.orchestra.run.smithi195.stdout:(25/174): rbd-fuse-19.0.0-2040.gd16d1766.el9.x8 1.1 MB/s | 85 kB 00:00 2024-03-13T21:18:23.162 INFO:teuthology.orchestra.run.smithi195.stdout:(26/174): rbd-mirror-19.0.0-2040.gd16d1766.el9. 9.5 MB/s | 3.1 MB 00:00 2024-03-13T21:18:23.237 INFO:teuthology.orchestra.run.smithi195.stdout:(27/174): rbd-nbd-19.0.0-2040.gd16d1766.el9.x86 2.2 MB/s | 170 kB 00:00 2024-03-13T21:18:23.295 INFO:teuthology.orchestra.run.smithi195.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2040.g 584 kB/s | 34 kB 00:00 2024-03-13T21:18:23.363 INFO:teuthology.orchestra.run.smithi195.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2040.gd16d176 2.0 MB/s | 139 kB 00:00 2024-03-13T21:18:23.547 INFO:teuthology.orchestra.run.smithi195.stdout:(30/174): ceph-mgr-dashboard-19.0.0-2040.gd16d1 9.8 MB/s | 1.8 MB 00:00 2024-03-13T21:18:23.747 INFO:teuthology.orchestra.run.smithi195.stdout:(31/174): ceph-common-19.0.0-2040.gd16d1766.el9 4.2 MB/s | 20 MB 00:04 2024-03-13T21:18:23.864 INFO:teuthology.orchestra.run.smithi195.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2040.gd1 2.1 MB/s | 248 kB 00:00 2024-03-13T21:18:23.972 INFO:teuthology.orchestra.run.smithi195.stdout:(33/174): ceph-mgr-rook-19.0.0-2040.gd16d1766.e 456 kB/s | 49 kB 00:00 2024-03-13T21:18:24.456 INFO:teuthology.orchestra.run.smithi195.stdout:(34/174): ceph-test-19.0.0-2040.gd16d1766.el9.x 15 MB/s | 47 MB 00:03 2024-03-13T21:18:24.473 INFO:teuthology.orchestra.run.smithi195.stdout:(35/174): ceph-prometheus-alerts-19.0.0-2040.gd 33 kB/s | 16 kB 00:00 2024-03-13T21:18:24.565 INFO:teuthology.orchestra.run.smithi195.stdout:(36/174): ceph-mgr-diskprediction-local-19.0.0- 7.3 MB/s | 7.4 MB 00:01 2024-03-13T21:18:24.590 INFO:teuthology.orchestra.run.smithi195.stdout:(37/174): ceph-volume-19.0.0-2040.gd16d1766.el9 1.9 MB/s | 264 kB 00:00 2024-03-13T21:18:24.606 INFO:teuthology.orchestra.run.smithi195.stdout:(38/174): cephfs-top-19.0.0-2040.gd16d1766.el9. 440 kB/s | 18 kB 00:00 2024-03-13T21:18:24.699 INFO:teuthology.orchestra.run.smithi195.stdout:(39/174): cephadm-19.0.0-2040.gd16d1766.el9.noa 3.2 MB/s | 749 kB 00:00 2024-03-13T21:18:24.783 INFO:teuthology.orchestra.run.smithi195.stdout:(40/174): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 662 kB 00:00 2024-03-13T21:18:24.808 INFO:teuthology.orchestra.run.smithi195.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 989 kB/s | 106 kB 00:00 2024-03-13T21:18:24.833 INFO:teuthology.orchestra.run.smithi195.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 307 kB 00:00 2024-03-13T21:18:24.858 INFO:teuthology.orchestra.run.smithi195.stdout:(43/174): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 920 kB 00:00 2024-03-13T21:18:24.892 INFO:teuthology.orchestra.run.smithi195.stdout:(44/174): flexiblas-3.0.4-8.el9.x86_64.rpm 382 kB/s | 32 kB 00:00 2024-03-13T21:18:24.967 INFO:teuthology.orchestra.run.smithi195.stdout:(45/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 22 MB/s | 3.0 MB 00:00 2024-03-13T21:18:24.992 INFO:teuthology.orchestra.run.smithi195.stdout:(46/174): flexiblas-openblas-openmp-3.0.4-8.el9 177 kB/s | 17 kB 00:00 2024-03-13T21:18:25.017 INFO:teuthology.orchestra.run.smithi195.stdout:(47/174): libaio-devel-0.3.111-13.el9.x86_64.rp 83 kB/s | 10 kB 00:00 2024-03-13T21:18:25.043 INFO:teuthology.orchestra.run.smithi195.stdout:(48/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2024-03-13T21:18:25.068 INFO:teuthology.orchestra.run.smithi195.stdout:(49/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 885 kB/s | 44 kB 00:00 2024-03-13T21:18:25.093 INFO:teuthology.orchestra.run.smithi195.stdout:(50/174): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 661 kB 00:00 2024-03-13T21:18:25.118 INFO:teuthology.orchestra.run.smithi195.stdout:(51/174): libtool-2.4.6-45.el9.x86_64.rpm 7.5 MB/s | 578 kB 00:00 2024-03-13T21:18:25.144 INFO:teuthology.orchestra.run.smithi195.stdout:(52/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 941 kB/s | 46 kB 00:00 2024-03-13T21:18:25.169 INFO:teuthology.orchestra.run.smithi195.stdout:(53/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.7 MB/s | 282 kB 00:00 2024-03-13T21:18:25.194 INFO:teuthology.orchestra.run.smithi195.stdout:(54/174): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 187 kB 00:00 2024-03-13T21:18:25.219 INFO:teuthology.orchestra.run.smithi195.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 689 kB/s | 34 kB 00:00 2024-03-13T21:18:25.244 INFO:teuthology.orchestra.run.smithi195.stdout:(56/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2024-03-13T21:18:25.312 INFO:teuthology.orchestra.run.smithi195.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 40 MB/s | 4.7 MB 00:00 2024-03-13T21:18:25.353 INFO:teuthology.orchestra.run.smithi195.stdout:(58/174): postgresql-13.11-1.el9.x86_64.rpm 12 MB/s | 1.5 MB 00:00 2024-03-13T21:18:25.379 INFO:teuthology.orchestra.run.smithi195.stdout:(59/174): postgresql-contrib-13.11-1.el9.x86_64 6.0 MB/s | 811 kB 00:00 2024-03-13T21:18:25.404 INFO:teuthology.orchestra.run.smithi195.stdout:(60/174): postgresql-private-libs-13.11-1.el9.x 1.5 MB/s | 134 kB 00:00 2024-03-13T21:18:25.446 INFO:teuthology.orchestra.run.smithi195.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-03-13T21:18:25.529 INFO:teuthology.orchestra.run.smithi195.stdout:(62/174): postgresql-server-13.11-1.el9.x86_64. 38 MB/s | 5.7 MB 00:00 2024-03-13T21:18:25.555 INFO:teuthology.orchestra.run.smithi195.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 518 kB/s | 78 kB 00:00 2024-03-13T21:18:25.638 INFO:teuthology.orchestra.run.smithi195.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 30 MB/s | 5.8 MB 00:00 2024-03-13T21:18:25.655 INFO:teuthology.orchestra.run.smithi195.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 198 kB/s | 24 kB 00:00 2024-03-13T21:18:25.672 INFO:teuthology.orchestra.run.smithi195.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 157 kB/s | 18 kB 00:00 2024-03-13T21:18:25.697 INFO:teuthology.orchestra.run.smithi195.stdout:(67/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2024-03-13T21:18:25.714 INFO:teuthology.orchestra.run.smithi195.stdout:(68/174): python3-markupsafe-1.1.1-12.el9.x86_6 763 kB/s | 32 kB 00:00 2024-03-13T21:18:25.798 INFO:teuthology.orchestra.run.smithi195.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 4.8 MB 00:00 2024-03-13T21:18:25.843 INFO:teuthology.orchestra.run.smithi195.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 217 kB 00:00 2024-03-13T21:18:25.873 INFO:teuthology.orchestra.run.smithi195.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 174 kB 00:00 2024-03-13T21:18:25.899 INFO:teuthology.orchestra.run.smithi195.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 687 kB/s | 69 kB 00:00 2024-03-13T21:18:25.916 INFO:teuthology.orchestra.run.smithi195.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 984 kB/s | 41 kB 00:00 2024-03-13T21:18:25.941 INFO:teuthology.orchestra.run.smithi195.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 238 kB 00:00 2024-03-13T21:18:25.966 INFO:teuthology.orchestra.run.smithi195.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2024-03-13T21:18:25.991 INFO:teuthology.orchestra.run.smithi195.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 948 kB/s | 47 kB 00:00 2024-03-13T21:18:26.017 INFO:teuthology.orchestra.run.smithi195.stdout:(77/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2024-03-13T21:18:26.041 INFO:teuthology.orchestra.run.smithi195.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 568 kB/s | 43 kB 00:00 2024-03-13T21:18:26.326 INFO:teuthology.orchestra.run.smithi195.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 47 MB/s | 16 MB 00:00 2024-03-13T21:18:26.350 INFO:teuthology.orchestra.run.smithi195.stdout:(80/174): python3-toml-0.10.2-6.el9.noarch.rpm 126 kB/s | 39 kB 00:00 2024-03-13T21:18:26.376 INFO:teuthology.orchestra.run.smithi195.stdout:(81/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 124 kB/s | 41 kB 00:00 2024-03-13T21:18:26.401 INFO:teuthology.orchestra.run.smithi195.stdout:(82/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.9 MB/s | 300 kB 00:00 2024-03-13T21:18:26.426 INFO:teuthology.orchestra.run.smithi195.stdout:(83/174): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-03-13T21:18:26.452 INFO:teuthology.orchestra.run.smithi195.stdout:(84/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 838 kB/s | 63 kB 00:00 2024-03-13T21:18:26.477 INFO:teuthology.orchestra.run.smithi195.stdout:(85/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 584 kB/s | 44 kB 00:00 2024-03-13T21:18:26.510 INFO:teuthology.orchestra.run.smithi195.stdout:(86/174): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-03-13T21:18:26.535 INFO:teuthology.orchestra.run.smithi195.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.8 MB/s | 241 kB 00:00 2024-03-13T21:18:26.569 INFO:teuthology.orchestra.run.smithi195.stdout:(88/174): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.1 MB 00:00 2024-03-13T21:18:26.594 INFO:teuthology.orchestra.run.smithi195.stdout:(89/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-03-13T21:18:26.619 INFO:teuthology.orchestra.run.smithi195.stdout:(90/174): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2024-03-13T21:18:26.645 INFO:teuthology.orchestra.run.smithi195.stdout:(91/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.4 MB/s | 187 kB 00:00 2024-03-13T21:18:26.770 INFO:teuthology.orchestra.run.smithi195.stdout:(92/174): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2024-03-13T21:18:26.795 INFO:teuthology.orchestra.run.smithi195.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-03-13T21:18:26.820 INFO:teuthology.orchestra.run.smithi195.stdout:(94/174): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-03-13T21:18:26.879 INFO:teuthology.orchestra.run.smithi195.stdout:(95/174): libgfortran-11.4.1-3.el9.x86_64.rpm 3.0 MB/s | 803 kB 00:00 2024-03-13T21:18:26.988 INFO:teuthology.orchestra.run.smithi195.stdout:(96/174): elfutils-libelf-devel-0.190-2.el9.x86 112 kB/s | 21 kB 00:00 2024-03-13T21:18:27.005 INFO:teuthology.orchestra.run.smithi195.stdout:(97/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 138 kB/s | 25 kB 00:00 2024-03-13T21:18:27.230 INFO:teuthology.orchestra.run.smithi195.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-03-13T21:18:27.255 INFO:teuthology.orchestra.run.smithi195.stdout:(99/174): python3-jinja2-2.11.3-5.el9.noarch.rp 991 kB/s | 248 kB 00:00 2024-03-13T21:18:27.330 INFO:teuthology.orchestra.run.smithi195.stdout:(100/174): qatlib-service-23.11.0-1.el9.x86_64. 466 kB/s | 35 kB 00:00 2024-03-13T21:18:27.381 INFO:teuthology.orchestra.run.smithi195.stdout:(101/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 893 kB/s | 44 kB 00:00 2024-03-13T21:18:27.439 INFO:teuthology.orchestra.run.smithi195.stdout:(102/174): qatlib-23.11.0-1.el9.x86_64.rpm 1.0 MB/s | 216 kB 00:00 2024-03-13T21:18:27.489 INFO:teuthology.orchestra.run.smithi195.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 863 kB/s | 94 kB 00:00 2024-03-13T21:18:27.515 INFO:teuthology.orchestra.run.smithi195.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 297 kB/s | 22 kB 00:00 2024-03-13T21:18:27.790 INFO:teuthology.orchestra.run.smithi195.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.8 MB/s | 863 kB 00:00 2024-03-13T21:18:28.324 INFO:teuthology.orchestra.run.smithi195.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 678 kB/s | 548 kB 00:00 2024-03-13T21:18:28.382 INFO:teuthology.orchestra.run.smithi195.stdout:(107/174): openssl-devel-3.0.7-27.el9.x86_64.rp 2.7 MB/s | 4.1 MB 00:01 2024-03-13T21:18:28.441 INFO:teuthology.orchestra.run.smithi195.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 167 kB/s | 19 kB 00:00 2024-03-13T21:18:28.550 INFO:teuthology.orchestra.run.smithi195.stdout:(109/174): gperftools-libs-2.9.1-2.el9.x86_64.r 407 kB/s | 309 kB 00:00 2024-03-13T21:18:28.575 INFO:teuthology.orchestra.run.smithi195.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 195 kB/s | 26 kB 00:00 2024-03-13T21:18:28.675 INFO:teuthology.orchestra.run.smithi195.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 388 kB/s | 49 kB 00:00 2024-03-13T21:18:28.700 INFO:teuthology.orchestra.run.smithi195.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 538 kB/s | 67 kB 00:00 2024-03-13T21:18:28.826 INFO:teuthology.orchestra.run.smithi195.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.0 MB/s | 151 kB 00:00 2024-03-13T21:18:28.926 INFO:teuthology.orchestra.run.smithi195.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.6 MB/s | 838 kB 00:00 2024-03-13T21:18:29.043 INFO:teuthology.orchestra.run.smithi195.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 373 kB/s | 43 kB 00:00 2024-03-13T21:18:29.068 INFO:teuthology.orchestra.run.smithi195.stdout:(116/174): python3-asyncssh-2.13.2-4.el9.noarch 2.2 MB/s | 548 kB 00:00 2024-03-13T21:18:29.152 INFO:teuthology.orchestra.run.smithi195.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 297 kB/s | 32 kB 00:00 2024-03-13T21:18:29.177 INFO:teuthology.orchestra.run.smithi195.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 138 kB/s | 15 kB 00:00 2024-03-13T21:18:29.269 INFO:teuthology.orchestra.run.smithi195.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-03-13T21:18:29.319 INFO:teuthology.orchestra.run.smithi195.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 2.5 MB/s | 358 kB 00:00 2024-03-13T21:18:29.395 INFO:teuthology.orchestra.run.smithi195.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-03-13T21:18:29.437 INFO:teuthology.orchestra.run.smithi195.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 302 kB/s | 35 kB 00:00 2024-03-13T21:18:29.562 INFO:teuthology.orchestra.run.smithi195.stdout:(123/174): libarrow-9.0.0-10.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-03-13T21:18:29.578 INFO:teuthology.orchestra.run.smithi195.stdout:(124/174): python3-google-auth-2.28.0-1.el9.noa 1.1 MB/s | 203 kB 00:00 2024-03-13T21:18:29.679 INFO:teuthology.orchestra.run.smithi195.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-03-13T21:18:29.704 INFO:teuthology.orchestra.run.smithi195.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 85 kB/s | 11 kB 00:00 2024-03-13T21:18:29.754 INFO:teuthology.orchestra.run.smithi195.stdout:(127/174): python3-grpcio-1.46.7-10.el9.x86_64. 6.4 MB/s | 2.0 MB 00:00 2024-03-13T21:18:29.788 INFO:teuthology.orchestra.run.smithi195.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 162 kB/s | 18 kB 00:00 2024-03-13T21:18:29.813 INFO:teuthology.orchestra.run.smithi195.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 213 kB/s | 23 kB 00:00 2024-03-13T21:18:29.863 INFO:teuthology.orchestra.run.smithi195.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 178 kB/s | 19 kB 00:00 2024-03-13T21:18:29.897 INFO:teuthology.orchestra.run.smithi195.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2024-03-13T21:18:29.948 INFO:teuthology.orchestra.run.smithi195.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-03-13T21:18:29.973 INFO:teuthology.orchestra.run.smithi195.stdout:(133/174): python3-logutils-0.3.5-21.el9.noarch 426 kB/s | 46 kB 00:00 2024-03-13T21:18:30.015 INFO:teuthology.orchestra.run.smithi195.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 673 kB/s | 79 kB 00:00 2024-03-13T21:18:30.073 INFO:teuthology.orchestra.run.smithi195.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 459 kB/s | 58 kB 00:00 2024-03-13T21:18:30.115 INFO:teuthology.orchestra.run.smithi195.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-03-13T21:18:30.141 INFO:teuthology.orchestra.run.smithi195.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 130 kB/s | 16 kB 00:00 2024-03-13T21:18:30.199 INFO:teuthology.orchestra.run.smithi195.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 716 kB/s | 90 kB 00:00 2024-03-13T21:18:30.233 INFO:teuthology.orchestra.run.smithi195.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 241 kB/s | 28 kB 00:00 2024-03-13T21:18:30.250 INFO:teuthology.orchestra.run.smithi195.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 283 kB/s | 31 kB 00:00 2024-03-13T21:18:30.317 INFO:teuthology.orchestra.run.smithi195.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-03-13T21:18:30.342 INFO:teuthology.orchestra.run.smithi195.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 543 kB/s | 59 kB 00:00 2024-03-13T21:18:30.359 INFO:teuthology.orchestra.run.smithi195.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 329 kB/s | 36 kB 00:00 2024-03-13T21:18:30.418 INFO:teuthology.orchestra.run.smithi195.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 507 kB/s | 51 kB 00:00 2024-03-13T21:18:30.460 INFO:teuthology.orchestra.run.smithi195.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-03-13T21:18:30.485 INFO:teuthology.orchestra.run.smithi195.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 714 kB/s | 90 kB 00:00 2024-03-13T21:18:30.543 INFO:teuthology.orchestra.run.smithi195.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-03-13T21:18:30.560 INFO:teuthology.orchestra.run.smithi195.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2024-03-13T21:18:30.603 INFO:teuthology.orchestra.run.smithi195.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-03-13T21:18:30.719 INFO:teuthology.orchestra.run.smithi195.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-03-13T21:18:30.844 INFO:teuthology.orchestra.run.smithi195.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 2.5 MB/s | 321 kB 00:00 2024-03-13T21:18:31.061 INFO:teuthology.orchestra.run.smithi195.stdout:(152/174): librbd1-19.0.0-2040.gd16d1766.el9.x8 7.3 MB/s | 3.1 MB 00:00 2024-03-13T21:18:31.111 INFO:teuthology.orchestra.run.smithi195.stdout:(153/174): NetworkManager-1.46.0-1.el9.x86_64.r 8.6 MB/s | 2.3 MB 00:00 2024-03-13T21:18:31.162 INFO:teuthology.orchestra.run.smithi195.stdout:(154/174): NetworkManager-team-1.46.0-1.el9.x86 848 kB/s | 42 kB 00:00 2024-03-13T21:18:31.212 INFO:teuthology.orchestra.run.smithi195.stdout:(155/174): NetworkManager-tui-1.46.0-1.el9.x86_ 4.9 MB/s | 248 kB 00:00 2024-03-13T21:18:31.262 INFO:teuthology.orchestra.run.smithi195.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2024-03-13T21:18:31.321 INFO:teuthology.orchestra.run.smithi195.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 626 kB/s | 36 kB 00:00 2024-03-13T21:18:31.388 INFO:teuthology.orchestra.run.smithi195.stdout:(158/174): NetworkManager-libnm-1.46.0-1.el9.x8 5.6 MB/s | 1.8 MB 00:00 2024-03-13T21:18:31.413 INFO:teuthology.orchestra.run.smithi195.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.0 MB/s | 192 kB 00:00 2024-03-13T21:18:31.438 INFO:teuthology.orchestra.run.smithi195.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-03-13T21:18:31.505 INFO:teuthology.orchestra.run.smithi195.stdout:(161/174): librados2-19.0.0-2040.gd16d1766.el9. 3.6 MB/s | 3.4 MB 00:00 2024-03-13T21:18:31.522 INFO:teuthology.orchestra.run.smithi195.stdout:(162/174): libacl-2.3.1-4.el9.x86_64.rpm 212 kB/s | 23 kB 00:00 2024-03-13T21:18:31.539 INFO:teuthology.orchestra.run.smithi195.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 108 kB 00:00 2024-03-13T21:18:31.573 INFO:teuthology.orchestra.run.smithi195.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 155 kB 00:00 2024-03-13T21:18:31.590 INFO:teuthology.orchestra.run.smithi195.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 64 kB 00:00 2024-03-13T21:18:31.615 INFO:teuthology.orchestra.run.smithi195.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 685 kB/s | 29 kB 00:00 2024-03-13T21:18:31.649 INFO:teuthology.orchestra.run.smithi195.stdout:(167/174): libmount-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 136 kB 00:00 2024-03-13T21:18:31.699 INFO:teuthology.orchestra.run.smithi195.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 26 MB/s | 2.2 MB 00:00 2024-03-13T21:18:31.741 INFO:teuthology.orchestra.run.smithi195.stdout:(169/174): openssl-3.0.7-27.el9.x86_64.rpm 8.0 MB/s | 1.2 MB 00:00 2024-03-13T21:18:31.774 INFO:teuthology.orchestra.run.smithi195.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 6.0 MB/s | 465 kB 00:00 2024-03-13T21:18:31.800 INFO:teuthology.orchestra.run.smithi195.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 532 kB/s | 31 kB 00:00 2024-03-13T21:18:31.858 INFO:teuthology.orchestra.run.smithi195.stdout:(172/174): util-linux-2.37.4-18.el9.x86_64.rpm 11 MB/s | 2.3 MB 00:00 2024-03-13T21:18:31.892 INFO:teuthology.orchestra.run.smithi195.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 9.2 MB/s | 1.1 MB 00:00 2024-03-13T21:18:31.984 INFO:teuthology.orchestra.run.smithi195.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 404 kB/s | 74 kB 00:00 2024-03-13T21:18:31.990 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2024-03-13T21:18:31.990 INFO:teuthology.orchestra.run.smithi195.stdout:Total 17 MB/s | 224 MB 00:13 2024-03-13T21:18:32.438 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2024-03-13T21:18:32.747 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2024-03-13T21:18:32.747 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2024-03-13T21:18:34.789 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2024-03-13T21:18:34.789 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2024-03-13T21:18:41.746 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2024-03-13T21:18:41.846 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-13T21:18:41.881 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-13T21:18:41.927 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-13T21:18:41.937 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-13T21:18:41.981 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-13T21:18:42.039 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-13T21:18:42.072 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-13T21:18:42.103 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-13T21:18:42.155 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-13T21:18:42.500 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-13T21:18:42.563 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados2-2:19.0.0-2040.gd16d1766.el9.x86_64 10/198 2024-03-13T21:18:42.669 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:19.0.0-2040.gd16d1766.el9.x86_64 10/198 2024-03-13T21:18:42.706 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs2-2:19.0.0-2040.gd16d1766.el9.x86_64 11/198 2024-03-13T21:18:42.797 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:19.0.0-2040.gd16d1766.el9.x86_64 11/198 2024-03-13T21:18:42.834 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rados-2:19.0.0-2040.gd16d1766.el9.x86_64 12/198 2024-03-13T21:18:42.874 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-13T21:18:43.071 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-13T21:18:43.124 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-13T21:18:43.152 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephsqlite-2:19.0.0-2040.gd16d1766.el9.x86_64 16/198 2024-03-13T21:18:43.240 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2040.gd16d1766.el9.x86_64 16/198 2024-03-13T21:18:43.261 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libradosstriper1-2:19.0.0-2040.gd16d1766.el9.x86 17/198 2024-03-13T21:18:43.310 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2040.gd16d1766.el9.x86 17/198 2024-03-13T21:18:43.349 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-13T21:18:43.372 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-13T21:18:43.387 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-13T21:18:43.538 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-13T21:18:43.578 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-13T21:18:43.618 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-13T21:18:43.807 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-13T21:18:43.963 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-13T21:18:44.024 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-13T21:18:44.140 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-13T21:18:44.191 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-13T21:18:44.409 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-13T21:18:44.524 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-13T21:18:44.617 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-13T21:18:44.672 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-13T21:18:44.699 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-13T21:18:44.742 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-13T21:18:44.825 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-13T21:18:44.878 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-13T21:18:44.916 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-13T21:18:44.980 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-13T21:18:45.015 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-13T21:18:45.059 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-13T21:18:45.092 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-13T21:18:45.119 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-13T21:18:45.188 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-13T21:18:45.224 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-common-2:19.0.0-2040.gd16d1766.el9. 39/198 2024-03-13T21:18:45.268 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-argparse-2:19.0.0-2040.gd16d1766.el 40/198 2024-03-13T21:18:45.304 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cephfs-2:19.0.0-2040.gd16d1766.el9.x86_6 41/198 2024-03-13T21:18:45.372 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-13T21:18:45.419 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-13T21:18:45.492 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-13T21:18:45.625 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-13T21:18:45.679 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-13T21:18:46.199 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-13T21:18:46.274 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-13T21:18:46.354 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-13T21:18:46.395 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-13T21:18:46.403 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-13T21:18:46.442 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-13T21:18:46.485 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-13T21:18:46.513 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados-devel-2:19.0.0-2040.gd16d1766.el9.x86_6 53/198 2024-03-13T21:18:46.544 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-13T21:18:46.795 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-13T21:18:46.997 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-13T21:18:47.073 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-13T21:18:47.117 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-13T21:18:47.520 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-13T21:18:47.586 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-13T21:18:47.641 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-13T21:18:47.714 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-13T21:18:47.745 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-13T21:18:47.794 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-13T21:18:47.845 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-13T21:18:47.881 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-13T21:18:47.924 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-13T21:18:47.966 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-13T21:18:48.099 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-13T21:18:48.138 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-13T21:18:48.168 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-13T21:18:48.210 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-13T21:18:48.303 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-13T21:18:48.344 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-13T21:18:48.384 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-13T21:18:48.409 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-13T21:18:48.434 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-13T21:18:48.512 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-13T21:18:48.634 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-13T21:18:48.759 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-13T21:18:48.801 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-13T21:18:48.849 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-13T21:18:48.905 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-13T21:18:49.088 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-13T21:18:49.138 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-13T21:18:49.265 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-13T21:18:49.303 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 87/198 2024-03-13T21:18:49.334 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-13T21:18:49.365 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-13T21:18:49.393 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-13T21:18:49.427 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-13T21:18:49.475 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-13T21:18:49.507 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-13T21:18:49.537 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-13T21:18:49.612 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-13T21:18:49.647 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-13T21:18:49.680 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-13T21:18:49.721 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-13T21:18:49.756 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-13T21:18:49.845 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-13T21:18:49.935 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-13T21:18:49.979 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-13T21:18:50.019 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-13T21:18:50.065 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-13T21:18:50.162 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-13T21:18:50.220 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-13T21:18:50.943 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-13T21:18:50.992 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-13T21:18:51.025 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-13T21:18:51.073 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-13T21:18:51.152 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-13T21:18:51.185 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-13T21:18:51.361 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-13T21:18:51.383 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-13T21:18:51.461 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-13T21:18:52.095 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-13T21:18:52.199 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-13T21:18:53.596 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-13T21:18:53.685 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-13T21:18:53.716 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-13T21:18:53.747 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-13T21:18:53.775 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-13T21:18:54.088 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-13T21:18:54.121 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librbd1-2:19.0.0-2040.gd16d1766.el9.x86_64 124/198 2024-03-13T21:18:54.212 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:19.0.0-2040.gd16d1766.el9.x86_64 124/198 2024-03-13T21:18:54.243 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rbd-2:19.0.0-2040.gd16d1766.el9.x86_64 125/198 2024-03-13T21:18:54.280 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-13T21:18:54.739 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-13T21:18:54.766 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librgw2-2:19.0.0-2040.gd16d1766.el9.x86_64 128/198 2024-03-13T21:18:54.862 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:19.0.0-2040.gd16d1766.el9.x86_64 128/198 2024-03-13T21:18:54.893 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rgw-2:19.0.0-2040.gd16d1766.el9.x86_64 129/198 2024-03-13T21:18:57.003 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:19.0.0-2040.gd16d1766.el9.x86_64 130/198 2024-03-13T21:18:57.039 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-common-2:19.0.0-2040.gd16d1766.el9.x86_64 130/198 2024-03-13T21:18:57.584 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:19.0.0-2040.gd16d1766.el9.x86_64 130/198 2024-03-13T21:18:57.617 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-base-2:19.0.0-2040.gd16d1766.el9.x86_64 131/198 2024-03-13T21:18:57.707 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:19.0.0-2040.gd16d1766.el9.x86_64 131/198 2024-03-13T21:18:57.707 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-13T21:18:57.707 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-13T21:18:57.708 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:18:57.752 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-selinux-2:19.0.0-2040.gd16d1766.el9.x86_64 132/198 2024-03-13T21:19:09.689 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2040.gd16d1766.el9.x86_64 132/198 2024-03-13T21:19:09.689 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /sys 2024-03-13T21:19:09.689 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /proc 2024-03-13T21:19:09.689 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /mnt 2024-03-13T21:19:09.689 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /var/tmp 2024-03-13T21:19:09.689 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /home 2024-03-13T21:19:09.689 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /root 2024-03-13T21:19:09.689 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /tmp 2024-03-13T21:19:09.690 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:09.857 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-volume-2:19.0.0-2040.gd16d1766.el9.noarch 133/198 2024-03-13T21:19:09.873 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-volume-2:19.0.0-2040.gd16d1766.el9.noarch 133/198 2024-03-13T21:19:09.873 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-13T21:19:09.873 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-13T21:19:09.873 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:11.352 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-osd-2:19.0.0-2040.gd16d1766.el9.x86_64 134/198 2024-03-13T21:19:11.377 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:19.0.0-2040.gd16d1766.el9.x86_64 134/198 2024-03-13T21:19:11.377 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-13T21:19:11.377 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-13T21:19:11.377 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-13T21:19:11.377 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-13T21:19:11.377 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:11.602 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mds-2:19.0.0-2040.gd16d1766.el9.x86_64 135/198 2024-03-13T21:19:11.625 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:19.0.0-2040.gd16d1766.el9.x86_64 135/198 2024-03-13T21:19:11.625 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-13T21:19:11.625 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-13T21:19:11.625 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-13T21:19:11.625 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-13T21:19:11.625 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:12.069 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mon-2:19.0.0-2040.gd16d1766.el9.x86_64 136/198 2024-03-13T21:19:12.092 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:19.0.0-2040.gd16d1766.el9.x86_64 136/198 2024-03-13T21:19:12.092 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-13T21:19:12.092 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-13T21:19:12.092 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-13T21:19:12.092 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-13T21:19:12.092 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:12.188 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-13T21:19:12.642 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:19.0.0-2040.gd16d1766.el9.noarch 138/198 2024-03-13T21:19:12.669 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephadm-2:19.0.0-2040.gd16d1766.el9.noarch 138/198 2024-03-13T21:19:12.702 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2040.gd16d1766.e 139/198 2024-03-13T21:19:12.761 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2040.gd16d1766. 140/198 2024-03-13T21:19:12.784 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2040.gd16d1766.el9.noa 141/198 2024-03-13T21:19:13.018 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2040.gd16d1766.el9.noa 141/198 2024-03-13T21:19:13.052 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2040.gd16d1766.el9.n 142/198 2024-03-13T21:19:14.019 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2040.gd16d1766.el9.n 142/198 2024-03-13T21:19:14.044 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2040.gd16 143/198 2024-03-13T21:19:14.144 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2040.gd16 143/198 2024-03-13T21:19:14.306 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2040.gd16d1766.el 144/198 2024-03-13T21:19:14.346 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-2:19.0.0-2040.gd16d1766.el9.x86_64 145/198 2024-03-13T21:19:14.368 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2040.gd16d1766.el9.x86_64 145/198 2024-03-13T21:19:14.368 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-13T21:19:14.369 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-13T21:19:14.369 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-13T21:19:14.369 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-13T21:19:14.369 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:14.422 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-rook-2:19.0.0-2040.gd16d1766.el9.noarch 146/198 2024-03-13T21:19:14.432 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2040.gd16d1766.el9.noarch 146/198 2024-03-13T21:19:14.501 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-2:19.0.0-2040.gd16d1766.el9.x86_64 147/198 2024-03-13T21:19:15.368 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-13T21:19:15.407 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-radosgw-2:19.0.0-2040.gd16d1766.el9.x86_64 149/198 2024-03-13T21:19:15.430 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2040.gd16d1766.el9.x86_64 149/198 2024-03-13T21:19:15.430 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-13T21:19:15.430 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-13T21:19:15.430 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-13T21:19:15.430 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-13T21:19:15.430 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:15.474 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2040.gd16d1 150/198 2024-03-13T21:19:15.495 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2040.gd16d1 150/198 2024-03-13T21:19:15.496 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-13T21:19:15.496 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-13T21:19:15.496 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:15.542 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-mirror-2:19.0.0-2040.gd16d1766.el9.x86_64 151/198 2024-03-13T21:19:15.564 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2040.gd16d1766.el9.x86_64 151/198 2024-03-13T21:19:15.564 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-13T21:19:15.564 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-13T21:19:15.564 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-13T21:19:15.564 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-13T21:19:15.564 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:15.876 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-mirror-2:19.0.0-2040.gd16d1766.el9.x86_64 152/198 2024-03-13T21:19:15.898 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2040.gd16d1766.el9.x86_64 152/198 2024-03-13T21:19:15.898 INFO:teuthology.orchestra.run.smithi195.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-13T21:19:15.898 INFO:teuthology.orchestra.run.smithi195.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-13T21:19:15.898 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-13T21:19:15.899 INFO:teuthology.orchestra.run.smithi195.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-13T21:19:15.899 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:20.347 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-test-2:19.0.0-2040.gd16d1766.el9.x86_64 153/198 2024-03-13T21:19:20.388 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-fuse-2:19.0.0-2040.gd16d1766.el9.x86_64 154/198 2024-03-13T21:19:20.427 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-nbd-2:19.0.0-2040.gd16d1766.el9.x86_64 155/198 2024-03-13T21:19:20.454 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-13T21:19:20.641 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-shell-2:19.0.0-2040.gd16d1766.el9.x86_64 157/198 2024-03-13T21:19:20.753 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-13T21:19:20.810 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-fuse-2:19.0.0-2040.gd16d1766.el9.x86_64 159/198 2024-03-13T21:19:20.863 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-13T21:19:20.911 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-13T21:19:20.946 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-13T21:19:20.970 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs-devel-2:19.0.0-2040.gd16d1766.el9.x86_ 163/198 2024-03-13T21:19:21.011 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-13T21:19:21.040 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-13T21:19:21.100 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-13T21:19:21.161 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-13T21:19:21.189 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-13T21:19:21.765 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-13T21:19:21.803 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-13T21:19:21.822 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-13T21:19:22.643 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-top-2:19.0.0-2040.gd16d1766.el9.noarch 170/198 2024-03-13T21:19:22.707 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-13T21:19:22.740 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-13T21:19:22.822 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-13T21:19:22.861 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-13T21:19:22.886 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-13T21:19:22.911 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-13T21:19:22.938 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-13T21:19:22.938 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-13T21:19:23.025 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-13T21:19:23.055 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-13T21:19:23.055 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-13T21:19:23.132 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-13T21:19:23.158 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-13T21:19:23.199 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-13T21:19:23.225 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-13T21:19:23.250 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-13T21:19:23.283 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-13T21:19:23.331 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-13T21:19:23.371 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-13T21:19:23.396 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-13T21:19:23.422 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-13T21:19:23.447 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-13T21:19:23.472 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-13T21:19:23.479 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-13T21:19:23.479 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-13T21:19:23.658 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-13T21:19:23.659 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-13T21:19:23.741 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-13T21:19:23.768 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-13T21:19:23.794 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-13T21:19:23.827 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-13T21:19:23.853 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-13T21:19:23.919 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-13T21:19:28.781 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-13T21:19:28.781 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:19.0.0-2040.gd16d1766.el9.x86_64 1/198 2024-03-13T21:19:28.781 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:19.0.0-2040.gd16d1766.el9.x86_64 2/198 2024-03-13T21:19:28.781 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:19.0.0-2040.gd16d1766.el9.x86_64 3/198 2024-03-13T21:19:28.781 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:19.0.0-2040.gd16d1766.el9.x86_64 4/198 2024-03-13T21:19:28.781 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2040.gd16d1 5/198 2024-03-13T21:19:28.781 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:19.0.0-2040.gd16d1766.el9.x86_64 6/198 2024-03-13T21:19:28.781 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:19.0.0-2040.gd16d1766.el9.x86_64 7/198 2024-03-13T21:19:28.781 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:19.0.0-2040.gd16d1766.el9.x86_64 8/198 2024-03-13T21:19:28.782 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:19.0.0-2040.gd16d1766.el9.x86_64 9/198 2024-03-13T21:19:28.782 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:19.0.0-2040.gd16d1766.el9.x86_64 10/198 2024-03-13T21:19:28.782 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:19.0.0-2040.gd16d1766.el9.x86_64 11/198 2024-03-13T21:19:28.782 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:19.0.0-2040.gd16d1766.el9.x86_64 12/198 2024-03-13T21:19:28.782 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-mirror-2:19.0.0-2040.gd16d1766.el9.x86_64 13/198 2024-03-13T21:19:28.782 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-shell-2:19.0.0-2040.gd16d1766.el9.x86_64 14/198 2024-03-13T21:19:28.782 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:19.0.0-2040.gd16d1766.el9.x86_ 15/198 2024-03-13T21:19:28.782 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:19.0.0-2040.gd16d1766.el9.x86_64 16/198 2024-03-13T21:19:28.782 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:19.0.0-2040.gd16d1766.el9.x86_64 17/198 2024-03-13T21:19:28.782 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:19.0.0-2040.gd16d1766.el9.x86_6 18/198 2024-03-13T21:19:28.782 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:19.0.0-2040.gd16d1766.el9.x86 19/198 2024-03-13T21:19:28.783 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:19.0.0-2040.gd16d1766.el9.x86_64 20/198 2024-03-13T21:19:28.783 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2040.gd16d1766.el 21/198 2024-03-13T21:19:28.783 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:19.0.0-2040.gd16d1766.el9. 22/198 2024-03-13T21:19:28.783 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:19.0.0-2040.gd16d1766.el9.x86_6 23/198 2024-03-13T21:19:28.783 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:19.0.0-2040.gd16d1766.el9.x86_64 24/198 2024-03-13T21:19:28.783 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:19.0.0-2040.gd16d1766.el9.x86_64 25/198 2024-03-13T21:19:28.783 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:19.0.0-2040.gd16d1766.el9.x86_64 26/198 2024-03-13T21:19:28.783 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:19.0.0-2040.gd16d1766.el9.x86_64 27/198 2024-03-13T21:19:28.783 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:19.0.0-2040.gd16d1766.el9.x86_64 28/198 2024-03-13T21:19:28.783 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:19.0.0-2040.gd16d1766.el9.x86_64 29/198 2024-03-13T21:19:28.783 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2040.gd16d1766. 30/198 2024-03-13T21:19:28.783 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2040.gd16d1766.el9.noa 31/198 2024-03-13T21:19:28.783 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2040.gd16d1766.el9.n 32/198 2024-03-13T21:19:28.784 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2040.gd16 33/198 2024-03-13T21:19:28.784 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2040.gd16d1766.el 34/198 2024-03-13T21:19:28.784 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2040.gd16d1766.el9.noarch 35/198 2024-03-13T21:19:28.784 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2040.gd16d1766.e 36/198 2024-03-13T21:19:28.784 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-volume-2:19.0.0-2040.gd16d1766.el9.noarch 37/198 2024-03-13T21:19:28.784 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephadm-2:19.0.0-2040.gd16d1766.el9.noarch 38/198 2024-03-13T21:19:28.784 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-top-2:19.0.0-2040.gd16d1766.el9.noarch 39/198 2024-03-13T21:19:28.784 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-13T21:19:28.784 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-13T21:19:28.784 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-13T21:19:28.784 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-13T21:19:28.784 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-13T21:19:28.784 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-13T21:19:28.785 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-13T21:19:28.785 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-13T21:19:28.785 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-13T21:19:28.785 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-13T21:19:28.785 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-13T21:19:28.785 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-13T21:19:28.785 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-13T21:19:28.785 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-13T21:19:28.785 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-13T21:19:28.785 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-13T21:19:28.785 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-13T21:19:28.785 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-13T21:19:28.785 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-13T21:19:28.786 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-13T21:19:28.786 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-13T21:19:28.786 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-13T21:19:28.786 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-13T21:19:28.786 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-13T21:19:28.786 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-13T21:19:28.786 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-13T21:19:28.786 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-13T21:19:28.786 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-13T21:19:28.786 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-13T21:19:28.786 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-13T21:19:28.786 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-13T21:19:28.786 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-13T21:19:28.787 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-13T21:19:28.787 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-13T21:19:28.787 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-13T21:19:28.787 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-13T21:19:28.787 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-13T21:19:28.787 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-13T21:19:28.787 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-13T21:19:28.787 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-13T21:19:28.787 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-13T21:19:28.787 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-13T21:19:28.787 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-13T21:19:28.787 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-13T21:19:28.787 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-13T21:19:28.788 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-13T21:19:28.788 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-13T21:19:28.788 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-13T21:19:28.788 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-13T21:19:28.788 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-13T21:19:28.788 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-13T21:19:28.788 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-13T21:19:28.788 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-13T21:19:28.788 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-13T21:19:28.788 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-13T21:19:28.788 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-13T21:19:28.788 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-13T21:19:28.788 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-13T21:19:28.789 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-13T21:19:28.789 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-13T21:19:28.789 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-13T21:19:28.789 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-13T21:19:28.789 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-13T21:19:28.789 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-13T21:19:28.789 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-13T21:19:28.789 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-13T21:19:28.789 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-13T21:19:28.789 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-13T21:19:28.789 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-13T21:19:28.789 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-13T21:19:28.789 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-13T21:19:28.789 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-13T21:19:28.790 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-13T21:19:28.790 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-13T21:19:28.790 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-13T21:19:28.790 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-13T21:19:28.790 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-13T21:19:28.790 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-13T21:19:28.790 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-13T21:19:28.790 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-13T21:19:28.790 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-13T21:19:28.790 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-13T21:19:28.790 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-13T21:19:28.790 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-13T21:19:28.790 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-13T21:19:28.791 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-13T21:19:28.791 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-13T21:19:28.791 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-13T21:19:28.791 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-13T21:19:28.791 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-13T21:19:28.791 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-13T21:19:28.791 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-13T21:19:28.791 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-13T21:19:28.791 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-13T21:19:28.791 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-13T21:19:28.791 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-13T21:19:28.791 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-13T21:19:28.791 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-13T21:19:28.791 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-13T21:19:28.791 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-13T21:19:28.792 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-13T21:19:28.792 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-13T21:19:28.792 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-13T21:19:28.792 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-13T21:19:28.792 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-13T21:19:28.792 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-13T21:19:28.792 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-13T21:19:28.792 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-13T21:19:28.792 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-13T21:19:28.792 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-13T21:19:28.792 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-13T21:19:28.792 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:19.0.0-2040.gd16d1766.el9.x86_64 151/198 2024-03-13T21:19:28.792 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-13T21:19:28.793 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:19.0.0-2040.gd16d1766.el9.x86_64 153/198 2024-03-13T21:19:28.793 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-13T21:19:28.793 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-13T21:19:28.793 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-13T21:19:28.793 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/198 2024-03-13T21:19:28.793 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-13T21:19:28.793 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/198 2024-03-13T21:19:28.793 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-13T21:19:28.793 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/198 2024-03-13T21:19:28.793 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-13T21:19:28.793 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/198 2024-03-13T21:19:28.793 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-13T21:19:28.793 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-13T21:19:28.793 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-13T21:19:28.794 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-13T21:19:28.794 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-13T21:19:28.794 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-13T21:19:28.794 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-13T21:19:28.794 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-13T21:19:28.794 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-13T21:19:28.794 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-13T21:19:28.794 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-13T21:19:28.794 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-13T21:19:28.794 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-13T21:19:28.794 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-13T21:19:28.794 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-13T21:19:28.794 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-13T21:19:28.794 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-13T21:19:28.795 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-13T21:19:28.795 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-13T21:19:28.795 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-13T21:19:28.795 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-13T21:19:28.795 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-13T21:19:28.795 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-13T21:19:28.795 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-13T21:19:28.795 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-13T21:19:28.795 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-13T21:19:28.795 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-13T21:19:28.795 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-13T21:19:28.795 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-13T21:19:28.795 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-13T21:19:28.795 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-13T21:19:28.795 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-13T21:19:28.796 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-13T21:19:28.796 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-13T21:19:31.623 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-13T21:19:31.623 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:31.623 INFO:teuthology.orchestra.run.smithi195.stdout:Upgraded: 2024-03-13T21:19:31.623 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-13T21:19:31.623 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-13T21:19:31.623 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-13T21:19:31.623 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-13T21:19:31.624 INFO:teuthology.orchestra.run.smithi195.stdout: acl-2.3.1-4.el9.x86_64 2024-03-13T21:19:31.624 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-13T21:19:31.624 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-13T21:19:31.624 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-13T21:19:31.624 INFO:teuthology.orchestra.run.smithi195.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-13T21:19:31.624 INFO:teuthology.orchestra.run.smithi195.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-13T21:19:31.624 INFO:teuthology.orchestra.run.smithi195.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-13T21:19:31.624 INFO:teuthology.orchestra.run.smithi195.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-13T21:19:31.624 INFO:teuthology.orchestra.run.smithi195.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-13T21:19:31.624 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.624 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.624 INFO:teuthology.orchestra.run.smithi195.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-13T21:19:31.624 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-13T21:19:31.624 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-13T21:19:31.625 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-13T21:19:31.625 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-13T21:19:31.625 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-13T21:19:31.625 INFO:teuthology.orchestra.run.smithi195.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-13T21:19:31.625 INFO:teuthology.orchestra.run.smithi195.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-13T21:19:31.625 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-13T21:19:31.625 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2024-03-13T21:19:31.625 INFO:teuthology.orchestra.run.smithi195.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-13T21:19:31.625 INFO:teuthology.orchestra.run.smithi195.stdout: automake-1.16.2-8.el9.noarch 2024-03-13T21:19:31.625 INFO:teuthology.orchestra.run.smithi195.stdout: bison-3.7.4-5.el9.x86_64 2024-03-13T21:19:31.625 INFO:teuthology.orchestra.run.smithi195.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-13T21:19:31.625 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.625 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.625 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.626 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.626 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:19:31.626 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.626 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.626 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.626 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:19:31.626 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:19:31.626 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:19:31.626 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:19:31.626 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:19:31.626 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.626 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.627 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:19:31.627 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.627 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.627 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.627 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:19:31.627 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:19:31.627 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.627 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-shell-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.627 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-top-2:19.0.0-2040.gd16d1766.el9.noarch 2024-03-13T21:19:31.627 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-13T21:19:31.627 INFO:teuthology.orchestra.run.smithi195.stdout: flex-2.6.4-9.el9.x86_64 2024-03-13T21:19:31.627 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-13T21:19:31.627 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-13T21:19:31.627 INFO:teuthology.orchestra.run.smithi195.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-13T21:19:31.627 INFO:teuthology.orchestra.run.smithi195.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-13T21:19:31.628 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-13T21:19:31.628 INFO:teuthology.orchestra.run.smithi195.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-13T21:19:31.628 INFO:teuthology.orchestra.run.smithi195.stdout: jq-1.6-16.el9.x86_64 2024-03-13T21:19:31.628 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-13T21:19:31.628 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-13T21:19:31.628 INFO:teuthology.orchestra.run.smithi195.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-13T21:19:31.628 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.628 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.628 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.628 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-13T21:19:31.628 INFO:teuthology.orchestra.run.smithi195.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-13T21:19:31.628 INFO:teuthology.orchestra.run.smithi195.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-13T21:19:31.628 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-13T21:19:31.628 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-13T21:19:31.628 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.629 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.629 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-13T21:19:31.629 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.629 INFO:teuthology.orchestra.run.smithi195.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-13T21:19:31.629 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-13T21:19:31.629 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-13T21:19:31.629 INFO:teuthology.orchestra.run.smithi195.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-13T21:19:31.629 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-13T21:19:31.629 INFO:teuthology.orchestra.run.smithi195.stdout: lua-5.4.4-4.el9.x86_64 2024-03-13T21:19:31.629 INFO:teuthology.orchestra.run.smithi195.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-13T21:19:31.629 INFO:teuthology.orchestra.run.smithi195.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-13T21:19:31.629 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-13T21:19:31.629 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-13T21:19:31.629 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-13T21:19:31.629 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-13T21:19:31.630 INFO:teuthology.orchestra.run.smithi195.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-13T21:19:31.630 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-13.11-1.el9.x86_64 2024-03-13T21:19:31.630 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-13T21:19:31.630 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-13T21:19:31.630 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-13T21:19:31.630 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-13T21:19:31.630 INFO:teuthology.orchestra.run.smithi195.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-13T21:19:31.630 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-13T21:19:31.630 INFO:teuthology.orchestra.run.smithi195.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-13T21:19:31.630 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-13T21:19:31.630 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-13T21:19:31.630 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-13T21:19:31.630 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.631 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.631 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.631 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-13T21:19:31.631 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-13T21:19:31.631 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-13T21:19:31.631 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-13T21:19:31.631 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-13T21:19:31.631 INFO:teuthology.orchestra.run.smithi195.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-13T21:19:31.631 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-13T21:19:31.631 INFO:teuthology.orchestra.run.smithi195.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-13T21:19:31.631 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-13T21:19:31.631 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-13T21:19:31.631 INFO:teuthology.orchestra.run.smithi195.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-13T21:19:31.631 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-13T21:19:31.632 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-13T21:19:31.632 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-13T21:19:31.632 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-13T21:19:31.632 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-13T21:19:31.632 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-13T21:19:31.632 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-13T21:19:31.632 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-13T21:19:31.632 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-13T21:19:31.632 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-13T21:19:31.632 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-13T21:19:31.632 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-13T21:19:31.632 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-13T21:19:31.632 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-13T21:19:31.632 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-13T21:19:31.632 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-13T21:19:31.633 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-13T21:19:31.633 INFO:teuthology.orchestra.run.smithi195.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-13T21:19:31.633 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-13T21:19:31.633 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ply-3.11-14.el9.noarch 2024-03-13T21:19:31.633 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-13T21:19:31.633 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-13T21:19:31.633 INFO:teuthology.orchestra.run.smithi195.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-13T21:19:31.633 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-13T21:19:31.633 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-13T21:19:31.633 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-13T21:19:31.633 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-13T21:19:31.633 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-13T21:19:31.633 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-13T21:19:31.633 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.634 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.634 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-13T21:19:31.634 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-13T21:19:31.634 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-13T21:19:31.634 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.634 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-13T21:19:31.634 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-13T21:19:31.634 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-13T21:19:31.634 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-13T21:19:31.634 INFO:teuthology.orchestra.run.smithi195.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-13T21:19:31.634 INFO:teuthology.orchestra.run.smithi195.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-13T21:19:31.634 INFO:teuthology.orchestra.run.smithi195.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-13T21:19:31.634 INFO:teuthology.orchestra.run.smithi195.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-13T21:19:31.634 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-13T21:19:31.635 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-13T21:19:31.635 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-13T21:19:31.635 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-13T21:19:31.635 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-13T21:19:31.635 INFO:teuthology.orchestra.run.smithi195.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-13T21:19:31.635 INFO:teuthology.orchestra.run.smithi195.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-13T21:19:31.635 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.635 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.635 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-2:19.0.0-2040.gd16d1766.el9.x86_64 2024-03-13T21:19:31.635 INFO:teuthology.orchestra.run.smithi195.stdout: re2-1:20211101-3.el9.x86_64 2024-03-13T21:19:31.635 INFO:teuthology.orchestra.run.smithi195.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-13T21:19:31.635 INFO:teuthology.orchestra.run.smithi195.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-13T21:19:31.635 INFO:teuthology.orchestra.run.smithi195.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-13T21:19:31.635 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-13T21:19:31.636 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-13T21:19:31.636 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-13T21:19:31.636 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:31.636 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2024-03-13T21:19:32.284 DEBUG:teuthology.parallel:result is None 2024-03-13T21:19:32.285 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d16d1766eb379253122a6acda1cdd17a0b9c3aa3 2024-03-13T21:19:32.423 DEBUG:teuthology.orchestra.run.smithi107:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-13T21:19:32.449 INFO:teuthology.orchestra.run.smithi107.stdout:19.0.0-2040.gd16d1766.el9 2024-03-13T21:19:32.450 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2040.gd16d1766.el9 2024-03-13T21:19:32.450 INFO:teuthology.task.install:The correct ceph version 19.0.0-2040.gd16d1766 is installed. 2024-03-13T21:19:32.452 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d16d1766eb379253122a6acda1cdd17a0b9c3aa3 2024-03-13T21:19:32.803 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-13T21:19:32.826 INFO:teuthology.orchestra.run.smithi195.stdout:19.0.0-2040.gd16d1766.el9 2024-03-13T21:19:32.827 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2040.gd16d1766.el9 2024-03-13T21:19:32.827 INFO:teuthology.task.install:The correct ceph version 19.0.0-2040.gd16d1766 is installed. 2024-03-13T21:19:32.829 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-13T21:19:32.830 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:19:32.830 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-13T21:19:32.866 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:19:32.866 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-13T21:19:32.897 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-13T21:19:32.897 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:19:32.897 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/daemon-helper 2024-03-13T21:19:32.937 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-13T21:19:33.006 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:19:33.006 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2024-03-13T21:19:33.034 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-13T21:19:33.101 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-13T21:19:33.102 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:19:33.102 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-13T21:19:33.129 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-13T21:19:33.197 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:19:33.197 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-13T21:19:33.223 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-13T21:19:33.290 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-13T21:19:33.290 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:19:33.290 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/usr/bin/stdin-killer 2024-03-13T21:19:33.317 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-13T21:19:33.385 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:19:33.385 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2024-03-13T21:19:33.412 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-13T21:19:33.479 INFO:teuthology.run_tasks:Running task ceph... 2024-03-13T21:19:33.565 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-13T21:19:33.566 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 777 /var/log/ceph 2024-03-13T21:19:33.568 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /var/log/ceph 2024-03-13T21:19:33.594 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-13T21:19:33.594 DEBUG:teuthology.orchestra.run.smithi107:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-13T21:19:33.635 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-13T21:19:33.662 INFO:tasks.ceph:Creating extra log directories... 2024-03-13T21:19:33.662 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-13T21:19:33.702 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-13T21:19:33.735 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-13T21:19:33.735 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-13T21:19:33.735 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-13T21:19:33.736 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:19:33.736 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-13T21:19:33.780 DEBUG:teuthology.orchestra.run.smithi107:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-13T21:19:33.897 DEBUG:teuthology.orchestra.run.smithi107:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-13T21:19:33.923 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:19:33.923 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-13T21:19:33.938 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-13T21:19:34.057 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-13T21:19:34.088 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-13T21:19:34.089 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-13T21:19:34.089 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-03-13_20:49:58-fs-wip-batrick-testing-20240310.014948-distro-default-smithi/7599076', 'branch': 'wip-batrick-testing-20240310.014948', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/xfstests-dev}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7599076', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-03-13_20:49:58-fs-wip-batrick-testing-20240310.014948-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20240310.014948'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': 'd16d1766eb379253122a6acda1cdd17a0b9c3aa3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd16d1766eb379253122a6acda1cdd17a0b9c3aa3'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20240310.014948', 'sha1': '32d4e26ee101db040501914293e54a3c24a95078'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6353, 'sha1': 'd16d1766eb379253122a6acda1cdd17a0b9c3aa3', 'sleep_before_teardown': 0, 'subset': '383/512', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20240310.014948', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_32d4e26ee101db040501914293e54a3c24a95078/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph', 'suite_sha1': '32d4e26ee101db040501914293e54a3c24a95078', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi107.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOZxHcA86ARQd6MPWVKCTPUi0oGlMriafLFoAvI3Pl22si158mDSGLl3Vx045nPTRFc0Ask67FTW8ndsVCpkwP0=', 'smithi195.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCc1sGTqdXRxUtV8KU0dAcVQf0q3mNEx7nEdcJekZ+2lHu4LHLcOEC4PwEBT7xn+h15il8X/B478BiMJB1OqrVs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd16d1766eb379253122a6acda1cdd17a0b9c3aa3'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': 'd16d1766eb379253122a6acda1cdd17a0b9c3aa3', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-13_20:49:58', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-13T21:19:34.089 DEBUG:teuthology.orchestra.run.smithi107:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-13T21:19:34.091 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-13T21:19:34.140 DEBUG:teuthology.orchestra.run.smithi107:> sudo install -d -m0777 -- /var/run/ceph 2024-03-13T21:19:34.146 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m0777 -- /var/run/ceph 2024-03-13T21:19:34.207 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:19:34.207 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/scratch_devs of=/dev/stdout 2024-03-13T21:19:34.226 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-13T21:19:34.227 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_1 2024-03-13T21:19:34.282 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-13T21:19:34.282 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-13T21:19:34.282 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-03-13T21:19:34.282 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-13T21:19:34.282 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-03-13T21:19:34.282 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-03-13 21:15:32.806531476 +0000 2024-03-13T21:19:34.282 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-03-13 21:13:31.876576230 +0000 2024-03-13T21:19:34.282 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-03-13 21:13:31.876576230 +0000 2024-03-13T21:19:34.282 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-03-13 21:13:31.876576230 +0000 2024-03-13T21:19:34.282 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-13T21:19:34.347 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-03-13T21:19:34.347 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-03-13T21:19:34.347 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000240842 s, 2.1 MB/s 2024-03-13T21:19:34.348 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-13T21:19:34.403 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_2 2024-03-13T21:19:34.459 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-13T21:19:34.459 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-13T21:19:34.459 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-03-13T21:19:34.459 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-13T21:19:34.459 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-03-13T21:19:34.459 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-03-13 21:15:32.806531476 +0000 2024-03-13T21:19:34.459 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-03-13 21:13:32.229570162 +0000 2024-03-13T21:19:34.459 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-03-13 21:13:32.229570162 +0000 2024-03-13T21:19:34.459 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-03-13 21:13:32.229570162 +0000 2024-03-13T21:19:34.459 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-13T21:19:34.524 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-03-13T21:19:34.524 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-03-13T21:19:34.524 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000202356 s, 2.5 MB/s 2024-03-13T21:19:34.525 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-13T21:19:34.580 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_3 2024-03-13T21:19:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-13T21:19:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-13T21:19:34.636 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-03-13T21:19:34.636 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-13T21:19:34.636 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-03-13T21:19:34.636 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-03-13 21:15:32.806531476 +0000 2024-03-13T21:19:34.636 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-03-13 21:13:32.576564197 +0000 2024-03-13T21:19:34.636 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-03-13 21:13:32.576564197 +0000 2024-03-13T21:19:34.636 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-03-13 21:13:32.576564197 +0000 2024-03-13T21:19:34.637 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-13T21:19:34.701 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-03-13T21:19:34.702 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-03-13T21:19:34.702 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000219426 s, 2.3 MB/s 2024-03-13T21:19:34.702 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-13T21:19:34.758 DEBUG:teuthology.orchestra.run.smithi107:> stat /dev/vg_nvme/lv_4 2024-03-13T21:19:34.813 INFO:teuthology.orchestra.run.smithi107.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-13T21:19:34.813 INFO:teuthology.orchestra.run.smithi107.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-13T21:19:34.813 INFO:teuthology.orchestra.run.smithi107.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-03-13T21:19:34.814 INFO:teuthology.orchestra.run.smithi107.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-13T21:19:34.814 INFO:teuthology.orchestra.run.smithi107.stdout:Context: system_u:object_r:device_t:s0 2024-03-13T21:19:34.814 INFO:teuthology.orchestra.run.smithi107.stdout:Access: 2024-03-13 21:15:32.807531459 +0000 2024-03-13T21:19:34.814 INFO:teuthology.orchestra.run.smithi107.stdout:Modify: 2024-03-13 21:13:32.920558284 +0000 2024-03-13T21:19:34.814 INFO:teuthology.orchestra.run.smithi107.stdout:Change: 2024-03-13 21:13:32.920558284 +0000 2024-03-13T21:19:34.814 INFO:teuthology.orchestra.run.smithi107.stdout: Birth: 2024-03-13 21:13:32.920558284 +0000 2024-03-13T21:19:34.815 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-13T21:19:34.878 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records in 2024-03-13T21:19:34.878 INFO:teuthology.orchestra.run.smithi107.stderr:1+0 records out 2024-03-13T21:19:34.878 INFO:teuthology.orchestra.run.smithi107.stderr:512 bytes copied, 0.000205089 s, 2.5 MB/s 2024-03-13T21:19:34.879 DEBUG:teuthology.orchestra.run.smithi107:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-13T21:19:34.935 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-13T21:19:34.935 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:19:34.935 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2024-03-13T21:19:34.952 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-13T21:19:34.952 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2024-03-13T21:19:35.008 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-13T21:19:35.009 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-13T21:19:35.009 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-03-13T21:19:35.009 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-13T21:19:35.009 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-03-13T21:19:35.009 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-03-13 21:19:24.259756121 +0000 2024-03-13T21:19:35.009 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-03-13 21:13:31.649935708 +0000 2024-03-13T21:19:35.009 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-03-13 21:13:31.649935708 +0000 2024-03-13T21:19:35.009 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-03-13 21:13:31.649935708 +0000 2024-03-13T21:19:35.009 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-13T21:19:35.077 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-03-13T21:19:35.077 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-03-13T21:19:35.077 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000115979 s, 4.4 MB/s 2024-03-13T21:19:35.079 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-13T21:19:35.136 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2024-03-13T21:19:35.192 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-13T21:19:35.192 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-13T21:19:35.192 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-03-13T21:19:35.192 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-13T21:19:35.192 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-03-13T21:19:35.192 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-03-13 21:19:24.259756121 +0000 2024-03-13T21:19:35.192 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-03-13 21:13:31.967929418 +0000 2024-03-13T21:19:35.192 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-03-13 21:13:31.967929418 +0000 2024-03-13T21:19:35.192 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-03-13 21:13:31.967929418 +0000 2024-03-13T21:19:35.193 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-13T21:19:35.259 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-03-13T21:19:35.259 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-03-13T21:19:35.259 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 8.645e-05 s, 5.9 MB/s 2024-03-13T21:19:35.261 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-13T21:19:35.318 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2024-03-13T21:19:35.374 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-13T21:19:35.374 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-13T21:19:35.374 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-03-13T21:19:35.374 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-13T21:19:35.375 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-03-13T21:19:35.375 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-03-13 21:19:24.259756121 +0000 2024-03-13T21:19:35.375 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-03-13 21:13:32.289923048 +0000 2024-03-13T21:19:35.375 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-03-13 21:13:32.289923048 +0000 2024-03-13T21:19:35.375 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-03-13 21:13:32.289923048 +0000 2024-03-13T21:19:35.375 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-13T21:19:35.440 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-03-13T21:19:35.440 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-03-13T21:19:35.440 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 8.8114e-05 s, 5.8 MB/s 2024-03-13T21:19:35.442 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-13T21:19:35.498 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2024-03-13T21:19:35.554 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-13T21:19:35.555 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-13T21:19:35.555 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-03-13T21:19:35.555 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-13T21:19:35.555 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2024-03-13T21:19:35.555 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2024-03-13 21:19:24.260756100 +0000 2024-03-13T21:19:35.555 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2024-03-13 21:13:32.626916382 +0000 2024-03-13T21:19:35.555 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2024-03-13 21:13:32.626916382 +0000 2024-03-13T21:19:35.555 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2024-03-13 21:13:32.626916382 +0000 2024-03-13T21:19:35.556 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-13T21:19:35.620 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2024-03-13T21:19:35.620 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2024-03-13T21:19:35.620 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 9.8641e-05 s, 5.2 MB/s 2024-03-13T21:19:35.621 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-13T21:19:35.676 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-13T21:19:35.677 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-13T21:19:35.677 INFO:tasks.ceph:Generating config... 2024-03-13T21:19:35.678 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-13T21:19:35.678 INFO:tasks.ceph:[client] debug client = 20 2024-03-13T21:19:35.678 INFO:tasks.ceph:[client] debug ms = 1 2024-03-13T21:19:35.678 INFO:tasks.ceph:[client] pid file = 2024-03-13T21:19:35.678 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-13T21:19:35.678 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-13T21:19:35.678 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-13T21:19:35.678 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-13T21:19:35.679 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-13T21:19:35.679 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-13T21:19:35.679 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-13T21:19:35.679 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-13T21:19:35.679 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-13T21:19:35.679 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-13T21:19:35.679 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-13T21:19:35.679 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-13T21:19:35.679 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-13T21:19:35.679 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-13T21:19:35.679 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-13T21:19:35.679 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-13T21:19:35.679 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-13T21:19:35.679 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-13T21:19:35.679 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-13T21:19:35.679 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-13T21:19:35.680 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-13T21:19:35.680 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-13T21:19:35.680 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-13T21:19:35.680 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-13T21:19:35.680 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-13T21:19:35.680 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-13T21:19:35.680 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-13T21:19:35.680 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-13T21:19:35.680 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-13T21:19:35.680 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-13T21:19:35.680 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-13T21:19:35.680 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-13T21:19:35.680 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-13T21:19:35.680 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-13T21:19:35.680 INFO:tasks.ceph:Setting up mon.a... 2024-03-13T21:19:35.681 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-13T21:19:35.731 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.keyring 2024-03-13T21:19:35.733 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-13T21:19:35.778 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-13T21:19:35.805 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.107'), ('mon.b', '172.21.15.195'), ('mon.c', '[v2:172.21.15.195:3301,v1:172.21.15.195:6790]')] 2024-03-13T21:19:35.805 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.107,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-13T21:19:35.806 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:19:35.806 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-13T21:19:35.860 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.107 --add b 172.21.15.195 --addv c '[v2:172.21.15.195:3301,v1:172.21.15.195:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-13T21:19:35.946 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-13T21:19:35.946 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: generated fsid 2124cc6e-e803-48aa-9f5a-1b467da9f25e 2024-03-13T21:19:35.946 INFO:teuthology.orchestra.run.smithi107.stdout:setting min_mon_release = quincy 2024-03-13T21:19:35.946 INFO:teuthology.orchestra.run.smithi107.stdout:epoch 0 2024-03-13T21:19:35.946 INFO:teuthology.orchestra.run.smithi107.stdout:fsid 2124cc6e-e803-48aa-9f5a-1b467da9f25e 2024-03-13T21:19:35.946 INFO:teuthology.orchestra.run.smithi107.stdout:last_changed 2024-03-13T21:19:35.955261+0000 2024-03-13T21:19:35.946 INFO:teuthology.orchestra.run.smithi107.stdout:created 2024-03-13T21:19:35.955261+0000 2024-03-13T21:19:35.946 INFO:teuthology.orchestra.run.smithi107.stdout:min_mon_release 17 (quincy) 2024-03-13T21:19:35.946 INFO:teuthology.orchestra.run.smithi107.stdout:election_strategy: 1 2024-03-13T21:19:35.946 INFO:teuthology.orchestra.run.smithi107.stdout:0: [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] mon.a 2024-03-13T21:19:35.946 INFO:teuthology.orchestra.run.smithi107.stdout:1: [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon.b 2024-03-13T21:19:35.947 INFO:teuthology.orchestra.run.smithi107.stdout:2: [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] mon.c 2024-03-13T21:19:35.947 INFO:teuthology.orchestra.run.smithi107.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-13T21:19:35.948 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-13T21:19:35.962 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2124cc6e-e803-48aa-9f5a-1b467da9f25e... 2024-03-13T21:19:35.963 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-13T21:19:36.005 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-13T21:19:36.052 INFO:teuthology.orchestra.run.smithi107.stdout:[global] 2024-03-13T21:19:36.053 INFO:teuthology.orchestra.run.smithi107.stdout: chdir = "" 2024-03-13T21:19:36.053 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-13T21:19:36.053 INFO:teuthology.orchestra.run.smithi107.stdout: auth supported = cephx 2024-03-13T21:19:36.053 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.053 INFO:teuthology.orchestra.run.smithi107.stdout: filestore xattr use omap = true 2024-03-13T21:19:36.053 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.054 INFO:teuthology.orchestra.run.smithi107.stdout: mon clock drift allowed = 1.000 2024-03-13T21:19:36.054 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.054 INFO:teuthology.orchestra.run.smithi107.stdout: osd crush chooseleaf type = 0 2024-03-13T21:19:36.054 INFO:teuthology.orchestra.run.smithi107.stdout: auth debug = true 2024-03-13T21:19:36.054 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.054 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on old message = true 2024-03-13T21:19:36.055 INFO:teuthology.orchestra.run.smithi107.stdout: ms die on bug = true 2024-03-13T21:19:36.055 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.055 INFO:teuthology.orchestra.run.smithi107.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-13T21:19:36.055 INFO:teuthology.orchestra.run.smithi107.stdout: mon pg warn max object skew = 0 2024-03-13T21:19:36.055 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.055 INFO:teuthology.orchestra.run.smithi107.stdout: # disable pg_autoscaler by default for new pools 2024-03-13T21:19:36.055 INFO:teuthology.orchestra.run.smithi107.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-13T21:19:36.055 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.055 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default size = 2 2024-03-13T21:19:36.056 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.056 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow primary affinity = true 2024-03-13T21:19:36.056 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd allow pg remap = true 2024-03-13T21:19:36.056 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on legacy crush tunables = false 2024-03-13T21:19:36.056 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on crush straw calc version zero = false 2024-03-13T21:19:36.056 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on no sortbitwise = false 2024-03-13T21:19:36.056 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on osd down out interval zero = false 2024-03-13T21:19:36.056 INFO:teuthology.orchestra.run.smithi107.stdout: mon warn on too few osds = false 2024-03-13T21:19:36.056 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-13T21:19:36.057 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-13T21:19:36.057 INFO:teuthology.orchestra.run.smithi107.stdout: mon_allow_pool_size_one = true 2024-03-13T21:19:36.057 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.057 INFO:teuthology.orchestra.run.smithi107.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-13T21:19:36.057 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.057 INFO:teuthology.orchestra.run.smithi107.stdout: osd default data pool replay window = 5 2024-03-13T21:19:36.057 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.057 INFO:teuthology.orchestra.run.smithi107.stdout: mon allow pool delete = true 2024-03-13T21:19:36.057 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.058 INFO:teuthology.orchestra.run.smithi107.stdout: mon cluster log file level = debug 2024-03-13T21:19:36.058 INFO:teuthology.orchestra.run.smithi107.stdout: debug asserts on shutdown = true 2024-03-13T21:19:36.058 INFO:teuthology.orchestra.run.smithi107.stdout: mon health detail to clog = false 2024-03-13T21:19:36.058 INFO:teuthology.orchestra.run.smithi107.stdout: mon host = "172.21.15.107,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2024-03-13T21:19:36.058 INFO:teuthology.orchestra.run.smithi107.stdout: fsid = 2124cc6e-e803-48aa-9f5a-1b467da9f25e 2024-03-13T21:19:36.059 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.059 INFO:teuthology.orchestra.run.smithi107.stdout:[osd] 2024-03-13T21:19:36.059 INFO:teuthology.orchestra.run.smithi107.stdout: osd journal size = 100 2024-03-13T21:19:36.059 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.059 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub load threshold = 5.0 2024-03-13T21:19:36.059 INFO:teuthology.orchestra.run.smithi107.stdout: osd scrub max interval = 600 2024-03-13T21:19:36.059 INFO:teuthology.orchestra.run.smithi107.stdout: osd mclock profile = high_recovery_ops 2024-03-13T21:19:36.059 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.059 INFO:teuthology.orchestra.run.smithi107.stdout: osd recover clone overlap = true 2024-03-13T21:19:36.059 INFO:teuthology.orchestra.run.smithi107.stdout: osd recovery max chunk = 1048576 2024-03-13T21:19:36.059 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.059 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug shutdown = true 2024-03-13T21:19:36.060 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug op order = true 2024-03-13T21:19:36.060 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug verify stray on activate = true 2024-03-13T21:19:36.060 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug trim objects = true 2024-03-13T21:19:36.060 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.060 INFO:teuthology.orchestra.run.smithi107.stdout: osd open classes on start = true 2024-03-13T21:19:36.060 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug pg log writeout = true 2024-03-13T21:19:36.060 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.060 INFO:teuthology.orchestra.run.smithi107.stdout: osd deep scrub update digest min age = 30 2024-03-13T21:19:36.060 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.060 INFO:teuthology.orchestra.run.smithi107.stdout: osd map max advance = 10 2024-03-13T21:19:36.060 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.060 INFO:teuthology.orchestra.run.smithi107.stdout: journal zero on create = true 2024-03-13T21:19:36.060 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.060 INFO:teuthology.orchestra.run.smithi107.stdout: filestore ondisk finisher threads = 3 2024-03-13T21:19:36.060 INFO:teuthology.orchestra.run.smithi107.stdout: filestore apply finisher threads = 3 2024-03-13T21:19:36.060 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.060 INFO:teuthology.orchestra.run.smithi107.stdout: bdev debug aio = true 2024-03-13T21:19:36.061 INFO:teuthology.orchestra.run.smithi107.stdout: osd debug misdirected ops = true 2024-03-13T21:19:36.061 INFO:teuthology.orchestra.run.smithi107.stdout: bdev async discard = True 2024-03-13T21:19:36.061 INFO:teuthology.orchestra.run.smithi107.stdout: bdev enable discard = True 2024-03-13T21:19:36.061 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore allocator = bitmap 2024-03-13T21:19:36.061 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore block size = 96636764160 2024-03-13T21:19:36.061 INFO:teuthology.orchestra.run.smithi107.stdout: bluestore fsck on mount = True 2024-03-13T21:19:36.061 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluefs = 1/20 2024-03-13T21:19:36.061 INFO:teuthology.orchestra.run.smithi107.stdout: debug bluestore = 1/20 2024-03-13T21:19:36.061 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-03-13T21:19:36.061 INFO:teuthology.orchestra.run.smithi107.stdout: debug osd = 20 2024-03-13T21:19:36.061 INFO:teuthology.orchestra.run.smithi107.stdout: debug rocksdb = 4/10 2024-03-13T21:19:36.061 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd backfillfull_ratio = 0.85 2024-03-13T21:19:36.061 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd full ratio = 0.9 2024-03-13T21:19:36.061 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd nearfull ratio = 0.8 2024-03-13T21:19:36.061 INFO:teuthology.orchestra.run.smithi107.stdout: osd failsafe full ratio = 0.95 2024-03-13T21:19:36.062 INFO:teuthology.orchestra.run.smithi107.stdout: osd objectstore = bluestore 2024-03-13T21:19:36.062 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2024-03-13T21:19:36.062 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.062 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr] 2024-03-13T21:19:36.062 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-03-13T21:19:36.062 INFO:teuthology.orchestra.run.smithi107.stdout: debug mgr = 20 2024-03-13T21:19:36.062 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-03-13T21:19:36.062 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-03-13T21:19:36.062 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-03-13T21:19:36.062 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-03-13T21:19:36.062 INFO:teuthology.orchestra.run.smithi107.stdout: mgr/telemetry/nag = false 2024-03-13T21:19:36.062 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.062 INFO:teuthology.orchestra.run.smithi107.stdout:[mon] 2024-03-13T21:19:36.063 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-03-13T21:19:36.063 INFO:teuthology.orchestra.run.smithi107.stdout: debug mon = 20 2024-03-13T21:19:36.063 INFO:teuthology.orchestra.run.smithi107.stdout: debug paxos = 20 2024-03-13T21:19:36.063 INFO:teuthology.orchestra.run.smithi107.stdout: debug auth = 20 2024-03-13T21:19:36.063 INFO:teuthology.orchestra.run.smithi107.stdout: mon data avail warn = 5 2024-03-13T21:19:36.063 INFO:teuthology.orchestra.run.smithi107.stdout: mon mgr mkfs grace = 240 2024-03-13T21:19:36.063 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min pgs per osd = 4 2024-03-13T21:19:36.063 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd reporter subtree level = osd 2024-03-13T21:19:36.063 INFO:teuthology.orchestra.run.smithi107.stdout: mon osd prime pg temp = true 2024-03-13T21:19:36.063 INFO:teuthology.orchestra.run.smithi107.stdout: mon reweight min bytes per osd = 10 2024-03-13T21:19:36.063 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.063 INFO:teuthology.orchestra.run.smithi107.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-13T21:19:36.063 INFO:teuthology.orchestra.run.smithi107.stdout: auth mon ticket ttl = 660 # 11m 2024-03-13T21:19:36.063 INFO:teuthology.orchestra.run.smithi107.stdout: auth service ticket ttl = 240 # 4m 2024-03-13T21:19:36.064 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.064 INFO:teuthology.orchestra.run.smithi107.stdout: # don't complain about insecure global_id in the test suite 2024-03-13T21:19:36.064 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-13T21:19:36.064 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-13T21:19:36.064 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.064 INFO:teuthology.orchestra.run.smithi107.stdout: # 1m isn't quite enough 2024-03-13T21:19:36.064 INFO:teuthology.orchestra.run.smithi107.stdout: mon_down_mkfs_grace = 2m 2024-03-13T21:19:36.064 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.064 INFO:teuthology.orchestra.run.smithi107.stdout: mon_warn_on_filestore_osds = false 2024-03-13T21:19:36.064 INFO:teuthology.orchestra.run.smithi107.stdout: mon op complaint time = 120 2024-03-13T21:19:36.064 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:19:36.064 INFO:teuthology.orchestra.run.smithi107.stdout:[client] 2024-03-13T21:19:36.064 INFO:teuthology.orchestra.run.smithi107.stdout: rgw cache enabled = true 2024-03-13T21:19:36.064 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable ops log = true 2024-03-13T21:19:36.064 INFO:teuthology.orchestra.run.smithi107.stdout: rgw enable usage log = true 2024-03-13T21:19:36.065 INFO:teuthology.orchestra.run.smithi107.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-13T21:19:36.065 INFO:teuthology.orchestra.run.smithi107.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-13T21:19:36.065 INFO:teuthology.orchestra.run.smithi107.stdout: client mount timeout = 600 2024-03-13T21:19:36.065 INFO:teuthology.orchestra.run.smithi107.stdout: debug client = 20 2024-03-13T21:19:36.065 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-03-13T21:19:36.065 INFO:teuthology.orchestra.run.smithi107.stdout: pid file = "" 2024-03-13T21:19:36.065 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2024-03-13T21:19:36.065 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2024-03-13T21:19:36.065 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.a] 2024-03-13T21:19:36.065 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.b] 2024-03-13T21:19:36.065 INFO:teuthology.orchestra.run.smithi107.stdout:[mon.c] 2024-03-13T21:19:36.065 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-03-13T21:19:36.065 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2024-03-13T21:19:36.066 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2024-03-13T21:19:36.066 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2024-03-13T21:19:36.066 INFO:teuthology.orchestra.run.smithi107.stdout:[mds] 2024-03-13T21:19:36.066 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds = 20 2024-03-13T21:19:36.066 INFO:teuthology.orchestra.run.smithi107.stdout: debug mds balancer = 20 2024-03-13T21:19:36.066 INFO:teuthology.orchestra.run.smithi107.stdout: debug ms = 1 2024-03-13T21:19:36.066 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug frag = True 2024-03-13T21:19:36.066 INFO:teuthology.orchestra.run.smithi107.stdout: mds debug scatterstat = True 2024-03-13T21:19:36.066 INFO:teuthology.orchestra.run.smithi107.stdout: mds op complaint time = 180 2024-03-13T21:19:36.066 INFO:teuthology.orchestra.run.smithi107.stdout: mds verify scatter = True 2024-03-13T21:19:36.066 INFO:teuthology.orchestra.run.smithi107.stdout: osd op complaint time = 180 2024-03-13T21:19:36.066 INFO:teuthology.orchestra.run.smithi107.stdout: rados mon op timeout = 900 2024-03-13T21:19:36.067 INFO:teuthology.orchestra.run.smithi107.stdout: rados osd op timeout = 900 2024-03-13T21:19:36.067 INFO:teuthology.orchestra.run.smithi195.stdout:[global] 2024-03-13T21:19:36.067 INFO:teuthology.orchestra.run.smithi195.stdout: chdir = "" 2024-03-13T21:19:36.067 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-13T21:19:36.067 INFO:teuthology.orchestra.run.smithi195.stdout: auth supported = cephx 2024-03-13T21:19:36.067 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.067 INFO:teuthology.orchestra.run.smithi195.stdout: filestore xattr use omap = true 2024-03-13T21:19:36.067 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.067 INFO:teuthology.orchestra.run.smithi195.stdout: mon clock drift allowed = 1.000 2024-03-13T21:19:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: osd crush chooseleaf type = 0 2024-03-13T21:19:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: auth debug = true 2024-03-13T21:19:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on old message = true 2024-03-13T21:19:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: ms die on bug = true 2024-03-13T21:19:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-13T21:19:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: mon pg warn max object skew = 0 2024-03-13T21:19:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: # disable pg_autoscaler by default for new pools 2024-03-13T21:19:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-13T21:19:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default size = 2 2024-03-13T21:19:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow primary affinity = true 2024-03-13T21:19:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd allow pg remap = true 2024-03-13T21:19:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on legacy crush tunables = false 2024-03-13T21:19:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on crush straw calc version zero = false 2024-03-13T21:19:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on no sortbitwise = false 2024-03-13T21:19:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on osd down out interval zero = false 2024-03-13T21:19:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: mon warn on too few osds = false 2024-03-13T21:19:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-13T21:19:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-13T21:19:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: mon_allow_pool_size_one = true 2024-03-13T21:19:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-13T21:19:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: osd default data pool replay window = 5 2024-03-13T21:19:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: mon allow pool delete = true 2024-03-13T21:19:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: mon cluster log file level = debug 2024-03-13T21:19:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: debug asserts on shutdown = true 2024-03-13T21:19:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: mon health detail to clog = false 2024-03-13T21:19:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: mon host = "172.21.15.107,172.21.15.195,[v2:172.21.15.195:3301,v1:172.21.15.195:6790]" 2024-03-13T21:19:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: fsid = 2124cc6e-e803-48aa-9f5a-1b467da9f25e 2024-03-13T21:19:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.070 INFO:teuthology.orchestra.run.smithi195.stdout:[osd] 2024-03-13T21:19:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: osd journal size = 100 2024-03-13T21:19:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub load threshold = 5.0 2024-03-13T21:19:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: osd scrub max interval = 600 2024-03-13T21:19:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: osd mclock profile = high_recovery_ops 2024-03-13T21:19:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: osd recover clone overlap = true 2024-03-13T21:19:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: osd recovery max chunk = 1048576 2024-03-13T21:19:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug shutdown = true 2024-03-13T21:19:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug op order = true 2024-03-13T21:19:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug verify stray on activate = true 2024-03-13T21:19:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug trim objects = true 2024-03-13T21:19:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: osd open classes on start = true 2024-03-13T21:19:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug pg log writeout = true 2024-03-13T21:19:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: osd deep scrub update digest min age = 30 2024-03-13T21:19:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: osd map max advance = 10 2024-03-13T21:19:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: journal zero on create = true 2024-03-13T21:19:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: filestore ondisk finisher threads = 3 2024-03-13T21:19:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: filestore apply finisher threads = 3 2024-03-13T21:19:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: bdev debug aio = true 2024-03-13T21:19:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: osd debug misdirected ops = true 2024-03-13T21:19:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: bdev async discard = True 2024-03-13T21:19:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: bdev enable discard = True 2024-03-13T21:19:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore allocator = bitmap 2024-03-13T21:19:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore block size = 96636764160 2024-03-13T21:19:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: bluestore fsck on mount = True 2024-03-13T21:19:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluefs = 1/20 2024-03-13T21:19:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: debug bluestore = 1/20 2024-03-13T21:19:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-03-13T21:19:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: debug osd = 20 2024-03-13T21:19:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: debug rocksdb = 4/10 2024-03-13T21:19:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd backfillfull_ratio = 0.85 2024-03-13T21:19:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd full ratio = 0.9 2024-03-13T21:19:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd nearfull ratio = 0.8 2024-03-13T21:19:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: osd failsafe full ratio = 0.95 2024-03-13T21:19:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: osd objectstore = bluestore 2024-03-13T21:19:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-03-13T21:19:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.073 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr] 2024-03-13T21:19:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-03-13T21:19:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: debug mgr = 20 2024-03-13T21:19:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-03-13T21:19:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-03-13T21:19:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-03-13T21:19:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-03-13T21:19:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: mgr/telemetry/nag = false 2024-03-13T21:19:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.074 INFO:teuthology.orchestra.run.smithi195.stdout:[mon] 2024-03-13T21:19:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-03-13T21:19:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: debug mon = 20 2024-03-13T21:19:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: debug paxos = 20 2024-03-13T21:19:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: debug auth = 20 2024-03-13T21:19:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: mon data avail warn = 5 2024-03-13T21:19:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: mon mgr mkfs grace = 240 2024-03-13T21:19:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min pgs per osd = 4 2024-03-13T21:19:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd reporter subtree level = osd 2024-03-13T21:19:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: mon osd prime pg temp = true 2024-03-13T21:19:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: mon reweight min bytes per osd = 10 2024-03-13T21:19:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-13T21:19:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: auth mon ticket ttl = 660 # 11m 2024-03-13T21:19:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: auth service ticket ttl = 240 # 4m 2024-03-13T21:19:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: # don't complain about insecure global_id in the test suite 2024-03-13T21:19:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-13T21:19:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-13T21:19:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: # 1m isn't quite enough 2024-03-13T21:19:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: mon_down_mkfs_grace = 2m 2024-03-13T21:19:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: mon_warn_on_filestore_osds = false 2024-03-13T21:19:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: mon op complaint time = 120 2024-03-13T21:19:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: 2024-03-13T21:19:36.076 INFO:teuthology.orchestra.run.smithi195.stdout:[client] 2024-03-13T21:19:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: rgw cache enabled = true 2024-03-13T21:19:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable ops log = true 2024-03-13T21:19:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: rgw enable usage log = true 2024-03-13T21:19:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-13T21:19:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-13T21:19:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: client mount timeout = 600 2024-03-13T21:19:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: debug client = 20 2024-03-13T21:19:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-03-13T21:19:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: pid file = "" 2024-03-13T21:19:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-03-13T21:19:36.077 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-03-13T21:19:36.077 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.a] 2024-03-13T21:19:36.077 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.b] 2024-03-13T21:19:36.077 INFO:teuthology.orchestra.run.smithi195.stdout:[mon.c] 2024-03-13T21:19:36.077 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2024-03-13T21:19:36.077 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.c] 2024-03-13T21:19:36.077 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2024-03-13T21:19:36.077 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.d] 2024-03-13T21:19:36.077 INFO:teuthology.orchestra.run.smithi195.stdout:[mds] 2024-03-13T21:19:36.077 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds = 20 2024-03-13T21:19:36.077 INFO:teuthology.orchestra.run.smithi195.stdout: debug mds balancer = 20 2024-03-13T21:19:36.077 INFO:teuthology.orchestra.run.smithi195.stdout: debug ms = 1 2024-03-13T21:19:36.077 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug frag = True 2024-03-13T21:19:36.077 INFO:teuthology.orchestra.run.smithi195.stdout: mds debug scatterstat = True 2024-03-13T21:19:36.077 INFO:teuthology.orchestra.run.smithi195.stdout: mds op complaint time = 180 2024-03-13T21:19:36.077 INFO:teuthology.orchestra.run.smithi195.stdout: mds verify scatter = True 2024-03-13T21:19:36.078 INFO:teuthology.orchestra.run.smithi195.stdout: osd op complaint time = 180 2024-03-13T21:19:36.078 INFO:teuthology.orchestra.run.smithi195.stdout: rados mon op timeout = 900 2024-03-13T21:19:36.078 INFO:teuthology.orchestra.run.smithi195.stdout: rados osd op timeout = 900 2024-03-13T21:19:36.079 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-13T21:19:36.079 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-13T21:19:36.175 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-13T21:19:36.176 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:19:36.176 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-13T21:19:36.190 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:19:36.191 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-13T21:19:36.244 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi107.front.sepia.ceph.com 2024-03-13T21:19:36.245 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:19:36.245 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-13T21:19:36.245 DEBUG:teuthology.orchestra.run.smithi107:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-13T21:19:36.323 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:19:36.324 DEBUG:teuthology.orchestra.run.smithi107:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-13T21:19:36.379 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi195.front.sepia.ceph.com 2024-03-13T21:19:36.379 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:19:36.379 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-13T21:19:36.379 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-13T21:19:36.418 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:19:36.419 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-13T21:19:36.473 INFO:tasks.ceph:Setting up mon nodes... 2024-03-13T21:19:36.473 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-13T21:19:36.473 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-13T21:19:36.528 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-13T21:19:36.530 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-13T21:19:36.620 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-13T21:19:36.623 INFO:tasks.ceph:Setting up mds nodes... 2024-03-13T21:19:36.623 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-13T21:19:36.678 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-13T21:19:36.681 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-13T21:19:36.707 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-13T21:19:36.801 INFO:teuthology.orchestra.run.smithi107.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-13T21:19:36.804 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-13T21:19:36.831 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-13T21:19:36.886 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-13T21:19:36.888 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-13T21:19:36.915 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-13T21:19:37.009 INFO:teuthology.orchestra.run.smithi195.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-13T21:19:37.012 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-13T21:19:37.038 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-13T21:19:37.039 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-13T21:19:37.081 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-13T21:19:37.096 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-13T21:19:37.178 INFO:teuthology.orchestra.run.smithi107.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-13T21:19:37.193 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-13T21:19:37.234 INFO:teuthology.orchestra.run.smithi195.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-13T21:19:37.249 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-13T21:19:37.331 INFO:teuthology.orchestra.run.smithi195.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-13T21:19:37.346 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-13T21:19:37.346 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi107.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi195.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-13T21:19:37.347 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-13T21:19:37.374 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-13T21:19:37.374 INFO:tasks.ceph:role: osd.0 2024-03-13T21:19:37.374 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com 2024-03-13T21:19:37.374 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-13T21:19:37.448 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-13T21:19:37.448 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-13T21:19:37.448 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-13T21:19:37.448 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-13T21:19:37.448 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-13T21:19:37.448 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-03-13T21:19:37.448 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-13T21:19:37.448 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-13T21:19:37.448 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-13T21:19:37.448 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-13T21:19:37.975 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-03-13T21:19:37.977 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-03-13T21:19:37.978 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-13T21:19:38.102 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-13T21:19:38.136 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-13T21:19:38.203 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-13T21:19:38.203 INFO:tasks.ceph:role: osd.1 2024-03-13T21:19:38.203 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com 2024-03-13T21:19:38.203 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-13T21:19:38.277 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-13T21:19:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-13T21:19:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-13T21:19:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-13T21:19:38.278 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-13T21:19:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-03-13T21:19:38.278 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-13T21:19:38.278 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-13T21:19:38.278 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-13T21:19:38.278 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-13T21:19:38.742 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-03-13T21:19:38.744 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-03-13T21:19:38.744 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-13T21:19:38.852 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-13T21:19:38.883 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-13T21:19:38.950 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-13T21:19:38.950 INFO:tasks.ceph:role: osd.2 2024-03-13T21:19:38.950 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com 2024-03-13T21:19:38.951 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-13T21:19:39.024 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-13T21:19:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-13T21:19:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-13T21:19:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-13T21:19:39.025 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-13T21:19:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-03-13T21:19:39.025 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-13T21:19:39.025 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-13T21:19:39.025 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-13T21:19:39.025 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-13T21:19:39.544 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-03-13T21:19:39.546 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-03-13T21:19:39.546 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-13T21:19:39.666 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-13T21:19:39.698 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-13T21:19:39.765 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-13T21:19:39.765 INFO:tasks.ceph:role: osd.3 2024-03-13T21:19:39.766 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com 2024-03-13T21:19:39.766 DEBUG:teuthology.orchestra.run.smithi107:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-13T21:19:39.840 INFO:teuthology.orchestra.run.smithi107.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-13T21:19:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-13T21:19:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-13T21:19:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-13T21:19:39.840 INFO:teuthology.orchestra.run.smithi107.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-13T21:19:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: = sunit=0 swidth=0 blks 2024-03-13T21:19:39.840 INFO:teuthology.orchestra.run.smithi107.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-13T21:19:39.840 INFO:teuthology.orchestra.run.smithi107.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-13T21:19:39.840 INFO:teuthology.orchestra.run.smithi107.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-13T21:19:39.840 INFO:teuthology.orchestra.run.smithi107.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-13T21:19:40.328 INFO:teuthology.orchestra.run.smithi107.stdout:Discarding blocks...Done. 2024-03-13T21:19:40.330 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi107.front.sepia.ceph.com -o noatime 2024-03-13T21:19:40.331 DEBUG:teuthology.orchestra.run.smithi107:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-13T21:19:40.463 DEBUG:teuthology.orchestra.run.smithi107:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-13T21:19:40.498 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-13T21:19:40.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:40.598+0000 7f41c4b28640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-13T21:19:40.590 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:40.599+0000 7f41c4b28640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-13T21:19:40.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:40.599+0000 7f41c4b28640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-13T21:19:40.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:40.599+0000 7f41c4b28640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-13T21:19:40.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:40.599+0000 7f41c4b28640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-13T21:19:40.591 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:40.599+0000 7f41c4b28640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-13T21:19:43.433 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-13T21:19:43.463 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-13T21:19:43.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:43.560+0000 7f865480e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-13T21:19:43.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:43.560+0000 7f865480e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-13T21:19:43.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:43.560+0000 7f865480e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-13T21:19:43.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:43.560+0000 7f865480e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-13T21:19:43.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:43.560+0000 7f865480e640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-13T21:19:43.552 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:43.561+0000 7f865480e640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-13T21:19:46.400 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-13T21:19:46.431 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-13T21:19:46.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:46.531+0000 7feaafc15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-13T21:19:46.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:46.531+0000 7feaafc15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-13T21:19:46.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:46.531+0000 7feaafc15640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-13T21:19:46.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:46.531+0000 7feaafc15640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-13T21:19:46.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:46.531+0000 7feaafc15640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-13T21:19:46.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:46.532+0000 7feaafc15640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-13T21:19:49.369 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-13T21:19:49.397 DEBUG:teuthology.orchestra.run.smithi107:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-13T21:19:49.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:49.494+0000 7f7a40138640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-13T21:19:49.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:49.494+0000 7f7a40138640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-13T21:19:49.486 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:49.494+0000 7f7a40138640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-13T21:19:49.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:49.494+0000 7f7a40138640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-13T21:19:49.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:49.494+0000 7f7a40138640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-13T21:19:49.487 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:19:49.495+0000 7f7a40138640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-13T21:19:52.332 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-13T21:19:52.362 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-13T21:19:52.394 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-13T21:19:52.394 INFO:tasks.ceph:role: osd.4 2024-03-13T21:19:52.394 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com 2024-03-13T21:19:52.394 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-13T21:19:52.465 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-13T21:19:52.465 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-13T21:19:52.465 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-13T21:19:52.465 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-13T21:19:52.465 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-13T21:19:52.466 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-03-13T21:19:52.466 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-13T21:19:52.466 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-13T21:19:52.466 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-13T21:19:52.466 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-13T21:19:52.501 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-03-13T21:19:52.503 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-03-13T21:19:52.503 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-13T21:19:52.576 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-13T21:19:52.649 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-13T21:19:52.717 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-13T21:19:52.717 INFO:tasks.ceph:role: osd.5 2024-03-13T21:19:52.717 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi195.front.sepia.ceph.com 2024-03-13T21:19:52.717 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-13T21:19:52.783 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-13T21:19:52.784 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-13T21:19:52.784 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-13T21:19:52.784 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-13T21:19:52.784 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-13T21:19:52.784 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-03-13T21:19:52.784 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-13T21:19:52.784 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-13T21:19:52.784 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-13T21:19:52.784 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-13T21:19:52.816 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-03-13T21:19:52.818 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-03-13T21:19:52.818 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-13T21:19:52.890 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-13T21:19:52.964 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-13T21:19:53.032 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-13T21:19:53.033 INFO:tasks.ceph:role: osd.6 2024-03-13T21:19:53.033 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi195.front.sepia.ceph.com 2024-03-13T21:19:53.033 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-13T21:19:53.099 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-13T21:19:53.099 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-13T21:19:53.100 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-13T21:19:53.100 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-13T21:19:53.100 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-13T21:19:53.100 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-03-13T21:19:53.100 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-13T21:19:53.100 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-13T21:19:53.100 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-13T21:19:53.100 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-13T21:19:53.131 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-03-13T21:19:53.133 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-03-13T21:19:53.134 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-13T21:19:53.203 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-13T21:19:53.275 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-13T21:19:53.342 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-13T21:19:53.342 INFO:tasks.ceph:role: osd.7 2024-03-13T21:19:53.342 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi195.front.sepia.ceph.com 2024-03-13T21:19:53.343 DEBUG:teuthology.orchestra.run.smithi195:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-13T21:19:53.409 INFO:teuthology.orchestra.run.smithi195.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-13T21:19:53.409 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-13T21:19:53.409 INFO:teuthology.orchestra.run.smithi195.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-13T21:19:53.409 INFO:teuthology.orchestra.run.smithi195.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-13T21:19:53.410 INFO:teuthology.orchestra.run.smithi195.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-13T21:19:53.410 INFO:teuthology.orchestra.run.smithi195.stdout: = sunit=0 swidth=0 blks 2024-03-13T21:19:53.410 INFO:teuthology.orchestra.run.smithi195.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-13T21:19:53.410 INFO:teuthology.orchestra.run.smithi195.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-13T21:19:53.410 INFO:teuthology.orchestra.run.smithi195.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-13T21:19:53.410 INFO:teuthology.orchestra.run.smithi195.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-13T21:19:53.442 INFO:teuthology.orchestra.run.smithi195.stdout:Discarding blocks...Done. 2024-03-13T21:19:53.444 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi195.front.sepia.ceph.com -o noatime 2024-03-13T21:19:53.445 DEBUG:teuthology.orchestra.run.smithi195:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-13T21:19:53.515 DEBUG:teuthology.orchestra.run.smithi195:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-13T21:19:53.585 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-13T21:19:53.679 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:19:53.687+0000 7f653d20f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-13T21:19:53.679 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:19:53.687+0000 7f653d20f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-13T21:19:53.679 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:19:53.687+0000 7f653d20f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-13T21:19:53.679 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:19:53.687+0000 7f653d20f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-13T21:19:53.679 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:19:53.687+0000 7f653d20f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-13T21:19:53.679 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:19:53.687+0000 7f653d20f640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-13T21:19:56.526 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-13T21:19:56.557 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-13T21:19:56.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:19:56.656+0000 7fee98010640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-13T21:19:56.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:19:56.657+0000 7fee98010640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-13T21:19:56.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:19:56.657+0000 7fee98010640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-13T21:19:56.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:19:56.657+0000 7fee98010640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-13T21:19:56.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:19:56.657+0000 7fee98010640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-13T21:19:56.649 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:19:56.657+0000 7fee98010640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-13T21:19:59.488 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-13T21:19:59.519 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-13T21:19:59.610 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:19:59.618+0000 7f41b27a8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-13T21:19:59.610 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:19:59.618+0000 7f41b27a8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-13T21:19:59.610 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:19:59.618+0000 7f41b27a8640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-13T21:19:59.610 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:19:59.618+0000 7f41b27a8640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-13T21:19:59.610 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:19:59.618+0000 7f41b27a8640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-13T21:19:59.610 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:19:59.618+0000 7f41b27a8640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-13T21:20:02.452 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-13T21:20:02.484 DEBUG:teuthology.orchestra.run.smithi195:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-13T21:20:02.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:02.582+0000 7f9943d49640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-13T21:20:02.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:02.582+0000 7f9943d49640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-13T21:20:02.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:02.583+0000 7f9943d49640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-13T21:20:02.575 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:02.583+0000 7f9943d49640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-13T21:20:02.576 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:02.583+0000 7f9943d49640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-13T21:20:02.576 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:02.583+0000 7f9943d49640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-13T21:20:04.090 DEBUG:teuthology.orchestra.run.smithi107:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-13T21:20:04.093 DEBUG:teuthology.orchestra.run.smithi195:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-13T21:20:05.417 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-13T21:20:05.448 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-13T21:20:05.449 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:20:05.449 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-13T21:20:05.481 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:20:05.481 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-13T21:20:05.551 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:20:05.551 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-13T21:20:05.620 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:20:05.620 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-13T21:20:05.689 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:20:05.689 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-13T21:20:05.759 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:20:05.759 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-13T21:20:05.827 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:20:05.827 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-13T21:20:05.895 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:20:05.895 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-13T21:20:05.927 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:20:05.927 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-13T21:20:05.997 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:20:05.997 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-13T21:20:06.068 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:20:06.068 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-13T21:20:06.136 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:20:06.136 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-13T21:20:06.205 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:20:06.205 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-13T21:20:06.273 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:20:06.273 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-13T21:20:06.341 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:20:06.341 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-13T21:20:06.358 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:20:06.358 DEBUG:teuthology.orchestra.run.smithi107:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-13T21:20:06.415 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:20:06.416 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-13T21:20:06.431 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:20:06.431 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-13T21:20:06.486 INFO:tasks.ceph:Adding keys to all mons... 2024-03-13T21:20:06.486 DEBUG:teuthology.orchestra.run.smithi107:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-13T21:20:06.488 DEBUG:teuthology.orchestra.run.smithi195:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-13T21:20:06.529 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.y] 2024-03-13T21:20:06.529 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBoGPJlcEMKIBAAw8tnOpP4aRIchHBocDruYw== 2024-03-13T21:20:06.529 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.a] 2024-03-13T21:20:06.529 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBoGPJlhzEBKRAANXxp2WIJSmRQhcn7QRRuyw== 2024-03-13T21:20:06.529 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.c] 2024-03-13T21:20:06.529 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBoGPJlvclZMBAAhAoUrSp42YCyFvPqd727yg== 2024-03-13T21:20:06.529 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.0] 2024-03-13T21:20:06.530 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBsGPJlx2K7IxAAqomJ/hHKG7sKISpUJP/8pA== 2024-03-13T21:20:06.530 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.1] 2024-03-13T21:20:06.530 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBvGPJl93hyIRAAYn6jtNGUmc2WwyW3puABmQ== 2024-03-13T21:20:06.530 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.2] 2024-03-13T21:20:06.530 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQByGPJlvIu0HxAABM/f+o74hp94NUAAep4H5g== 2024-03-13T21:20:06.530 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.3] 2024-03-13T21:20:06.530 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQB1GPJl0PCEHRAAYKCPllE1LshVL8FahxmZdA== 2024-03-13T21:20:06.530 INFO:teuthology.orchestra.run.smithi107.stdout:[mgr.x] 2024-03-13T21:20:06.530 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBoGPJlspiHJRAAjJj73z8JFMF/KiL246Dflg== 2024-03-13T21:20:06.530 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.b] 2024-03-13T21:20:06.530 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBoGPJlPYpiNRAAqPRnnD+T3bZ5B1qZuPJOmQ== 2024-03-13T21:20:06.530 INFO:teuthology.orchestra.run.smithi107.stdout:[mds.d] 2024-03-13T21:20:06.530 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBpGPJlr1MkARAA44ocFt1kmyxOaCDxOSEPLg== 2024-03-13T21:20:06.531 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.4] 2024-03-13T21:20:06.531 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQB5GPJl/gQAKRAAwI5gi2bTpjURjov2SM+tSA== 2024-03-13T21:20:06.531 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.5] 2024-03-13T21:20:06.531 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQB8GPJlwE0yJxAAujiJHPdRSkbAsQvvVeGAEw== 2024-03-13T21:20:06.531 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.6] 2024-03-13T21:20:06.531 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQB/GPJlJS7kJBAAf+5tOf9gE1huUTsq9BeWzQ== 2024-03-13T21:20:06.531 INFO:teuthology.orchestra.run.smithi107.stdout:[osd.7] 2024-03-13T21:20:06.531 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQCCGPJlo8fXIhAAJwd7OWEjHlAyyOHDCkm40Q== 2024-03-13T21:20:06.531 INFO:teuthology.orchestra.run.smithi107.stdout:[client.0] 2024-03-13T21:20:06.531 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBpGPJlZIhnBRAA5DAs65s7A1fq2L+V5DHO/A== 2024-03-13T21:20:06.531 INFO:teuthology.orchestra.run.smithi107.stdout:[client.2] 2024-03-13T21:20:06.531 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBpGPJlLCktCxAA9tIw35FM3sDFV0vUuYCIHw== 2024-03-13T21:20:06.531 INFO:teuthology.orchestra.run.smithi107.stdout:[client.1] 2024-03-13T21:20:06.531 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBpGPJlLfyKDhAA1FzMgTEmqNQyx+KcXeefXw== 2024-03-13T21:20:06.532 INFO:teuthology.orchestra.run.smithi107.stdout:[client.3] 2024-03-13T21:20:06.532 INFO:teuthology.orchestra.run.smithi107.stdout: key = AQBpGPJlKg5OFBAA7Oopm0k9wV2Wx5A05Zs0XQ== 2024-03-13T21:20:06.551 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr.y] 2024-03-13T21:20:06.552 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBoGPJlcEMKIBAAw8tnOpP4aRIchHBocDruYw== 2024-03-13T21:20:06.552 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.a] 2024-03-13T21:20:06.552 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBoGPJlhzEBKRAANXxp2WIJSmRQhcn7QRRuyw== 2024-03-13T21:20:06.552 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.c] 2024-03-13T21:20:06.552 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBoGPJlvclZMBAAhAoUrSp42YCyFvPqd727yg== 2024-03-13T21:20:06.552 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.0] 2024-03-13T21:20:06.552 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBsGPJlx2K7IxAAqomJ/hHKG7sKISpUJP/8pA== 2024-03-13T21:20:06.552 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.1] 2024-03-13T21:20:06.552 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBvGPJl93hyIRAAYn6jtNGUmc2WwyW3puABmQ== 2024-03-13T21:20:06.552 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.2] 2024-03-13T21:20:06.552 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQByGPJlvIu0HxAABM/f+o74hp94NUAAep4H5g== 2024-03-13T21:20:06.552 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.3] 2024-03-13T21:20:06.552 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQB1GPJl0PCEHRAAYKCPllE1LshVL8FahxmZdA== 2024-03-13T21:20:06.552 INFO:teuthology.orchestra.run.smithi195.stdout:[mgr.x] 2024-03-13T21:20:06.553 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBoGPJlspiHJRAAjJj73z8JFMF/KiL246Dflg== 2024-03-13T21:20:06.553 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.b] 2024-03-13T21:20:06.553 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBoGPJlPYpiNRAAqPRnnD+T3bZ5B1qZuPJOmQ== 2024-03-13T21:20:06.553 INFO:teuthology.orchestra.run.smithi195.stdout:[mds.d] 2024-03-13T21:20:06.553 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBpGPJlr1MkARAA44ocFt1kmyxOaCDxOSEPLg== 2024-03-13T21:20:06.553 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.4] 2024-03-13T21:20:06.553 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQB5GPJl/gQAKRAAwI5gi2bTpjURjov2SM+tSA== 2024-03-13T21:20:06.553 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.5] 2024-03-13T21:20:06.553 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQB8GPJlwE0yJxAAujiJHPdRSkbAsQvvVeGAEw== 2024-03-13T21:20:06.553 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.6] 2024-03-13T21:20:06.553 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQB/GPJlJS7kJBAAf+5tOf9gE1huUTsq9BeWzQ== 2024-03-13T21:20:06.553 INFO:teuthology.orchestra.run.smithi195.stdout:[osd.7] 2024-03-13T21:20:06.553 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQCCGPJlo8fXIhAAJwd7OWEjHlAyyOHDCkm40Q== 2024-03-13T21:20:06.553 INFO:teuthology.orchestra.run.smithi195.stdout:[client.0] 2024-03-13T21:20:06.553 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBpGPJlZIhnBRAA5DAs65s7A1fq2L+V5DHO/A== 2024-03-13T21:20:06.554 INFO:teuthology.orchestra.run.smithi195.stdout:[client.2] 2024-03-13T21:20:06.554 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBpGPJlLCktCxAA9tIw35FM3sDFV0vUuYCIHw== 2024-03-13T21:20:06.554 INFO:teuthology.orchestra.run.smithi195.stdout:[client.1] 2024-03-13T21:20:06.554 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBpGPJlLfyKDhAA1FzMgTEmqNQyx+KcXeefXw== 2024-03-13T21:20:06.554 INFO:teuthology.orchestra.run.smithi195.stdout:[client.3] 2024-03-13T21:20:06.554 INFO:teuthology.orchestra.run.smithi195.stdout: key = AQBpGPJlKg5OFBAA7Oopm0k9wV2Wx5A05Zs0XQ== 2024-03-13T21:20:06.555 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-13T21:20:06.576 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-13T21:20:06.647 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-13T21:20:06.650 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-13T21:20:06.705 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-13T21:20:06.707 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-13T21:20:06.760 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-13T21:20:06.763 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-13T21:20:06.815 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-13T21:20:06.818 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-13T21:20:06.868 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-13T21:20:06.871 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-13T21:20:06.922 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-13T21:20:06.924 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-13T21:20:06.975 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-13T21:20:06.977 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-13T21:20:07.029 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-13T21:20:07.031 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-13T21:20:07.085 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-13T21:20:07.087 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-13T21:20:07.141 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-13T21:20:07.143 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-13T21:20:07.194 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-13T21:20:07.196 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-13T21:20:07.246 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-13T21:20:07.248 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-13T21:20:07.299 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-13T21:20:07.302 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-13T21:20:07.353 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-13T21:20:07.356 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-13T21:20:07.411 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-13T21:20:07.413 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-13T21:20:07.467 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-13T21:20:07.469 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-13T21:20:07.523 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-13T21:20:07.525 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-13T21:20:07.580 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-13T21:20:07.580 DEBUG:teuthology.orchestra.run.smithi107:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-13T21:20:07.607 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-13T21:20:07.703 DEBUG:teuthology.orchestra.run.smithi107:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-13T21:20:07.729 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-13T21:20:07.756 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-13T21:20:07.852 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-13T21:20:07.879 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-13T21:20:07.946 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-13T21:20:08.042 DEBUG:teuthology.orchestra.run.smithi195:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-13T21:20:08.068 DEBUG:teuthology.orchestra.run.smithi107:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-13T21:20:08.071 DEBUG:teuthology.orchestra.run.smithi195:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-13T21:20:08.122 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-13T21:20:08.123 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-13T21:20:08.123 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-13T21:20:08.125 INFO:tasks.ceph.mon.a:Started 2024-03-13T21:20:08.125 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-13T21:20:08.125 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-13T21:20:08.164 INFO:tasks.ceph.mon.b:Started 2024-03-13T21:20:08.165 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-13T21:20:08.165 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-13T21:20:08.166 INFO:tasks.ceph.mon.c:Started 2024-03-13T21:20:08.167 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-13T21:20:08.167 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-13T21:20:08.167 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-13T21:20:08.169 INFO:tasks.ceph.mgr.y:Started 2024-03-13T21:20:08.169 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-13T21:20:08.169 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-13T21:20:08.171 INFO:tasks.ceph.mgr.x:Started 2024-03-13T21:20:08.171 INFO:tasks.ceph:Setting crush tunables to default 2024-03-13T21:20:08.172 DEBUG:teuthology.orchestra.run.smithi107:> sudo ceph --cluster ceph osd crush tunables default 2024-03-13T21:20:08.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.279+0000 7f41f42fc640 1 Processor -- start 2024-03-13T21:20:08.271 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.279+0000 7f41f42fc640 1 -- start start 2024-03-13T21:20:08.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.280+0000 7f41f42fc640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f41ec15f1c0 0x7f41ec06bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:08.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.280+0000 7f41f42fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f41ec06c420 0x7f41ec06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:08.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.280+0000 7f41f42fc640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41ec15e720 con 0x7f41ec1551a0 2024-03-13T21:20:08.273 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.280+0000 7f41f42fc640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f41ec06c850 con 0x7f41ec06c420 2024-03-13T21:20:08.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.280+0000 7f41f42fc640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f41ec0b5300 con 0x7f41ec15f1c0 2024-03-13T21:20:08.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.280+0000 7f41f2899640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f41ec06c420 0x7f41ec06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:08.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.280+0000 7f41f2098640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f41ec1551a0 0x7f41ec0b4580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:57640/0 (socket says 172.21.15.107:57640) 2024-03-13T21:20:08.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.280+0000 7f41f2098640 1 -- 172.21.15.107:0/2182096770 learned_addr learned my addr 172.21.15.107:0/2182096770 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-03-13T21:20:08.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.280+0000 7f41f1897640 1 --2- 172.21.15.107:0/2182096770 >> v2:172.21.15.195:3300/0 conn(0x7f41ec15f1c0 0x7f41ec06bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:08.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.280+0000 7f41f2899640 1 -- 172.21.15.107:0/2182096770 >> v2:172.21.15.107:3300/0 conn(0x7f41ec06c420 msgr2=0x7f41ec06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-13T21:20:08.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.280+0000 7f41f2899640 1 -- 172.21.15.107:0/2182096770 >> v2:172.21.15.107:3300/0 conn(0x7f41ec06c420 msgr2=0x7f41ec06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-13T21:20:08.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.280+0000 7f41f2899640 1 --2- 172.21.15.107:0/2182096770 >> v2:172.21.15.107:3300/0 conn(0x7f41ec06c420 0x7f41ec06ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-13T21:20:08.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.280+0000 7f41f2899640 1 --2- 172.21.15.107:0/2182096770 >> v2:172.21.15.107:3300/0 conn(0x7f41ec06c420 0x7f41ec06ddd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-13T21:20:08.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.280+0000 7f41f1897640 1 -- 172.21.15.107:0/2182096770 >> v2:172.21.15.195:3300/0 conn(0x7f41ec15f1c0 msgr2=0x7f41ec06bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-13T21:20:08.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.280+0000 7f41f1897640 1 -- 172.21.15.107:0/2182096770 >> v2:172.21.15.195:3300/0 conn(0x7f41ec15f1c0 msgr2=0x7f41ec06bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-13T21:20:08.274 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.280+0000 7f41f1897640 1 --2- 172.21.15.107:0/2182096770 >> v2:172.21.15.195:3300/0 conn(0x7f41ec15f1c0 0x7f41ec06bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-13T21:20:08.275 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.280+0000 7f41f1897640 1 --2- 172.21.15.107:0/2182096770 >> v2:172.21.15.195:3300/0 conn(0x7f41ec15f1c0 0x7f41ec06bee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-13T21:20:08.463 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.471+0000 7f41f1096640 1 -- 172.21.15.107:0/2182096770 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3338679601 0 0) 0x7f41ec15e720 con 0x7f41ec1551a0 2024-03-13T21:20:08.464 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.471+0000 7f41f1096640 1 -- 172.21.15.107:0/2182096770 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41d8003520 con 0x7f41ec1551a0 2024-03-13T21:20:08.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f1096640 1 -- 172.21.15.107:0/2182096770 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3820208626 0 0) 0x7f41d8003520 con 0x7f41ec1551a0 2024-03-13T21:20:08.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f1096640 1 -- 172.21.15.107:0/2182096770 >> v2:172.21.15.195:3300/0 conn(0x7f41ec15f1c0 msgr2=0x7f41ec06bee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-13T21:20:08.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f1096640 1 --2- 172.21.15.107:0/2182096770 >> v2:172.21.15.195:3300/0 conn(0x7f41ec15f1c0 0x7f41ec06bee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:08.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f1096640 1 -- 172.21.15.107:0/2182096770 >> v2:172.21.15.107:3300/0 conn(0x7f41ec06c420 msgr2=0x7f41ec06ddd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-13T21:20:08.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f1096640 1 --2- 172.21.15.107:0/2182096770 >> v2:172.21.15.107:3300/0 conn(0x7f41ec06c420 0x7f41ec06ddd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:08.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f1096640 1 -- 172.21.15.107:0/2182096770 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41ec0b5020 con 0x7f41ec1551a0 2024-03-13T21:20:08.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f1096640 1 -- 172.21.15.107:0/2182096770 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1025813135 0 0) 0x7f41e8001670 con 0x7f41ec1551a0 2024-03-13T21:20:08.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f1096640 1 -- 172.21.15.107:0/2182096770 >> v1:172.21.15.107:6789/0 conn(0x7f41ec1551a0 legacy=0x7f41ec0b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:08.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f1096640 1 --2- 172.21.15.107:0/2182096770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41d80039b0 0x7f41d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:08.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f1096640 1 --2- 172.21.15.107:0/2182096770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41d8004310 0x7f41d8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:08.467 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f1096640 1 --2- 172.21.15.107:0/2182096770 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41d8004ee0 0x7f41d800ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:08.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f1096640 1 -- 172.21.15.107:0/2182096770 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f41ec06c850 con 0x7f41d80039b0 2024-03-13T21:20:08.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f1096640 1 -- 172.21.15.107:0/2182096770 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f41ec0b5300 con 0x7f41d8004310 2024-03-13T21:20:08.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f1096640 1 -- 172.21.15.107:0/2182096770 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f41d8010510 con 0x7f41d8004ee0 2024-03-13T21:20:08.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f1897640 1 --2- 172.21.15.107:0/2182096770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41d8004310 0x7f41d8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:08.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f2899640 1 --2- 172.21.15.107:0/2182096770 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41d8004ee0 0x7f41d800ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:08.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f2098640 1 --2- 172.21.15.107:0/2182096770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41d80039b0 0x7f41d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:08.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f2899640 1 -- 172.21.15.107:0/2182096770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41d8004310 msgr2=0x7f41d8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:08.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f2899640 1 --2- 172.21.15.107:0/2182096770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41d8004310 0x7f41d8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:08.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f2899640 1 -- 172.21.15.107:0/2182096770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41d80039b0 msgr2=0x7f41d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:08.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f2899640 1 --2- 172.21.15.107:0/2182096770 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41d80039b0 0x7f41d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:08.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f2899640 1 -- 172.21.15.107:0/2182096770 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d8003520 con 0x7f41d8004ee0 2024-03-13T21:20:08.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.472+0000 7f41f1897640 1 --2- 172.21.15.107:0/2182096770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41d8004310 0x7f41d8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-13T21:20:08.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.473+0000 7f41f2899640 1 -- 172.21.15.107:0/2182096770 reap_dead start 2024-03-13T21:20:08.468 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.473+0000 7f41f2899640 1 --2- 172.21.15.107:0/2182096770 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41d8004ee0 0x7f41d800ffd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009fd0 tx=0x7f41d8005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=700fd7037f9cacb4 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:08.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.473+0000 7f41f1096640 1 -- 172.21.15.107:0/2182096770 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e4039070 con 0x7f41d8004ee0 2024-03-13T21:20:08.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.473+0000 7f41f1096640 1 -- 172.21.15.107:0/2182096770 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e402ccd0 con 0x7f41d8004ee0 2024-03-13T21:20:08.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.473+0000 7f41f1096640 1 -- 172.21.15.107:0/2182096770 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e000b5e0 con 0x7f41d8004ee0 2024-03-13T21:20:08.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.474+0000 7f41f42fc640 1 -- 172.21.15.107:0/2182096770 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41d8004ee0 msgr2=0x7f41d800ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:08.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.474+0000 7f41f42fc640 1 --2- 172.21.15.107:0/2182096770 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41d8004ee0 0x7f41d800ffd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f41e4009fd0 tx=0x7f41d8005830 comp rx=0 tx=0).stop 2024-03-13T21:20:08.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.474+0000 7f41f42fc640 1 -- 172.21.15.107:0/2182096770 shutdown_connections 2024-03-13T21:20:08.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.474+0000 7f41f42fc640 1 --2- 172.21.15.107:0/2182096770 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41d8004ee0 0x7f41d800ffd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:08.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.474+0000 7f41f42fc640 1 -- 172.21.15.107:0/2182096770 >> 172.21.15.107:0/2182096770 conn(0x7f41ec0b2660 msgr2=0x7f41ec0b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:08.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.474+0000 7f41f42fc640 1 -- 172.21.15.107:0/2182096770 shutdown_connections 2024-03-13T21:20:08.469 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.474+0000 7f41f42fc640 1 -- 172.21.15.107:0/2182096770 wait complete. 2024-03-13T21:20:08.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.476+0000 7f41f42fc640 1 Processor -- start 2024-03-13T21:20:08.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.476+0000 7f41f42fc640 1 -- start start 2024-03-13T21:20:08.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.476+0000 7f41f42fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41d8004ee0 0x7f41ec148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:08.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.476+0000 7f41f42fc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41ec147b40 0x7f41ec153220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:08.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.476+0000 7f41f42fc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41ec15abb0 0x7f41ec153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:08.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.476+0000 7f41f42fc640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f41ec15be40 con 0x7f41d8004ee0 2024-03-13T21:20:08.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.476+0000 7f41f42fc640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f41ec15eca0 con 0x7f41ec147b40 2024-03-13T21:20:08.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.476+0000 7f41f42fc640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f41ec0b4580 con 0x7f41ec15abb0 2024-03-13T21:20:08.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.477+0000 7f41f2098640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41d8004ee0 0x7f41ec148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:08.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.477+0000 7f41f2899640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41ec15abb0 0x7f41ec153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:08.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.477+0000 7f41f1897640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41ec147b40 0x7f41ec153220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:08.472 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.477+0000 7f41f2899640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41ec15abb0 0x7f41ec153760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.107:35484/0 (socket says 172.21.15.107:35484) 2024-03-13T21:20:08.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.477+0000 7f41f2098640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41d8004ee0 0x7f41ec148470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36406/0 (socket says 172.21.15.107:36406) 2024-03-13T21:20:08.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.477+0000 7f41f2899640 1 -- 172.21.15.107:0/3007632655 learned_addr learned my addr 172.21.15.107:0/3007632655 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-03-13T21:20:08.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.477+0000 7f41f2098640 1 -- 172.21.15.107:0/3007632655 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41ec15abb0 msgr2=0x7f41ec153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:08.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.477+0000 7f41f2098640 1 --2- 172.21.15.107:0/3007632655 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41ec15abb0 0x7f41ec153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:08.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.477+0000 7f41f2098640 1 -- 172.21.15.107:0/3007632655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41ec147b40 msgr2=0x7f41ec153220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:08.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.477+0000 7f41f2098640 1 --2- 172.21.15.107:0/3007632655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41ec147b40 0x7f41ec153220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:08.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.477+0000 7f41f2098640 1 -- 172.21.15.107:0/3007632655 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41ec158bb0 con 0x7f41d8004ee0 2024-03-13T21:20:08.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.477+0000 7f41f2098640 1 --2- 172.21.15.107:0/3007632655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41d8004ee0 0x7f41ec148470 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f41e8004fa0 tx=0x7f41e80074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:08.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.477+0000 7f41deffd640 1 -- 172.21.15.107:0/3007632655 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e8007740 con 0x7f41d8004ee0 2024-03-13T21:20:08.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.477+0000 7f41deffd640 1 -- 172.21.15.107:0/3007632655 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e8018070 con 0x7f41d8004ee0 2024-03-13T21:20:08.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.477+0000 7f41deffd640 1 -- 172.21.15.107:0/3007632655 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e800fbd0 con 0x7f41d8004ee0 2024-03-13T21:20:08.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.477+0000 7f41f42fc640 1 -- 172.21.15.107:0/3007632655 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41ec158e90 con 0x7f41d8004ee0 2024-03-13T21:20:08.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.477+0000 7f41f42fc640 1 -- 172.21.15.107:0/3007632655 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41ec157fb0 con 0x7f41d8004ee0 2024-03-13T21:20:08.473 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.478+0000 7f41deffd640 1 -- 172.21.15.107:0/3007632655 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f41e801d460 con 0x7f41d8004ee0 2024-03-13T21:20:08.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.478+0000 7f41deffd640 1 -- 172.21.15.107:0/3007632655 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f41e80136a0 con 0x7f41d8004ee0 2024-03-13T21:20:08.474 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.479+0000 7f41f42fc640 1 -- 172.21.15.107:0/3007632655 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41ec1581b0 con 0x7f41d8004ee0 2024-03-13T21:20:08.475 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.482+0000 7f41deffd640 1 -- 172.21.15.107:0/3007632655 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f41ec1581b0 con 0x7f41d8004ee0 2024-03-13T21:20:08.541 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.548+0000 7f41f42fc640 1 -- 172.21.15.107:0/3007632655 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f41ec06cf40 con 0x7f41d8004ee0 2024-03-13T21:20:08.542 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.550+0000 7f41deffd640 1 -- 172.21.15.107:0/3007632655 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f41e800fd70 con 0x7f41d8004ee0 2024-03-13T21:20:08.543 INFO:teuthology.orchestra.run.smithi107.stderr:adjusted tunables profile to default 2024-03-13T21:20:08.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.551+0000 7f41f42fc640 1 -- 172.21.15.107:0/3007632655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41d8004ee0 msgr2=0x7f41ec148470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:08.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.551+0000 7f41f42fc640 1 --2- 172.21.15.107:0/3007632655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41d8004ee0 0x7f41ec148470 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f41e8004fa0 tx=0x7f41e80074f0 comp rx=0 tx=0).stop 2024-03-13T21:20:08.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.551+0000 7f41f42fc640 1 -- 172.21.15.107:0/3007632655 shutdown_connections 2024-03-13T21:20:08.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.551+0000 7f41f42fc640 1 --2- 172.21.15.107:0/3007632655 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f41ec15abb0 0x7f41ec153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:08.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.551+0000 7f41f42fc640 1 --2- 172.21.15.107:0/3007632655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41ec147b40 0x7f41ec153220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:08.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.551+0000 7f41f42fc640 1 --2- 172.21.15.107:0/3007632655 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f41d8004ee0 0x7f41ec148470 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:08.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.551+0000 7f41f42fc640 1 -- 172.21.15.107:0/3007632655 >> 172.21.15.107:0/3007632655 conn(0x7f41ec0b2660 msgr2=0x7f41ec154290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:08.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.551+0000 7f41f42fc640 1 -- 172.21.15.107:0/3007632655 shutdown_connections 2024-03-13T21:20:08.544 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:08.551+0000 7f41f42fc640 1 -- 172.21.15.107:0/3007632655 wait complete. 2024-03-13T21:20:08.554 INFO:tasks.ceph:check_enable_crimson: False 2024-03-13T21:20:08.554 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-13T21:20:08.555 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:20:08.555 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-13T21:20:08.581 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:20:08.581 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-13T21:20:08.648 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:20:08.648 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-13T21:20:08.715 DEBUG:teuthology.orchestra.run.smithi107:> set -ex 2024-03-13T21:20:08.715 DEBUG:teuthology.orchestra.run.smithi107:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-13T21:20:08.782 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:20:08.782 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-13T21:20:08.809 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:20:08.810 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-13T21:20:08.877 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:20:08.877 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-13T21:20:08.944 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2024-03-13T21:20:08.944 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-13T21:20:08.955 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:08.963+0000 7f4898c32040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-13T21:20:08.972 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:08.980+0000 7fab46a42040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-13T21:20:08.981 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new c2acc15b-5d55-4ce3-be7d-42c4498c7ade 0 2024-03-13T21:20:09.012 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:09.020+0000 7f4898c32040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-13T21:20:09.025 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:09.033+0000 7fab46a42040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-13T21:20:09.111 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.119+0000 7f1eef4ab640 1 Processor -- start 2024-03-13T21:20:09.112 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.119+0000 7f1eef4ab640 1 -- start start 2024-03-13T21:20:09.113 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.120+0000 7f1eef4ab640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ee8159530 0x7f1ee80b5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.114 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.120+0000 7f1eef4ab640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1ee80b5950 0x7f1ee806add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.114 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.120+0000 7f1eef4ab640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ee80b3a00 con 0x7f1ee80ceb20 2024-03-13T21:20:09.114 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.120+0000 7f1eef4ab640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f1ee80b3ce0 con 0x7f1ee80b5950 2024-03-13T21:20:09.114 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.120+0000 7f1eef4ab640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee80b3fc0 con 0x7f1ee8159530 2024-03-13T21:20:09.114 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.120+0000 7f1eed247640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ee8159530 0x7f1ee80b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.114 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.120+0000 7f1eeca46640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f1ee80b5950 0x7f1ee806add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.114 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.120+0000 7f1eed247640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ee8159530 0x7f1ee80b5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:47314/0 (socket says 172.21.15.195:47314) 2024-03-13T21:20:09.114 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.120+0000 7f1eed247640 1 -- 172.21.15.195:0/3376673241 learned_addr learned my addr 172.21.15.195:0/3376673241 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-13T21:20:09.114 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.120+0000 7f1eed247640 1 -- 172.21.15.195:0/3376673241 >> v2:172.21.15.195:3300/0 conn(0x7f1ee80b5950 msgr2=0x7f1ee806add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:09.114 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.120+0000 7f1eed247640 1 --2- 172.21.15.195:0/3376673241 >> v2:172.21.15.195:3300/0 conn(0x7f1ee80b5950 0x7f1ee806add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.114 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.120+0000 7f1eed247640 1 -- 172.21.15.195:0/3376673241 >> v1:172.21.15.107:6789/0 conn(0x7f1ee80ceb20 legacy=0x7f1ee815f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.114 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.120+0000 7f1eed247640 1 -- 172.21.15.195:0/3376673241 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee80b42a0 con 0x7f1ee8159530 2024-03-13T21:20:09.114 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.120+0000 7f1eeca46640 1 --2- 172.21.15.195:0/3376673241 >> v2:172.21.15.195:3300/0 conn(0x7f1ee80b5950 0x7f1ee806add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-13T21:20:09.115 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.121+0000 7f1eed247640 1 --2- 172.21.15.195:0/3376673241 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ee8159530 0x7f1ee80b5410 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8009870 tx=0x7f1ed802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2abb0a101037c7c1 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:09.115 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.121+0000 7f1edffff640 1 -- 172.21.15.195:0/3376673241 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8034070 con 0x7f1ee8159530 2024-03-13T21:20:09.115 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.121+0000 7f1edffff640 1 -- 172.21.15.195:0/3376673241 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed8030840 con 0x7f1ee8159530 2024-03-13T21:20:09.115 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.121+0000 7f1edffff640 1 -- 172.21.15.195:0/3376673241 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8030c10 con 0x7f1ee8159530 2024-03-13T21:20:09.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.122+0000 7f1eef4ab640 1 -- 172.21.15.195:0/3376673241 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ee8159530 msgr2=0x7f1ee80b5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.122+0000 7f1eef4ab640 1 --2- 172.21.15.195:0/3376673241 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ee8159530 0x7f1ee80b5410 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8009870 tx=0x7f1ed802b980 comp rx=0 tx=0).stop 2024-03-13T21:20:09.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.122+0000 7f1eef4ab640 1 -- 172.21.15.195:0/3376673241 shutdown_connections 2024-03-13T21:20:09.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.122+0000 7f1eef4ab640 1 --2- 172.21.15.195:0/3376673241 >> v2:172.21.15.195:3300/0 conn(0x7f1ee80b5950 0x7f1ee806add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.122+0000 7f1eef4ab640 1 --2- 172.21.15.195:0/3376673241 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ee8159530 0x7f1ee80b5410 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.122+0000 7f1eef4ab640 1 -- 172.21.15.195:0/3376673241 >> 172.21.15.195:0/3376673241 conn(0x7f1ee80d0880 msgr2=0x7f1ee80d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:09.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.122+0000 7f1eef4ab640 1 -- 172.21.15.195:0/3376673241 shutdown_connections 2024-03-13T21:20:09.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.122+0000 7f1eef4ab640 1 -- 172.21.15.195:0/3376673241 wait complete. 2024-03-13T21:20:09.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.123+0000 7f1eef4ab640 1 Processor -- start 2024-03-13T21:20:09.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.123+0000 7f1eef4ab640 1 -- start start 2024-03-13T21:20:09.118 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eef4ab640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ee80b5950 0x7f1ee806ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eef4ab640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ee80ceb20 0x7f1ee8156660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eef4ab640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ee8159530 0x7f1ee814b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eef4ab640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee815cda0 con 0x7f1ee80b5950 2024-03-13T21:20:09.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eef4ab640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee8159910 con 0x7f1ee80ceb20 2024-03-13T21:20:09.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eef4ab640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee815cf20 con 0x7f1ee8159530 2024-03-13T21:20:09.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eeca46640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ee80ceb20 0x7f1ee8156660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eeda48640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ee8159530 0x7f1ee814b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eeca46640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ee80ceb20 0x7f1ee8156660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:52184/0 (socket says 172.21.15.195:52184) 2024-03-13T21:20:09.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eeca46640 1 -- 172.21.15.195:0/1362959719 learned_addr learned my addr 172.21.15.195:0/1362959719 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-13T21:20:09.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eed247640 1 --2- 172.21.15.195:0/1362959719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ee80b5950 0x7f1ee806ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eeda48640 1 -- 172.21.15.195:0/1362959719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ee80ceb20 msgr2=0x7f1ee8156660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eeda48640 1 --2- 172.21.15.195:0/1362959719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ee80ceb20 0x7f1ee8156660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eeda48640 1 -- 172.21.15.195:0/1362959719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ee80b5950 msgr2=0x7f1ee806ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eeda48640 1 --2- 172.21.15.195:0/1362959719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ee80b5950 0x7f1ee806ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.119 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eeda48640 1 -- 172.21.15.195:0/1362959719 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee814f540 con 0x7f1ee8159530 2024-03-13T21:20:09.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eeca46640 1 --2- 172.21.15.195:0/1362959719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ee80ceb20 0x7f1ee8156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-13T21:20:09.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eeda48640 1 --2- 172.21.15.195:0/1362959719 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ee8159530 0x7f1ee814b300 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000c690 tx=0x7f1ee000cb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:09.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eddffb640 1 -- 172.21.15.195:0/1362959719 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0003b70 con 0x7f1ee8159530 2024-03-13T21:20:09.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eddffb640 1 -- 172.21.15.195:0/1362959719 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee0003d10 con 0x7f1ee8159530 2024-03-13T21:20:09.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eef4ab640 1 -- 172.21.15.195:0/1362959719 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee80cbd60 con 0x7f1ee8159530 2024-03-13T21:20:09.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.124+0000 7f1eddffb640 1 -- 172.21.15.195:0/1362959719 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee0005310 con 0x7f1ee8159530 2024-03-13T21:20:09.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.125+0000 7f1eef4ab640 1 -- 172.21.15.195:0/1362959719 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee80cc320 con 0x7f1ee8159530 2024-03-13T21:20:09.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.125+0000 7f1eddffb640 1 -- 172.21.15.195:0/1362959719 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1ee00054b0 con 0x7f1ee8159530 2024-03-13T21:20:09.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.125+0000 7f1eddffb640 1 -- 172.21.15.195:0/1362959719 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f1ee0012830 con 0x7f1ee8159530 2024-03-13T21:20:09.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.125+0000 7f1eef4ab640 1 -- 172.21.15.195:0/1362959719 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee8075120 con 0x7f1ee8159530 2024-03-13T21:20:09.120 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.128+0000 7f1eddffb640 1 -- 172.21.15.195:0/1362959719 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1ee0012a80 con 0x7f1ee8159530 2024-03-13T21:20:09.191 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.199+0000 7f1eef4ab640 1 -- 172.21.15.195:0/1362959719 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c2acc15b-5d55-4ce3-be7d-42c4498c7ade", "id": 0} v 0) -- 0x7f1ee815f2d0 con 0x7f1ee8159530 2024-03-13T21:20:09.194 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.201+0000 7f1eddffb640 1 -- 172.21.15.195:0/1362959719 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c2acc15b-5d55-4ce3-be7d-42c4498c7ade", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f1ee0012c60 con 0x7f1ee8159530 2024-03-13T21:20:09.194 INFO:teuthology.orchestra.run.smithi195.stdout:0 2024-03-13T21:20:09.195 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.202+0000 7f1eef4ab640 1 -- 172.21.15.195:0/1362959719 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ee8159530 msgr2=0x7f1ee814b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.195 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.202+0000 7f1eef4ab640 1 --2- 172.21.15.195:0/1362959719 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ee8159530 0x7f1ee814b300 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1ee000c690 tx=0x7f1ee000cb50 comp rx=0 tx=0).stop 2024-03-13T21:20:09.195 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.202+0000 7f1eef4ab640 1 -- 172.21.15.195:0/1362959719 shutdown_connections 2024-03-13T21:20:09.195 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.202+0000 7f1eef4ab640 1 --2- 172.21.15.195:0/1362959719 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f1ee8159530 0x7f1ee814b300 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.195 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.202+0000 7f1eef4ab640 1 --2- 172.21.15.195:0/1362959719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1ee80ceb20 0x7f1ee8156660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.195 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.202+0000 7f1eef4ab640 1 --2- 172.21.15.195:0/1362959719 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f1ee80b5950 0x7f1ee806ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.196 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.202+0000 7f1eef4ab640 1 -- 172.21.15.195:0/1362959719 >> 172.21.15.195:0/1362959719 conn(0x7f1ee80d0880 msgr2=0x7f1ee806c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:09.196 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.202+0000 7f1eef4ab640 1 -- 172.21.15.195:0/1362959719 shutdown_connections 2024-03-13T21:20:09.196 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.202+0000 7f1eef4ab640 1 -- 172.21.15.195:0/1362959719 wait complete. 2024-03-13T21:20:09.205 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 6452e15a-de59-4bb8-b50b-ed0c73193d57 1 2024-03-13T21:20:09.305 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.312+0000 7fe7d6644640 1 Processor -- start 2024-03-13T21:20:09.305 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.313+0000 7fe7d6644640 1 -- start start 2024-03-13T21:20:09.307 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.313+0000 7fe7d6644640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7d00cc150 0x7fe7d015f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.307 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.313+0000 7fe7d6644640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe7d00ce2a0 0x7fe7d00ca610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.307 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.313+0000 7fe7d6644640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7d006b5b0 con 0x7fe7d006add0 2024-03-13T21:20:09.307 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.313+0000 7fe7d6644640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fe7d00cc530 con 0x7fe7d00ce2a0 2024-03-13T21:20:09.307 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.313+0000 7fe7d6644640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d006c1c0 con 0x7fe7d00cc150 2024-03-13T21:20:09.307 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.313+0000 7fe7d4be1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe7d00ce2a0 0x7fe7d00ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.307 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.313+0000 7fe7cffff640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7d00cc150 0x7fe7d015f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.307 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.313+0000 7fe7d4be1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fe7d00ce2a0 0x7fe7d00ca610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:52186/0 (socket says 172.21.15.195:52186) 2024-03-13T21:20:09.307 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.313+0000 7fe7d4be1640 1 -- 172.21.15.195:0/1219667133 learned_addr learned my addr 172.21.15.195:0/1219667133 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-13T21:20:09.307 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.314+0000 7fe7ceffd640 1 -- 172.21.15.195:0/1219667133 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1371687062 0 0) 0x7fe7d006b5b0 con 0x7fe7d006add0 2024-03-13T21:20:09.307 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.314+0000 7fe7d4be1640 1 -- 172.21.15.195:0/1219667133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7d00cc150 msgr2=0x7fe7d015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:09.307 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.314+0000 7fe7d4be1640 1 --2- 172.21.15.195:0/1219667133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7d00cc150 0x7fe7d015f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.308 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.314+0000 7fe7d4be1640 1 -- 172.21.15.195:0/1219667133 >> v1:172.21.15.195:6789/0 conn(0x7fe7d006add0 legacy=0x7fe7d00cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.308 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.314+0000 7fe7d4be1640 1 -- 172.21.15.195:0/1219667133 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d006b890 con 0x7fe7d00ce2a0 2024-03-13T21:20:09.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.315+0000 7fe7d4be1640 1 --2- 172.21.15.195:0/1219667133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d00ce2a0 0x7fe7d00ca610 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8009e80 tx=0x7fe7c802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1487689739aa1901 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:09.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.315+0000 7fe7ceffd640 1 -- 172.21.15.195:0/1219667133 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c802caf0 con 0x7fe7d00ce2a0 2024-03-13T21:20:09.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.315+0000 7fe7ceffd640 1 -- 172.21.15.195:0/1219667133 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c802cc90 con 0x7fe7d00ce2a0 2024-03-13T21:20:09.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.315+0000 7fe7ceffd640 1 -- 172.21.15.195:0/1219667133 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8034610 con 0x7fe7d00ce2a0 2024-03-13T21:20:09.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.316+0000 7fe7d6644640 1 -- 172.21.15.195:0/1219667133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d00ce2a0 msgr2=0x7fe7d00ca610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.316+0000 7fe7d6644640 1 --2- 172.21.15.195:0/1219667133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d00ce2a0 0x7fe7d00ca610 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe7c8009e80 tx=0x7fe7c802bf50 comp rx=0 tx=0).stop 2024-03-13T21:20:09.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.316+0000 7fe7d6644640 1 -- 172.21.15.195:0/1219667133 shutdown_connections 2024-03-13T21:20:09.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.316+0000 7fe7d6644640 1 --2- 172.21.15.195:0/1219667133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d00ce2a0 0x7fe7d00ca610 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.316+0000 7fe7d6644640 1 --2- 172.21.15.195:0/1219667133 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7d00cc150 0x7fe7d015f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.309 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.316+0000 7fe7d6644640 1 -- 172.21.15.195:0/1219667133 >> 172.21.15.195:0/1219667133 conn(0x7fe7d00cffc0 msgr2=0x7fe7d00d03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:09.310 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.316+0000 7fe7d6644640 1 -- 172.21.15.195:0/1219667133 shutdown_connections 2024-03-13T21:20:09.310 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.316+0000 7fe7d6644640 1 -- 172.21.15.195:0/1219667133 wait complete. 2024-03-13T21:20:09.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.317+0000 7fe7d6644640 1 Processor -- start 2024-03-13T21:20:09.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.317+0000 7fe7d6644640 1 -- start start 2024-03-13T21:20:09.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7d6644640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d006add0 0x7fe7d00ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7d6644640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7d00cc150 0x7fe7d015a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7d6644640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7d00ce2a0 0x7fe7d015d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.312 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7d6644640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d006b230 con 0x7fe7d00ce2a0 2024-03-13T21:20:09.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7d6644640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d006be50 con 0x7fe7d006add0 2024-03-13T21:20:09.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7d6644640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d006c650 con 0x7fe7d00cc150 2024-03-13T21:20:09.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7cffff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d006add0 0x7fe7d00ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7cffff640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d006add0 0x7fe7d00ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:52194/0 (socket says 172.21.15.195:52194) 2024-03-13T21:20:09.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7cf7fe640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7d00cc150 0x7fe7d015a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7cffff640 1 -- 172.21.15.195:0/3628171269 learned_addr learned my addr 172.21.15.195:0/3628171269 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-13T21:20:09.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7d4be1640 1 --2- 172.21.15.195:0/3628171269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7d00ce2a0 0x7fe7d015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7cffff640 1 -- 172.21.15.195:0/3628171269 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7d00cc150 msgr2=0x7fe7d015a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7cffff640 1 --2- 172.21.15.195:0/3628171269 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7d00cc150 0x7fe7d015a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7cffff640 1 -- 172.21.15.195:0/3628171269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7d00ce2a0 msgr2=0x7fe7d015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7cffff640 1 --2- 172.21.15.195:0/3628171269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7d00ce2a0 0x7fe7d015d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7cffff640 1 -- 172.21.15.195:0/3628171269 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d015d990 con 0x7fe7d006add0 2024-03-13T21:20:09.313 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7cf7fe640 1 --2- 172.21.15.195:0/3628171269 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7d00cc150 0x7fe7d015a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-13T21:20:09.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7cffff640 1 --2- 172.21.15.195:0/3628171269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d006add0 0x7fe7d00ca700 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400e9b0 tx=0x7fe7c400ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:09.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.318+0000 7fe7ccff9640 1 -- 172.21.15.195:0/3628171269 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c4017070 con 0x7fe7d006add0 2024-03-13T21:20:09.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.319+0000 7fe7ccff9640 1 -- 172.21.15.195:0/3628171269 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c400c9a0 con 0x7fe7d006add0 2024-03-13T21:20:09.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.319+0000 7fe7ccff9640 1 -- 172.21.15.195:0/3628171269 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c400cd90 con 0x7fe7d006add0 2024-03-13T21:20:09.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.319+0000 7fe7d6644640 1 -- 172.21.15.195:0/3628171269 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d015dc70 con 0x7fe7d006add0 2024-03-13T21:20:09.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.319+0000 7fe7d6644640 1 -- 172.21.15.195:0/3628171269 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d00b3d90 con 0x7fe7d006add0 2024-03-13T21:20:09.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.319+0000 7fe7ccff9640 1 -- 172.21.15.195:0/3628171269 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe7c401a070 con 0x7fe7d006add0 2024-03-13T21:20:09.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.319+0000 7fe7ccff9640 1 -- 172.21.15.195:0/3628171269 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fe7c401c970 con 0x7fe7d006add0 2024-03-13T21:20:09.314 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.320+0000 7fe7d6644640 1 -- 172.21.15.195:0/3628171269 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7d0075120 con 0x7fe7d006add0 2024-03-13T21:20:09.315 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.322+0000 7fe7ccff9640 1 -- 172.21.15.195:0/3628171269 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe7c401cbc0 con 0x7fe7d006add0 2024-03-13T21:20:09.414 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.421+0000 7fe7d6644640 1 -- 172.21.15.195:0/3628171269 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6452e15a-de59-4bb8-b50b-ed0c73193d57", "id": 1} v 0) -- 0x7fe7d00aff90 con 0x7fe7d006add0 2024-03-13T21:20:09.419 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.427+0000 7fe7ccff9640 1 -- 172.21.15.195:0/3628171269 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6452e15a-de59-4bb8-b50b-ed0c73193d57", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fe7c4005990 con 0x7fe7d006add0 2024-03-13T21:20:09.419 INFO:teuthology.orchestra.run.smithi195.stdout:1 2024-03-13T21:20:09.420 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.427+0000 7fe7d6644640 1 -- 172.21.15.195:0/3628171269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d006add0 msgr2=0x7fe7d00ca700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.420 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.427+0000 7fe7d6644640 1 --2- 172.21.15.195:0/3628171269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d006add0 0x7fe7d00ca700 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe7c400e9b0 tx=0x7fe7c400ee70 comp rx=0 tx=0).stop 2024-03-13T21:20:09.420 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.428+0000 7fe7d6644640 1 -- 172.21.15.195:0/3628171269 shutdown_connections 2024-03-13T21:20:09.420 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.428+0000 7fe7d6644640 1 --2- 172.21.15.195:0/3628171269 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fe7d00ce2a0 0x7fe7d015d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.421 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.428+0000 7fe7d6644640 1 --2- 172.21.15.195:0/3628171269 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fe7d00cc150 0x7fe7d015a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.421 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.428+0000 7fe7d6644640 1 --2- 172.21.15.195:0/3628171269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7d006add0 0x7fe7d00ca700 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.421 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.428+0000 7fe7d6644640 1 -- 172.21.15.195:0/3628171269 >> 172.21.15.195:0/3628171269 conn(0x7fe7d00cffc0 msgr2=0x7fe7d015e530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:09.421 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.428+0000 7fe7d6644640 1 -- 172.21.15.195:0/3628171269 shutdown_connections 2024-03-13T21:20:09.421 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.428+0000 7fe7d6644640 1 -- 172.21.15.195:0/3628171269 wait complete. 2024-03-13T21:20:09.434 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 6ec15277-ca0f-47b0-a89f-2fa53a606ed9 2 2024-03-13T21:20:09.536 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.544+0000 7f9257da4640 1 Processor -- start 2024-03-13T21:20:09.536 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.544+0000 7f9257da4640 1 -- start start 2024-03-13T21:20:09.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.545+0000 7f9257da4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9250071d80 0x7f92500b5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.545+0000 7f9257da4640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f92500cec70 0x7f92500b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.545+0000 7f9257da4640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f925015e900 con 0x7f9250144460 2024-03-13T21:20:09.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.545+0000 7f9257da4640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f92500b5e80 con 0x7f92500cec70 2024-03-13T21:20:09.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.545+0000 7f9257da4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f925015ebe0 con 0x7f9250071d80 2024-03-13T21:20:09.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.545+0000 7f9255b40640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f9250144460 0x7f9250071670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:40698/0 (socket says 172.21.15.195:40698) 2024-03-13T21:20:09.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.545+0000 7f9255b40640 1 -- 172.21.15.195:0/2714117581 learned_addr learned my addr 172.21.15.195:0/2714117581 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-03-13T21:20:09.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.545+0000 7f925533f640 1 --2- 172.21.15.195:0/2714117581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9250071d80 0x7f92500b5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.545+0000 7f9256341640 1 --2- 172.21.15.195:0/2714117581 >> v2:172.21.15.107:3300/0 conn(0x7f92500cec70 0x7f92500b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.538 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.545+0000 7f9254b3e640 1 -- 172.21.15.195:0/2714117581 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656196665 0 0) 0x7f925015e900 con 0x7f9250144460 2024-03-13T21:20:09.539 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.545+0000 7f9254b3e640 1 -- 172.21.15.195:0/2714117581 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f923c003520 con 0x7f9250144460 2024-03-13T21:20:09.539 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.545+0000 7f925533f640 1 -- 172.21.15.195:0/2714117581 >> v2:172.21.15.107:3300/0 conn(0x7f92500cec70 msgr2=0x7f92500b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:09.539 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.545+0000 7f925533f640 1 --2- 172.21.15.195:0/2714117581 >> v2:172.21.15.107:3300/0 conn(0x7f92500cec70 0x7f92500b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.539 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.545+0000 7f925533f640 1 -- 172.21.15.195:0/2714117581 >> v1:172.21.15.195:6789/0 conn(0x7f9250144460 legacy=0x7f9250071670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.539 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.545+0000 7f925533f640 1 -- 172.21.15.195:0/2714117581 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f925015eec0 con 0x7f9250071d80 2024-03-13T21:20:09.540 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.546+0000 7f925533f640 1 --2- 172.21.15.195:0/2714117581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9250071d80 0x7f92500b5940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f92400097a0 tx=0x7f924002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71db042f7c754143 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:09.540 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.546+0000 7f9254b3e640 1 -- 172.21.15.195:0/2714117581 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240035020 con 0x7f9250071d80 2024-03-13T21:20:09.540 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.546+0000 7f9254b3e640 1 -- 172.21.15.195:0/2714117581 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9240031830 con 0x7f9250071d80 2024-03-13T21:20:09.540 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.546+0000 7f9254b3e640 1 -- 172.21.15.195:0/2714117581 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240031c00 con 0x7f9250071d80 2024-03-13T21:20:09.540 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.547+0000 7f9257da4640 1 -- 172.21.15.195:0/2714117581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9250071d80 msgr2=0x7f92500b5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.541 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.547+0000 7f9257da4640 1 --2- 172.21.15.195:0/2714117581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9250071d80 0x7f92500b5940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f92400097a0 tx=0x7f924002b8d0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.541 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.547+0000 7f9257da4640 1 -- 172.21.15.195:0/2714117581 shutdown_connections 2024-03-13T21:20:09.541 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.547+0000 7f9257da4640 1 --2- 172.21.15.195:0/2714117581 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9250071d80 0x7f92500b5940 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.541 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.547+0000 7f9257da4640 1 --2- 172.21.15.195:0/2714117581 >> v2:172.21.15.107:3300/0 conn(0x7f92500cec70 0x7f92500b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.541 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.547+0000 7f9257da4640 1 -- 172.21.15.195:0/2714117581 >> 172.21.15.195:0/2714117581 conn(0x7f92500b28b0 msgr2=0x7f92500b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:09.541 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.547+0000 7f9257da4640 1 -- 172.21.15.195:0/2714117581 shutdown_connections 2024-03-13T21:20:09.541 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.547+0000 7f9257da4640 1 -- 172.21.15.195:0/2714117581 wait complete. 2024-03-13T21:20:09.541 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.548+0000 7f9257da4640 1 Processor -- start 2024-03-13T21:20:09.541 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.548+0000 7f9257da4640 1 -- start start 2024-03-13T21:20:09.543 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f9257da4640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9250071d80 0x7f92501555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.543 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f9257da4640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92500cec70 0x7f9250159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.543 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f9257da4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9250144460 0x7f9250138180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f9257da4640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f925015e520 con 0x7f9250144460 2024-03-13T21:20:09.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f9257da4640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f925006f380 con 0x7f92500cec70 2024-03-13T21:20:09.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f9257da4640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f925015e6a0 con 0x7f9250071d80 2024-03-13T21:20:09.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f9255b40640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9250071d80 0x7f92501555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f9255b40640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9250071d80 0x7f92501555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:47360/0 (socket says 172.21.15.195:47360) 2024-03-13T21:20:09.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f9255b40640 1 -- 172.21.15.195:0/3721755090 learned_addr learned my addr 172.21.15.195:0/3721755090 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-13T21:20:09.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f925533f640 1 --2- 172.21.15.195:0/3721755090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92500cec70 0x7f9250159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f9256341640 1 --2- 172.21.15.195:0/3721755090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9250144460 0x7f9250138180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f9255b40640 1 -- 172.21.15.195:0/3721755090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92500cec70 msgr2=0x7f9250159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f9255b40640 1 --2- 172.21.15.195:0/3721755090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92500cec70 0x7f9250159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f9255b40640 1 -- 172.21.15.195:0/3721755090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9250144460 msgr2=0x7f9250138180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f9255b40640 1 --2- 172.21.15.195:0/3721755090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9250144460 0x7f9250138180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.544 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f9255b40640 1 -- 172.21.15.195:0/3721755090 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9250141790 con 0x7f9250071d80 2024-03-13T21:20:09.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f9255b40640 1 --2- 172.21.15.195:0/3721755090 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9250071d80 0x7f92501555d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f924c00c390 tx=0x7f924c00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:09.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f92467fc640 1 -- 172.21.15.195:0/3721755090 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c017070 con 0x7f9250071d80 2024-03-13T21:20:09.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f92467fc640 1 -- 172.21.15.195:0/3721755090 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f924c005ce0 con 0x7f9250071d80 2024-03-13T21:20:09.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f9257da4640 1 -- 172.21.15.195:0/3721755090 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9250155c60 con 0x7f9250071d80 2024-03-13T21:20:09.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f92467fc640 1 -- 172.21.15.195:0/3721755090 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f924c0072f0 con 0x7f9250071d80 2024-03-13T21:20:09.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f9257da4640 1 -- 172.21.15.195:0/3721755090 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9250156220 con 0x7f9250071d80 2024-03-13T21:20:09.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f92467fc640 1 -- 172.21.15.195:0/3721755090 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f924c01a070 con 0x7f9250071d80 2024-03-13T21:20:09.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.549+0000 7f92467fc640 1 -- 172.21.15.195:0/3721755090 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f924c012820 con 0x7f9250071d80 2024-03-13T21:20:09.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.550+0000 7f9257da4640 1 -- 172.21.15.195:0/3721755090 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f925015be10 con 0x7f9250071d80 2024-03-13T21:20:09.545 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.552+0000 7f92467fc640 1 -- 172.21.15.195:0/3721755090 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f925015be10 con 0x7f9250071d80 2024-03-13T21:20:09.563 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:09.570+0000 7fab46a42040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-13T21:20:09.603 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:09.611+0000 7f4898c32040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-13T21:20:09.616 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:09.624+0000 7fab46a42040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-13T21:20:09.616 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.624+0000 7f9257da4640 1 -- 172.21.15.195:0/3721755090 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6ec15277-ca0f-47b0-a89f-2fa53a606ed9", "id": 2} v 0) -- 0x7f925006ecc0 con 0x7f9250071d80 2024-03-13T21:20:09.621 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.629+0000 7f92467fc640 1 -- 172.21.15.195:0/3721755090 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6ec15277-ca0f-47b0-a89f-2fa53a606ed9", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f924c021070 con 0x7f9250071d80 2024-03-13T21:20:09.622 INFO:teuthology.orchestra.run.smithi195.stdout:2 2024-03-13T21:20:09.623 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.630+0000 7f9257da4640 1 -- 172.21.15.195:0/3721755090 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9250071d80 msgr2=0x7f92501555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.623 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.630+0000 7f9257da4640 1 --2- 172.21.15.195:0/3721755090 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9250071d80 0x7f92501555d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f924c00c390 tx=0x7f924c00c850 comp rx=0 tx=0).stop 2024-03-13T21:20:09.623 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.630+0000 7f9257da4640 1 -- 172.21.15.195:0/3721755090 shutdown_connections 2024-03-13T21:20:09.623 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.630+0000 7f9257da4640 1 --2- 172.21.15.195:0/3721755090 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f9250144460 0x7f9250138180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.623 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.630+0000 7f9257da4640 1 --2- 172.21.15.195:0/3721755090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92500cec70 0x7f9250159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.623 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.630+0000 7f9257da4640 1 --2- 172.21.15.195:0/3721755090 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f9250071d80 0x7f92501555d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.623 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.630+0000 7f9257da4640 1 -- 172.21.15.195:0/3721755090 >> 172.21.15.195:0/3721755090 conn(0x7f92500b28b0 msgr2=0x7f925006df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:09.623 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.630+0000 7f9257da4640 1 -- 172.21.15.195:0/3721755090 shutdown_connections 2024-03-13T21:20:09.623 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.630+0000 7f9257da4640 1 -- 172.21.15.195:0/3721755090 wait complete. 2024-03-13T21:20:09.633 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new de114af6-e8ee-4d26-92d8-e0b0683fe282 3 2024-03-13T21:20:09.661 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:09.668+0000 7fab46a42040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-13T21:20:09.661 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:09.668+0000 7f4898c32040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-13T21:20:09.708 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:09.715+0000 7f4898c32040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-13T21:20:09.713 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:09.721+0000 7fab46a42040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-13T21:20:09.733 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.741+0000 7f72bfeb2640 1 Processor -- start 2024-03-13T21:20:09.733 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.741+0000 7f72bfeb2640 1 -- start start 2024-03-13T21:20:09.735 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.742+0000 7f72bfeb2640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f72b815b9d0 0x7f72b815ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.742+0000 7f72bfeb2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f72b80cca90 0x7f72b806add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.742+0000 7f72bfeb2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72b8160510 con 0x7f72b806b310 2024-03-13T21:20:09.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.742+0000 7f72bfeb2640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f72b806b780 con 0x7f72b815b9d0 2024-03-13T21:20:09.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.742+0000 7f72bfeb2640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f72b806d6f0 con 0x7f72b80cca90 2024-03-13T21:20:09.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.742+0000 7f72bd44d640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f72b80cca90 0x7f72b806add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.742+0000 7f72be44f640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f72b806b310 0x7f72b80cae70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:40708/0 (socket says 172.21.15.195:40708) 2024-03-13T21:20:09.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.742+0000 7f72be44f640 1 -- 172.21.15.195:0/1257209742 learned_addr learned my addr 172.21.15.195:0/1257209742 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-03-13T21:20:09.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.742+0000 7f72bdc4e640 1 --2- 172.21.15.195:0/1257209742 >> v2:172.21.15.107:3300/0 conn(0x7f72b815b9d0 0x7f72b815ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.742+0000 7f72bd44d640 1 -- 172.21.15.195:0/1257209742 >> v2:172.21.15.107:3300/0 conn(0x7f72b815b9d0 msgr2=0x7f72b815ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:09.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.742+0000 7f72bd44d640 1 --2- 172.21.15.195:0/1257209742 >> v2:172.21.15.107:3300/0 conn(0x7f72b815b9d0 0x7f72b815ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.742+0000 7f72bd44d640 1 -- 172.21.15.195:0/1257209742 >> v1:172.21.15.195:6789/0 conn(0x7f72b806b310 legacy=0x7f72b80cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.742+0000 7f72bd44d640 1 -- 172.21.15.195:0/1257209742 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b806d940 con 0x7f72b80cca90 2024-03-13T21:20:09.736 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.742+0000 7f72bcc4c640 1 -- 172.21.15.195:0/1257209742 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4182409304 0 0) 0x7f72b8160510 con 0x7f72b806b310 2024-03-13T21:20:09.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.743+0000 7f72bd44d640 1 --2- 172.21.15.195:0/1257209742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b80cca90 0x7f72b806add0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f72b806beb0 tx=0x7f72a802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50b8e4247231f973 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:09.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.743+0000 7f72bcc4c640 1 -- 172.21.15.195:0/1257209742 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8035020 con 0x7f72b80cca90 2024-03-13T21:20:09.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.743+0000 7f72bcc4c640 1 -- 172.21.15.195:0/1257209742 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72a8031830 con 0x7f72b80cca90 2024-03-13T21:20:09.737 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.743+0000 7f72bcc4c640 1 -- 172.21.15.195:0/1257209742 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8031c00 con 0x7f72b80cca90 2024-03-13T21:20:09.740 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.744+0000 7f72bfeb2640 1 -- 172.21.15.195:0/1257209742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b80cca90 msgr2=0x7f72b806add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.740 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.744+0000 7f72bfeb2640 1 --2- 172.21.15.195:0/1257209742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b80cca90 0x7f72b806add0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f72b806beb0 tx=0x7f72a802b8d0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.740 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.744+0000 7f72bfeb2640 1 -- 172.21.15.195:0/1257209742 shutdown_connections 2024-03-13T21:20:09.740 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.744+0000 7f72bfeb2640 1 --2- 172.21.15.195:0/1257209742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b80cca90 0x7f72b806add0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.740 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.744+0000 7f72bfeb2640 1 --2- 172.21.15.195:0/1257209742 >> v2:172.21.15.107:3300/0 conn(0x7f72b815b9d0 0x7f72b815ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.740 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.744+0000 7f72bfeb2640 1 -- 172.21.15.195:0/1257209742 >> 172.21.15.195:0/1257209742 conn(0x7f72b80d0820 msgr2=0x7f72b80d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:09.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.744+0000 7f72bfeb2640 1 -- 172.21.15.195:0/1257209742 shutdown_connections 2024-03-13T21:20:09.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.744+0000 7f72bfeb2640 1 -- 172.21.15.195:0/1257209742 wait complete. 2024-03-13T21:20:09.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.745+0000 7f72bfeb2640 1 Processor -- start 2024-03-13T21:20:09.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.745+0000 7f72bfeb2640 1 -- start start 2024-03-13T21:20:09.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72bfeb2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72b806b310 0x7f72b814d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72bfeb2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72b80cca90 0x7f72b80b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72bfeb2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b815b9d0 0x7f72b81f6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72bfeb2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f72b815f7d0 con 0x7f72b806b310 2024-03-13T21:20:09.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72bfeb2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f72b806df00 con 0x7f72b815b9d0 2024-03-13T21:20:09.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72bfeb2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f72b815fab0 con 0x7f72b80cca90 2024-03-13T21:20:09.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72be44f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b815b9d0 0x7f72b81f6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72bd44d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72b80cca90 0x7f72b80b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72bd44d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72b80cca90 0x7f72b80b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:47374/0 (socket says 172.21.15.195:47374) 2024-03-13T21:20:09.741 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72bd44d640 1 -- 172.21.15.195:0/2942475009 learned_addr learned my addr 172.21.15.195:0/2942475009 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-13T21:20:09.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72bdc4e640 1 --2- 172.21.15.195:0/2942475009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72b806b310 0x7f72b814d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72be44f640 1 -- 172.21.15.195:0/2942475009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72b80cca90 msgr2=0x7f72b80b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72be44f640 1 --2- 172.21.15.195:0/2942475009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72b80cca90 0x7f72b80b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72be44f640 1 -- 172.21.15.195:0/2942475009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72b806b310 msgr2=0x7f72b814d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72be44f640 1 --2- 172.21.15.195:0/2942475009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72b806b310 0x7f72b814d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72be44f640 1 -- 172.21.15.195:0/2942475009 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b81f77f0 con 0x7f72b815b9d0 2024-03-13T21:20:09.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72bd44d640 1 --2- 172.21.15.195:0/2942475009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72b80cca90 0x7f72b80b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-13T21:20:09.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72be44f640 1 --2- 172.21.15.195:0/2942475009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b815b9d0 0x7f72b81f6d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f72b0000f80 tx=0x7f72b000cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:09.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72ae7fc640 1 -- 172.21.15.195:0/2942475009 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0018070 con 0x7f72b815b9d0 2024-03-13T21:20:09.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72ae7fc640 1 -- 172.21.15.195:0/2942475009 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b0004d60 con 0x7f72b815b9d0 2024-03-13T21:20:09.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72bfeb2640 1 -- 172.21.15.195:0/2942475009 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72b81f7ad0 con 0x7f72b815b9d0 2024-03-13T21:20:09.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72ae7fc640 1 -- 172.21.15.195:0/2942475009 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b000a860 con 0x7f72b815b9d0 2024-03-13T21:20:09.742 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.746+0000 7f72bfeb2640 1 -- 172.21.15.195:0/2942475009 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72b80cf1c0 con 0x7f72b815b9d0 2024-03-13T21:20:09.743 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.747+0000 7f72ae7fc640 1 -- 172.21.15.195:0/2942475009 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f72b001b070 con 0x7f72b815b9d0 2024-03-13T21:20:09.743 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.747+0000 7f72ae7fc640 1 -- 172.21.15.195:0/2942475009 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f72b0012400 con 0x7f72b815b9d0 2024-03-13T21:20:09.743 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.747+0000 7f72bfeb2640 1 -- 172.21.15.195:0/2942475009 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b80cf3c0 con 0x7f72b815b9d0 2024-03-13T21:20:09.744 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.751+0000 7f72ae7fc640 1 -- 172.21.15.195:0/2942475009 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f72b80cf3c0 con 0x7f72b815b9d0 2024-03-13T21:20:09.755 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:09.763+0000 7fab46a42040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-13T21:20:09.766 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:09.774+0000 7f4898c32040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-13T21:20:09.809 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:09.816+0000 7f4898c32040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-13T21:20:09.815 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.823+0000 7f72bfeb2640 1 -- 172.21.15.195:0/2942475009 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "de114af6-e8ee-4d26-92d8-e0b0683fe282", "id": 3} v 0) -- 0x7f72b80cecd0 con 0x7f72b815b9d0 2024-03-13T21:20:09.821 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.828+0000 7f72ae7fc640 1 -- 172.21.15.195:0/2942475009 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "de114af6-e8ee-4d26-92d8-e0b0683fe282", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f72b0007280 con 0x7f72b815b9d0 2024-03-13T21:20:09.821 INFO:teuthology.orchestra.run.smithi195.stdout:3 2024-03-13T21:20:09.822 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.829+0000 7f72bfeb2640 1 -- 172.21.15.195:0/2942475009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b815b9d0 msgr2=0x7f72b81f6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.822 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.829+0000 7f72bfeb2640 1 --2- 172.21.15.195:0/2942475009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b815b9d0 0x7f72b81f6d30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f72b0000f80 tx=0x7f72b000cbe0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.822 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.829+0000 7f72bfeb2640 1 -- 172.21.15.195:0/2942475009 shutdown_connections 2024-03-13T21:20:09.823 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.829+0000 7f72bfeb2640 1 --2- 172.21.15.195:0/2942475009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72b815b9d0 0x7f72b81f6d30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.823 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.829+0000 7f72bfeb2640 1 --2- 172.21.15.195:0/2942475009 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f72b80cca90 0x7f72b80b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.823 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.829+0000 7f72bfeb2640 1 --2- 172.21.15.195:0/2942475009 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f72b806b310 0x7f72b814d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.823 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.829+0000 7f72bfeb2640 1 -- 172.21.15.195:0/2942475009 >> 172.21.15.195:0/2942475009 conn(0x7f72b80d0820 msgr2=0x7f72b815a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:09.823 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.829+0000 7f72bfeb2640 1 -- 172.21.15.195:0/2942475009 shutdown_connections 2024-03-13T21:20:09.823 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.829+0000 7f72bfeb2640 1 -- 172.21.15.195:0/2942475009 wait complete. 2024-03-13T21:20:09.833 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 78d43c86-5c73-4e6d-9a51-d8022f68f36a 4 2024-03-13T21:20:09.869 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:09.877+0000 7fab46a42040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-13T21:20:09.934 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:09.939+0000 7f4898c32040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-13T21:20:09.939 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:09.946+0000 7fab46a42040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-13T21:20:09.974 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.981+0000 7fb9d4753640 1 Processor -- start 2024-03-13T21:20:09.974 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.981+0000 7fb9d4753640 1 -- start start 2024-03-13T21:20:09.977 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.982+0000 7fb9d4753640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9cc15bb50 0x7fb9cc0d2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.977 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.982+0000 7fb9d4753640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fb9cc0cf5a0 0x7fb9cc0cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.977 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.982+0000 7fb9d4753640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9cc0cefb0 con 0x7fb9cc0cd630 2024-03-13T21:20:09.977 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.982+0000 7fb9d4753640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fb9cc0cc3e0 con 0x7fb9cc0cf5a0 2024-03-13T21:20:09.977 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.982+0000 7fb9d4753640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb9cc0cf290 con 0x7fb9cc15bb50 2024-03-13T21:20:09.977 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.982+0000 7fb9d24ef640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9cc15bb50 0x7fb9cc0d2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.978 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.982+0000 7fb9d24ef640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9cc15bb50 0x7fb9cc0d2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:47378/0 (socket says 172.21.15.195:47378) 2024-03-13T21:20:09.978 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.982+0000 7fb9d24ef640 1 -- 172.21.15.195:0/4268722670 learned_addr learned my addr 172.21.15.195:0/4268722670 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-13T21:20:09.978 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.982+0000 7fb9d1cee640 1 --2- 172.21.15.195:0/4268722670 >> v2:172.21.15.107:3300/0 conn(0x7fb9cc0cf5a0 0x7fb9cc0cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.978 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.982+0000 7fb9d24ef640 1 -- 172.21.15.195:0/4268722670 >> v2:172.21.15.107:3300/0 conn(0x7fb9cc0cf5a0 msgr2=0x7fb9cc0cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:09.978 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.982+0000 7fb9d24ef640 1 --2- 172.21.15.195:0/4268722670 >> v2:172.21.15.107:3300/0 conn(0x7fb9cc0cf5a0 0x7fb9cc0cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.978 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.982+0000 7fb9d24ef640 1 -- 172.21.15.195:0/4268722670 >> v1:172.21.15.107:6789/0 conn(0x7fb9cc0cd630 legacy=0x7fb9cc0ae710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.978 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.982+0000 7fb9d24ef640 1 -- 172.21.15.195:0/4268722670 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9cc0cc610 con 0x7fb9cc15bb50 2024-03-13T21:20:09.978 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.982+0000 7fb9d14ed640 1 -- 172.21.15.195:0/4268722670 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1254671777 0 0) 0x7fb9cc0cefb0 con 0x7fb9cc0cd630 2024-03-13T21:20:09.978 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.982+0000 7fb9d1cee640 1 --2- 172.21.15.195:0/4268722670 >> v2:172.21.15.107:3300/0 conn(0x7fb9cc0cf5a0 0x7fb9cc0cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-13T21:20:09.978 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.983+0000 7fb9d24ef640 1 --2- 172.21.15.195:0/4268722670 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9cc15bb50 0x7fb9cc0d2460 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc009870 tx=0x7fb9bc02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d11b815585258a32 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:09.978 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.983+0000 7fb9d14ed640 1 -- 172.21.15.195:0/4268722670 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc035020 con 0x7fb9cc15bb50 2024-03-13T21:20:09.978 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.983+0000 7fb9d14ed640 1 -- 172.21.15.195:0/4268722670 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9bc031640 con 0x7fb9cc15bb50 2024-03-13T21:20:09.978 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.983+0000 7fb9d14ed640 1 -- 172.21.15.195:0/4268722670 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc02d040 con 0x7fb9cc15bb50 2024-03-13T21:20:09.979 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.984+0000 7fb9d4753640 1 -- 172.21.15.195:0/4268722670 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9cc15bb50 msgr2=0x7fb9cc0d2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.979 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.984+0000 7fb9d4753640 1 --2- 172.21.15.195:0/4268722670 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9cc15bb50 0x7fb9cc0d2460 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc009870 tx=0x7fb9bc02b8f0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.979 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.984+0000 7fb9d4753640 1 -- 172.21.15.195:0/4268722670 shutdown_connections 2024-03-13T21:20:09.979 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.984+0000 7fb9d4753640 1 --2- 172.21.15.195:0/4268722670 >> v2:172.21.15.107:3300/0 conn(0x7fb9cc0cf5a0 0x7fb9cc0cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.979 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.984+0000 7fb9d4753640 1 --2- 172.21.15.195:0/4268722670 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9cc15bb50 0x7fb9cc0d2460 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.979 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.984+0000 7fb9d4753640 1 -- 172.21.15.195:0/4268722670 >> 172.21.15.195:0/4268722670 conn(0x7fb9cc0d1940 msgr2=0x7fb9cc0d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:09.979 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.984+0000 7fb9d4753640 1 -- 172.21.15.195:0/4268722670 shutdown_connections 2024-03-13T21:20:09.979 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.984+0000 7fb9d4753640 1 -- 172.21.15.195:0/4268722670 wait complete. 2024-03-13T21:20:09.982 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.985+0000 7fb9d4753640 1 Processor -- start 2024-03-13T21:20:09.982 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.985+0000 7fb9d4753640 1 -- start start 2024-03-13T21:20:09.982 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.986+0000 7fb9d4753640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9cc0cf5a0 0x7fb9cc150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.982 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.986+0000 7fb9d4753640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9cc15bb50 0x7fb9cc0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.982 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.986+0000 7fb9d4753640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9cc0b4560 0x7fb9cc0b6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:09.982 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.986+0000 7fb9d4753640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fb9cc0aee20 con 0x7fb9cc15bb50 2024-03-13T21:20:09.982 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.986+0000 7fb9d4753640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fb9cc0cec40 con 0x7fb9cc0b4560 2024-03-13T21:20:09.982 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.986+0000 7fb9d4753640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fb9cc0aefa0 con 0x7fb9cc0cf5a0 2024-03-13T21:20:09.982 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.986+0000 7fb9d24ef640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9cc0cf5a0 0x7fb9cc150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.982 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.986+0000 7fb9d24ef640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9cc0cf5a0 0x7fb9cc150170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:47384/0 (socket says 172.21.15.195:47384) 2024-03-13T21:20:09.983 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.986+0000 7fb9d24ef640 1 -- 172.21.15.195:0/867951076 learned_addr learned my addr 172.21.15.195:0/867951076 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-13T21:20:09.983 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.986+0000 7fb9d2cf0640 1 --2- 172.21.15.195:0/867951076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9cc0b4560 0x7fb9cc0b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.983 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.986+0000 7fb9d1cee640 1 --2- 172.21.15.195:0/867951076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9cc15bb50 0x7fb9cc0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:09.983 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.986+0000 7fb9d24ef640 1 -- 172.21.15.195:0/867951076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9cc0b4560 msgr2=0x7fb9cc0b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.983 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.986+0000 7fb9d24ef640 1 --2- 172.21.15.195:0/867951076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9cc0b4560 0x7fb9cc0b6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.983 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.986+0000 7fb9d24ef640 1 -- 172.21.15.195:0/867951076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9cc15bb50 msgr2=0x7fb9cc0c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:09.983 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.986+0000 7fb9d24ef640 1 --2- 172.21.15.195:0/867951076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9cc15bb50 0x7fb9cc0c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:09.983 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.986+0000 7fb9d24ef640 1 -- 172.21.15.195:0/867951076 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9cc0b4cd0 con 0x7fb9cc0cf5a0 2024-03-13T21:20:09.983 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.986+0000 7fb9d2cf0640 1 --2- 172.21.15.195:0/867951076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9cc0b4560 0x7fb9cc0b6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-13T21:20:09.983 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.987+0000 7fb9d24ef640 1 --2- 172.21.15.195:0/867951076 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9cc0cf5a0 0x7fb9cc150170 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc02b930 tx=0x7fb9bc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:09.983 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.987+0000 7fb9c2ffd640 1 -- 172.21.15.195:0/867951076 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc040070 con 0x7fb9cc0cf5a0 2024-03-13T21:20:09.983 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.987+0000 7fb9c2ffd640 1 -- 172.21.15.195:0/867951076 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9bc0399f0 con 0x7fb9cc0cf5a0 2024-03-13T21:20:09.983 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.987+0000 7fb9d4753640 1 -- 172.21.15.195:0/867951076 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9cc0b4fb0 con 0x7fb9cc0cf5a0 2024-03-13T21:20:09.983 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.987+0000 7fb9c2ffd640 1 -- 172.21.15.195:0/867951076 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc035040 con 0x7fb9cc0cf5a0 2024-03-13T21:20:09.983 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.987+0000 7fb9d4753640 1 -- 172.21.15.195:0/867951076 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9cc0b5570 con 0x7fb9cc0cf5a0 2024-03-13T21:20:09.984 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.987+0000 7fb9c2ffd640 1 -- 172.21.15.195:0/867951076 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb9bc038020 con 0x7fb9cc0cf5a0 2024-03-13T21:20:09.984 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.987+0000 7fb9c2ffd640 1 -- 172.21.15.195:0/867951076 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fb9bc03ab00 con 0x7fb9cc0cf5a0 2024-03-13T21:20:09.984 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.988+0000 7fb9d4753640 1 -- 172.21.15.195:0/867951076 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9cc075120 con 0x7fb9cc0cf5a0 2024-03-13T21:20:09.984 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:09.990+0000 7fb9c2ffd640 1 -- 172.21.15.195:0/867951076 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fb9bc03ade0 con 0x7fb9cc0cf5a0 2024-03-13T21:20:09.985 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:09.992+0000 7fab46a42040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-13T21:20:10.006 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:10.013+0000 7f4898c32040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-13T21:20:10.036 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:10.044+0000 7fab46a42040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-13T21:20:10.051 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:10.059+0000 7f4898c32040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-13T21:20:10.053 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.060+0000 7fb9d4753640 1 -- 172.21.15.195:0/867951076 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "78d43c86-5c73-4e6d-9a51-d8022f68f36a", "id": 4} v 0) -- 0x7fb9cc0b78c0 con 0x7fb9cc0cf5a0 2024-03-13T21:20:10.058 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.065+0000 7fb9c2ffd640 1 -- 172.21.15.195:0/867951076 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "78d43c86-5c73-4e6d-9a51-d8022f68f36a", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fb9bc039dc0 con 0x7fb9cc0cf5a0 2024-03-13T21:20:10.058 INFO:teuthology.orchestra.run.smithi195.stdout:4 2024-03-13T21:20:10.059 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.066+0000 7fb9d4753640 1 -- 172.21.15.195:0/867951076 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9cc0cf5a0 msgr2=0x7fb9cc150170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.060 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.066+0000 7fb9d4753640 1 --2- 172.21.15.195:0/867951076 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9cc0cf5a0 0x7fb9cc150170 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc02b930 tx=0x7fb9bc0046c0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.060 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.066+0000 7fb9d4753640 1 -- 172.21.15.195:0/867951076 shutdown_connections 2024-03-13T21:20:10.060 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.066+0000 7fb9d4753640 1 --2- 172.21.15.195:0/867951076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9cc0b4560 0x7fb9cc0b6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.060 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.066+0000 7fb9d4753640 1 --2- 172.21.15.195:0/867951076 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fb9cc15bb50 0x7fb9cc0c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.060 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.066+0000 7fb9d4753640 1 --2- 172.21.15.195:0/867951076 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fb9cc0cf5a0 0x7fb9cc150170 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.060 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.066+0000 7fb9d4753640 1 -- 172.21.15.195:0/867951076 >> 172.21.15.195:0/867951076 conn(0x7fb9cc0d1940 msgr2=0x7fb9cc06ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:10.060 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.067+0000 7fb9d4753640 1 -- 172.21.15.195:0/867951076 shutdown_connections 2024-03-13T21:20:10.060 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.067+0000 7fb9d4753640 1 -- 172.21.15.195:0/867951076 wait complete. 2024-03-13T21:20:10.070 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new ef9caa1c-ef75-4307-8b5d-171bd2eb37b0 5 2024-03-13T21:20:10.084 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:10.091+0000 7fab46a42040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-13T21:20:10.108 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:10.115+0000 7f4898c32040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-13T21:20:10.157 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:10.164+0000 7f4898c32040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-13T21:20:10.169 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.177+0000 7f58147b2640 1 Processor -- start 2024-03-13T21:20:10.170 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.177+0000 7f58147b2640 1 -- start start 2024-03-13T21:20:10.171 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.178+0000 7f58147b2640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f580c0b4870 0x7f580c165c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.171 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.178+0000 7f58147b2640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f580c0b5060 con 0x7f580c0b43e0 2024-03-13T21:20:10.172 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.178+0000 7f58147b2640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f580c0b4d80 con 0x7f580c0716e0 2024-03-13T21:20:10.172 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.178+0000 7f58147b2640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f580c15c0e0 con 0x7f580c0b4870 2024-03-13T21:20:10.172 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.178+0000 7f5812d4f640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f580c0b4870 0x7f580c165c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.172 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.178+0000 7f581254e640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7f580c0716e0 0x7f580c071ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:40710/0 (socket says 172.21.15.195:40710) 2024-03-13T21:20:10.172 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.178+0000 7f581254e640 1 -- 172.21.15.195:0/916080096 learned_addr learned my addr 172.21.15.195:0/916080096 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-03-13T21:20:10.172 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.178+0000 7f5812d4f640 1 -- 172.21.15.195:0/916080096 >> v1:172.21.15.195:6789/0 conn(0x7f580c0716e0 legacy=0x7f580c071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.172 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.179+0000 7f5812d4f640 1 -- 172.21.15.195:0/916080096 >> v1:172.21.15.107:6789/0 conn(0x7f580c0b43e0 legacy=0x7f580c162530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.172 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.179+0000 7f581154c640 1 -- 172.21.15.195:0/916080096 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1903469616 0 0) 0x7f580c0b4d80 con 0x7f580c0716e0 2024-03-13T21:20:10.172 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.179+0000 7f5812d4f640 1 -- 172.21.15.195:0/916080096 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580c06d600 con 0x7f580c0b4870 2024-03-13T21:20:10.173 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.180+0000 7f5812d4f640 1 --2- 172.21.15.195:0/916080096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f580c0b4870 0x7f580c165c60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5804009d90 tx=0x7f580402bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d0b3515e16962de server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:10.174 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.180+0000 7f581154c640 1 -- 172.21.15.195:0/916080096 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804039070 con 0x7f580c0b4870 2024-03-13T21:20:10.174 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.180+0000 7f581154c640 1 -- 172.21.15.195:0/916080096 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f580402cd00 con 0x7f580c0b4870 2024-03-13T21:20:10.174 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.180+0000 7f581154c640 1 -- 172.21.15.195:0/916080096 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5804034660 con 0x7f580c0b4870 2024-03-13T21:20:10.174 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.180+0000 7f58147b2640 1 -- 172.21.15.195:0/916080096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f580c0b4870 msgr2=0x7f580c165c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.174 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.180+0000 7f58147b2640 1 --2- 172.21.15.195:0/916080096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f580c0b4870 0x7f580c165c60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5804009d90 tx=0x7f580402bf50 comp rx=0 tx=0).stop 2024-03-13T21:20:10.174 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.181+0000 7f58147b2640 1 -- 172.21.15.195:0/916080096 shutdown_connections 2024-03-13T21:20:10.174 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.181+0000 7f58147b2640 1 --2- 172.21.15.195:0/916080096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f580c0b4870 0x7f580c165c60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.174 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.181+0000 7f58147b2640 1 -- 172.21.15.195:0/916080096 >> 172.21.15.195:0/916080096 conn(0x7f580c0d0880 msgr2=0x7f580c0d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:10.174 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.181+0000 7f58147b2640 1 -- 172.21.15.195:0/916080096 shutdown_connections 2024-03-13T21:20:10.174 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.181+0000 7f58147b2640 1 -- 172.21.15.195:0/916080096 wait complete. 2024-03-13T21:20:10.177 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.182+0000 7f58147b2640 1 Processor -- start 2024-03-13T21:20:10.177 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.182+0000 7f58147b2640 1 -- start start 2024-03-13T21:20:10.177 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.182+0000 7f58147b2640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f580c0716e0 0x7f580c1f7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.177 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.182+0000 7f58147b2640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f580c0b43e0 0x7f580c0cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.177 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.182+0000 7f58147b2640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f580c0b4870 0x7f580c147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.177 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.182+0000 7f58147b2640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f580c15ac90 con 0x7f580c0716e0 2024-03-13T21:20:10.177 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.182+0000 7f58147b2640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f580c06dbc0 con 0x7f580c0b4870 2024-03-13T21:20:10.177 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.182+0000 7f58147b2640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f580c15ae10 con 0x7f580c0b43e0 2024-03-13T21:20:10.177 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f5811d4d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f580c0b43e0 0x7f580c0cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.177 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f5812d4f640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f580c0b4870 0x7f580c147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.178 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f5811d4d640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f580c0b43e0 0x7f580c0cfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:47386/0 (socket says 172.21.15.195:47386) 2024-03-13T21:20:10.178 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f5811d4d640 1 -- 172.21.15.195:0/2827184481 learned_addr learned my addr 172.21.15.195:0/2827184481 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-13T21:20:10.178 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f581254e640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f580c0716e0 0x7f580c1f7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.178 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f5811d4d640 1 -- 172.21.15.195:0/2827184481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f580c0b4870 msgr2=0x7f580c147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.178 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f5811d4d640 1 --2- 172.21.15.195:0/2827184481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f580c0b4870 0x7f580c147ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.178 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f5811d4d640 1 -- 172.21.15.195:0/2827184481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f580c0716e0 msgr2=0x7f580c1f7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.178 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f5811d4d640 1 --2- 172.21.15.195:0/2827184481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f580c0716e0 0x7f580c1f7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.178 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f5811d4d640 1 -- 172.21.15.195:0/2827184481 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f580c0ca660 con 0x7f580c0b43e0 2024-03-13T21:20:10.178 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f5812d4f640 1 --2- 172.21.15.195:0/2827184481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f580c0b4870 0x7f580c147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-13T21:20:10.178 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f581254e640 1 --2- 172.21.15.195:0/2827184481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f580c0716e0 0x7f580c1f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-13T21:20:10.179 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f5811d4d640 1 --2- 172.21.15.195:0/2827184481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f580c0b43e0 0x7f580c0cfc60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f580000c450 tx=0x7f580000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:10.179 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f57feffd640 1 -- 172.21.15.195:0/2827184481 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58000052d0 con 0x7f580c0b43e0 2024-03-13T21:20:10.179 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f57feffd640 1 -- 172.21.15.195:0/2827184481 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5800005470 con 0x7f580c0b43e0 2024-03-13T21:20:10.179 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f58147b2640 1 -- 172.21.15.195:0/2827184481 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f580c1f7a90 con 0x7f580c0b43e0 2024-03-13T21:20:10.179 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f57feffd640 1 -- 172.21.15.195:0/2827184481 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5800012870 con 0x7f580c0b43e0 2024-03-13T21:20:10.179 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f58147b2640 1 -- 172.21.15.195:0/2827184481 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f580c0ca900 con 0x7f580c0b43e0 2024-03-13T21:20:10.179 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f57feffd640 1 -- 172.21.15.195:0/2827184481 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5800012a10 con 0x7f580c0b43e0 2024-03-13T21:20:10.179 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.183+0000 7f57feffd640 1 -- 172.21.15.195:0/2827184481 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f580001ba20 con 0x7f580c0b43e0 2024-03-13T21:20:10.179 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.185+0000 7f58147b2640 1 -- 172.21.15.195:0/2827184481 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f580c1f7e80 con 0x7f580c0b43e0 2024-03-13T21:20:10.180 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.186+0000 7f57feffd640 1 -- 172.21.15.195:0/2827184481 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f580001b4a0 con 0x7f580c0b43e0 2024-03-13T21:20:10.252 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.260+0000 7f58147b2640 1 -- 172.21.15.195:0/2827184481 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ef9caa1c-ef75-4307-8b5d-171bd2eb37b0", "id": 5} v 0) -- 0x7f580c15bcf0 con 0x7f580c0b43e0 2024-03-13T21:20:10.258 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.265+0000 7f57feffd640 1 -- 172.21.15.195:0/2827184481 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ef9caa1c-ef75-4307-8b5d-171bd2eb37b0", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f580c15bcf0 con 0x7f580c0b43e0 2024-03-13T21:20:10.258 INFO:teuthology.orchestra.run.smithi195.stdout:5 2024-03-13T21:20:10.259 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.267+0000 7f58147b2640 1 -- 172.21.15.195:0/2827184481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f580c0b43e0 msgr2=0x7f580c0cfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.260 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.267+0000 7f58147b2640 1 --2- 172.21.15.195:0/2827184481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f580c0b43e0 0x7f580c0cfc60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f580000c450 tx=0x7f580000c910 comp rx=0 tx=0).stop 2024-03-13T21:20:10.260 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.267+0000 7f58147b2640 1 -- 172.21.15.195:0/2827184481 shutdown_connections 2024-03-13T21:20:10.260 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.267+0000 7f58147b2640 1 --2- 172.21.15.195:0/2827184481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f580c0b4870 0x7f580c147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.260 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.267+0000 7f58147b2640 1 --2- 172.21.15.195:0/2827184481 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f580c0b43e0 0x7f580c0cfc60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.260 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.267+0000 7f58147b2640 1 --2- 172.21.15.195:0/2827184481 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f580c0716e0 0x7f580c1f7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.260 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.267+0000 7f58147b2640 1 -- 172.21.15.195:0/2827184481 >> 172.21.15.195:0/2827184481 conn(0x7f580c0d0880 msgr2=0x7f580c15dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:10.260 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.267+0000 7f58147b2640 1 -- 172.21.15.195:0/2827184481 shutdown_connections 2024-03-13T21:20:10.260 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.267+0000 7f58147b2640 1 -- 172.21.15.195:0/2827184481 wait complete. 2024-03-13T21:20:10.269 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new 0f07cccd-e497-44fa-afae-e81242b8ece2 6 2024-03-13T21:20:10.410 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.418+0000 7f2293ef8640 1 Processor -- start 2024-03-13T21:20:10.411 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.418+0000 7f2293ef8640 1 -- start start 2024-03-13T21:20:10.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.419+0000 7f2293ef8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f228c0cfb90 0x7f228c0cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.419+0000 7f2293ef8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f228c0b17e0 0x7f228c0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.419+0000 7f2293ef8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228c0d26c0 con 0x7f228c0ccf20 2024-03-13T21:20:10.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.419+0000 7f2293ef8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f228c0cd420 con 0x7f228c0b17e0 2024-03-13T21:20:10.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.419+0000 7f2293ef8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f228c0cd700 con 0x7f228c0cfb90 2024-03-13T21:20:10.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.419+0000 7f2291c94640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f228c0cfb90 0x7f228c0cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.419+0000 7f2291c94640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f228c0cfb90 0x7f228c0cf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:52256/0 (socket says 172.21.15.195:52256) 2024-03-13T21:20:10.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.419+0000 7f2291c94640 1 -- 172.21.15.195:0/1354463861 learned_addr learned my addr 172.21.15.195:0/1354463861 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-13T21:20:10.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.419+0000 7f2291493640 1 --1- 172.21.15.195:0/1354463861 >> v1:172.21.15.195:6789/0 conn(0x7f228c0ccf20 0x7f228c0cff70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:40712/0 (socket says 172.21.15.195:40712) 2024-03-13T21:20:10.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.419+0000 7f2292495640 1 --2- 172.21.15.195:0/1354463861 >> v2:172.21.15.107:3300/0 conn(0x7f228c0b17e0 0x7f228c0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.413 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.419+0000 7f2291c94640 1 -- 172.21.15.195:0/1354463861 >> v2:172.21.15.107:3300/0 conn(0x7f228c0b17e0 msgr2=0x7f228c0b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:10.414 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.419+0000 7f2291c94640 1 --2- 172.21.15.195:0/1354463861 >> v2:172.21.15.107:3300/0 conn(0x7f228c0b17e0 0x7f228c0b1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.414 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.419+0000 7f2291c94640 1 -- 172.21.15.195:0/1354463861 >> v1:172.21.15.195:6789/0 conn(0x7f228c0ccf20 legacy=0x7f228c0cff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.414 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.419+0000 7f2291c94640 1 -- 172.21.15.195:0/1354463861 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c0b0d00 con 0x7f228c0cfb90 2024-03-13T21:20:10.414 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.419+0000 7f2290c92640 1 -- 172.21.15.195:0/1354463861 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2053186620 0 0) 0x7f228c0d26c0 con 0x7f228c0ccf20 2024-03-13T21:20:10.414 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.419+0000 7f2292495640 1 --2- 172.21.15.195:0/1354463861 >> v2:172.21.15.107:3300/0 conn(0x7f228c0b17e0 0x7f228c0b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-13T21:20:10.414 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.420+0000 7f2291c94640 1 --2- 172.21.15.195:0/1354463861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f228c0cfb90 0x7f228c0cf4d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f228c073450 tx=0x7f228802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cd6b8cb56a34536 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:10.414 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.420+0000 7f2290c92640 1 -- 172.21.15.195:0/1354463861 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288034070 con 0x7f228c0cfb90 2024-03-13T21:20:10.414 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.420+0000 7f2290c92640 1 -- 172.21.15.195:0/1354463861 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2288030860 con 0x7f228c0cfb90 2024-03-13T21:20:10.414 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.420+0000 7f2290c92640 1 -- 172.21.15.195:0/1354463861 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288030c30 con 0x7f228c0cfb90 2024-03-13T21:20:10.418 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.421+0000 7f2293ef8640 1 -- 172.21.15.195:0/1354463861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f228c0cfb90 msgr2=0x7f228c0cf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.418 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.421+0000 7f2293ef8640 1 --2- 172.21.15.195:0/1354463861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f228c0cfb90 0x7f228c0cf4d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f228c073450 tx=0x7f228802b9a0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.418 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.421+0000 7f2293ef8640 1 -- 172.21.15.195:0/1354463861 shutdown_connections 2024-03-13T21:20:10.418 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.421+0000 7f2293ef8640 1 --2- 172.21.15.195:0/1354463861 >> v2:172.21.15.107:3300/0 conn(0x7f228c0b17e0 0x7f228c0b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.418 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.421+0000 7f2293ef8640 1 --2- 172.21.15.195:0/1354463861 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f228c0cfb90 0x7f228c0cf4d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.418 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.421+0000 7f2293ef8640 1 -- 172.21.15.195:0/1354463861 >> 172.21.15.195:0/1354463861 conn(0x7f228c0d1900 msgr2=0x7f228c0d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:10.418 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.421+0000 7f2293ef8640 1 -- 172.21.15.195:0/1354463861 shutdown_connections 2024-03-13T21:20:10.418 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.421+0000 7f2293ef8640 1 -- 172.21.15.195:0/1354463861 wait complete. 2024-03-13T21:20:10.419 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.422+0000 7f2293ef8640 1 Processor -- start 2024-03-13T21:20:10.419 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.422+0000 7f2293ef8640 1 -- start start 2024-03-13T21:20:10.419 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.423+0000 7f2293ef8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f228c0b17e0 0x7f228c0c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.419 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.423+0000 7f2293ef8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f228c0ccf20 0x7f228c149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.419 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.423+0000 7f2293ef8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f228c0cfb90 0x7f228c0cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.419 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.423+0000 7f2293ef8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f228c15c0c0 con 0x7f228c0b17e0 2024-03-13T21:20:10.419 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.423+0000 7f2293ef8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f228c15bf40 con 0x7f228c0ccf20 2024-03-13T21:20:10.419 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.423+0000 7f2293ef8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f228c0b21b0 con 0x7f228c0cfb90 2024-03-13T21:20:10.419 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.423+0000 7f2291493640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f228c0ccf20 0x7f228c149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.419 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.423+0000 7f2292495640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f228c0cfb90 0x7f228c0cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.419 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.423+0000 7f2292495640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f228c0cfb90 0x7f228c0cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:47398/0 (socket says 172.21.15.195:47398) 2024-03-13T21:20:10.419 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.423+0000 7f2292495640 1 -- 172.21.15.195:0/3395650657 learned_addr learned my addr 172.21.15.195:0/3395650657 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-13T21:20:10.419 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.423+0000 7f2291c94640 1 --2- 172.21.15.195:0/3395650657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f228c0b17e0 0x7f228c0c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.420 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.423+0000 7f2292495640 1 -- 172.21.15.195:0/3395650657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f228c0ccf20 msgr2=0x7f228c149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.420 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.423+0000 7f2292495640 1 --2- 172.21.15.195:0/3395650657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f228c0ccf20 0x7f228c149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.420 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.423+0000 7f2292495640 1 -- 172.21.15.195:0/3395650657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f228c0b17e0 msgr2=0x7f228c0c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.420 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.423+0000 7f2292495640 1 --2- 172.21.15.195:0/3395650657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f228c0b17e0 0x7f228c0c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.420 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.423+0000 7f2292495640 1 -- 172.21.15.195:0/3395650657 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c0c9ee0 con 0x7f228c0cfb90 2024-03-13T21:20:10.420 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.423+0000 7f2291493640 1 --2- 172.21.15.195:0/3395650657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f228c0ccf20 0x7f228c149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-13T21:20:10.420 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.423+0000 7f2292495640 1 --2- 172.21.15.195:0/3395650657 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f228c0cfb90 0x7f228c0cb160 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2284007ef0 tx=0x7f228400d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:10.420 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.424+0000 7f22827fc640 1 -- 172.21.15.195:0/3395650657 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228401a070 con 0x7f228c0cfb90 2024-03-13T21:20:10.420 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.424+0000 7f22827fc640 1 -- 172.21.15.195:0/3395650657 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2284003b90 con 0x7f228c0cfb90 2024-03-13T21:20:10.420 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.424+0000 7f2293ef8640 1 -- 172.21.15.195:0/3395650657 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228c0ca680 con 0x7f228c0cfb90 2024-03-13T21:20:10.420 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.424+0000 7f22827fc640 1 -- 172.21.15.195:0/3395650657 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284004030 con 0x7f228c0cfb90 2024-03-13T21:20:10.420 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.424+0000 7f2293ef8640 1 -- 172.21.15.195:0/3395650657 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f228c0c9b70 con 0x7f228c0cfb90 2024-03-13T21:20:10.420 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.424+0000 7f22827fc640 1 -- 172.21.15.195:0/3395650657 <== mon.2 v2:172.21.15.195:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f228401d070 con 0x7f228c0cfb90 2024-03-13T21:20:10.420 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.424+0000 7f22827fc640 1 -- 172.21.15.195:0/3395650657 <== mon.2 v2:172.21.15.195:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f228401f800 con 0x7f228c0cfb90 2024-03-13T21:20:10.421 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.425+0000 7f2293ef8640 1 -- 172.21.15.195:0/3395650657 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f228c0b44f0 con 0x7f228c0cfb90 2024-03-13T21:20:10.421 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.427+0000 7f22827fc640 1 -- 172.21.15.195:0/3395650657 <== mon.2 v2:172.21.15.195:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f228c0b44f0 con 0x7f228c0cfb90 2024-03-13T21:20:10.457 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:10.465+0000 7fab46a42040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-13T21:20:10.493 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.500+0000 7f2293ef8640 1 -- 172.21.15.195:0/3395650657 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0f07cccd-e497-44fa-afae-e81242b8ece2", "id": 6} v 0) -- 0x7f228c075120 con 0x7f228c0cfb90 2024-03-13T21:20:10.498 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.505+0000 7f22827fc640 1 -- 172.21.15.195:0/3395650657 <== mon.2 v2:172.21.15.195:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0f07cccd-e497-44fa-afae-e81242b8ece2", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f2284010070 con 0x7f228c0cfb90 2024-03-13T21:20:10.498 INFO:teuthology.orchestra.run.smithi195.stdout:6 2024-03-13T21:20:10.499 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.506+0000 7f2293ef8640 1 -- 172.21.15.195:0/3395650657 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f228c0cfb90 msgr2=0x7f228c0cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.499 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.506+0000 7f2293ef8640 1 --2- 172.21.15.195:0/3395650657 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f228c0cfb90 0x7f228c0cb160 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2284007ef0 tx=0x7f228400d4a0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.499 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.506+0000 7f2293ef8640 1 -- 172.21.15.195:0/3395650657 shutdown_connections 2024-03-13T21:20:10.499 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.506+0000 7f2293ef8640 1 --2- 172.21.15.195:0/3395650657 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f228c0cfb90 0x7f228c0cb160 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.499 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.506+0000 7f2293ef8640 1 --2- 172.21.15.195:0/3395650657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f228c0ccf20 0x7f228c149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.499 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.506+0000 7f2293ef8640 1 --2- 172.21.15.195:0/3395650657 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f228c0b17e0 0x7f228c0c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.499 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.506+0000 7f2293ef8640 1 -- 172.21.15.195:0/3395650657 >> 172.21.15.195:0/3395650657 conn(0x7f228c0d1900 msgr2=0x7f228c15b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:10.499 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.506+0000 7f2293ef8640 1 -- 172.21.15.195:0/3395650657 shutdown_connections 2024-03-13T21:20:10.499 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.506+0000 7f2293ef8640 1 -- 172.21.15.195:0/3395650657 wait complete. 2024-03-13T21:20:10.509 DEBUG:teuthology.orchestra.run.smithi195:> sudo ceph --cluster ceph osd new df5edf8d-3d1b-486f-a640-e01e2f1d1f98 7 2024-03-13T21:20:10.558 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:10.566+0000 7f4898c32040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-13T21:20:10.592 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:10.600+0000 7fab46a42040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-13T21:20:10.610 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.617+0000 7fd92bcd1640 1 Processor -- start 2024-03-13T21:20:10.610 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.617+0000 7fd92bcd1640 1 -- start start 2024-03-13T21:20:10.611 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.618+0000 7fd92bcd1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9240ceb20 0x7fd92406add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.612 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.618+0000 7fd92bcd1640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd92406b310 0x7fd9240717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.612 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.618+0000 7fd92bcd1640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9240b3a00 con 0x7fd924159530 2024-03-13T21:20:10.612 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.618+0000 7fd92bcd1640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fd92406b740 con 0x7fd92406b310 2024-03-13T21:20:10.612 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.618+0000 7fd92bcd1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd9240b3ce0 con 0x7fd9240ceb20 2024-03-13T21:20:10.612 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.618+0000 7fd92a26e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd92406b310 0x7fd9240717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.612 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.618+0000 7fd92926c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9240ceb20 0x7fd92406add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.612 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.619+0000 7fd929a6d640 1 --1- >> v1:172.21.15.195:6789/0 conn(0x7fd924159530 0x7fd9240b5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.195:6789/0 says I am v1:172.21.15.195:40722/0 (socket says 172.21.15.195:40722) 2024-03-13T21:20:10.612 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.619+0000 7fd929a6d640 1 -- 172.21.15.195:0/1161740687 learned_addr learned my addr 172.21.15.195:0/1161740687 (peer_addr_for_me v1:172.21.15.195:0/0) 2024-03-13T21:20:10.612 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.619+0000 7fd92a26e640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fd92406b310 0x7fd9240717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:52266/0 (socket says 172.21.15.195:52266) 2024-03-13T21:20:10.612 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.619+0000 7fd92926c640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9240ceb20 0x7fd92406add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3301/0 says I am v2:172.21.15.195:47412/0 (socket says 172.21.15.195:47412) 2024-03-13T21:20:10.612 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.619+0000 7fd92a26e640 1 -- 172.21.15.195:0/1161740687 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9240ceb20 msgr2=0x7fd92406add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:10.612 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.619+0000 7fd92a26e640 1 --2- 172.21.15.195:0/1161740687 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9240ceb20 0x7fd92406add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.613 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.619+0000 7fd92a26e640 1 -- 172.21.15.195:0/1161740687 >> v1:172.21.15.195:6789/0 conn(0x7fd924159530 legacy=0x7fd9240b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.613 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.619+0000 7fd928a6b640 1 -- 172.21.15.195:0/1161740687 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3655730666 0 0) 0x7fd9240b3a00 con 0x7fd924159530 2024-03-13T21:20:10.613 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.619+0000 7fd92a26e640 1 -- 172.21.15.195:0/1161740687 --> v2:172.21.15.195:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9240b3fc0 con 0x7fd92406b310 2024-03-13T21:20:10.613 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.619+0000 7fd92926c640 1 --2- 172.21.15.195:0/1161740687 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9240ceb20 0x7fd92406add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-13T21:20:10.614 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.620+0000 7fd92a26e640 1 --2- 172.21.15.195:0/1161740687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd92406b310 0x7fd9240717e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd91c009d90 tx=0x7fd91c02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4239f1dc4b84c81f server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:10.614 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.620+0000 7fd928a6b640 1 -- 172.21.15.195:0/1161740687 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c039070 con 0x7fd92406b310 2024-03-13T21:20:10.614 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.620+0000 7fd928a6b640 1 -- 172.21.15.195:0/1161740687 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd91c02cc50 con 0x7fd92406b310 2024-03-13T21:20:10.615 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.620+0000 7fd928a6b640 1 -- 172.21.15.195:0/1161740687 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd91c034440 con 0x7fd92406b310 2024-03-13T21:20:10.615 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.621+0000 7fd92bcd1640 1 -- 172.21.15.195:0/1161740687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd92406b310 msgr2=0x7fd9240717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.615 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.621+0000 7fd92bcd1640 1 --2- 172.21.15.195:0/1161740687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd92406b310 0x7fd9240717e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd91c009d90 tx=0x7fd91c02bea0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.615 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.621+0000 7fd92bcd1640 1 -- 172.21.15.195:0/1161740687 shutdown_connections 2024-03-13T21:20:10.615 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.621+0000 7fd92bcd1640 1 --2- 172.21.15.195:0/1161740687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd92406b310 0x7fd9240717e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.615 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.621+0000 7fd92bcd1640 1 --2- 172.21.15.195:0/1161740687 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd9240ceb20 0x7fd92406add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.615 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.621+0000 7fd92bcd1640 1 -- 172.21.15.195:0/1161740687 >> 172.21.15.195:0/1161740687 conn(0x7fd9240d0880 msgr2=0x7fd9240d0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:10.615 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.621+0000 7fd92bcd1640 1 -- 172.21.15.195:0/1161740687 shutdown_connections 2024-03-13T21:20:10.615 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.621+0000 7fd92bcd1640 1 -- 172.21.15.195:0/1161740687 wait complete. 2024-03-13T21:20:10.615 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.622+0000 7fd92bcd1640 1 Processor -- start 2024-03-13T21:20:10.615 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.622+0000 7fd92bcd1640 1 -- start start 2024-03-13T21:20:10.617 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.622+0000 7fd92bcd1640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd92406b310 0x7fd924140450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.617 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.622+0000 7fd92bcd1640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9240ceb20 0x7fd924153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.618 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.622+0000 7fd92bcd1640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd924159530 0x7fd924071f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.618 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd92bcd1640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fd924159910 con 0x7fd9240ceb20 2024-03-13T21:20:10.618 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd92bcd1640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fd9240b4580 con 0x7fd92406b310 2024-03-13T21:20:10.618 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd92bcd1640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fd9240b5b20 con 0x7fd924159530 2024-03-13T21:20:10.618 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd929a6d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd92406b310 0x7fd924140450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.618 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd92a26e640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd924159530 0x7fd924071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.618 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd929a6d640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd92406b310 0x7fd924140450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:52274/0 (socket says 172.21.15.195:52274) 2024-03-13T21:20:10.618 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd929a6d640 1 -- 172.21.15.195:0/3428465391 learned_addr learned my addr 172.21.15.195:0/3428465391 (peer_addr_for_me v2:172.21.15.195:0/0) 2024-03-13T21:20:10.618 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd92926c640 1 --2- 172.21.15.195:0/3428465391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9240ceb20 0x7fd924153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.618 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd929a6d640 1 -- 172.21.15.195:0/3428465391 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd924159530 msgr2=0x7fd924071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.618 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd929a6d640 1 --2- 172.21.15.195:0/3428465391 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd924159530 0x7fd924071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.618 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd929a6d640 1 -- 172.21.15.195:0/3428465391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9240ceb20 msgr2=0x7fd924153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.618 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd929a6d640 1 --2- 172.21.15.195:0/3428465391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9240ceb20 0x7fd924153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.619 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd929a6d640 1 -- 172.21.15.195:0/3428465391 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd924153bb0 con 0x7fd92406b310 2024-03-13T21:20:10.619 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd929a6d640 1 --2- 172.21.15.195:0/3428465391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd92406b310 0x7fd924140450 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd91400c430 tx=0x7fd91400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:10.619 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd91a7fc640 1 -- 172.21.15.195:0/3428465391 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9140074e0 con 0x7fd92406b310 2024-03-13T21:20:10.619 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd91a7fc640 1 -- 172.21.15.195:0/3428465391 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9140047e0 con 0x7fd92406b310 2024-03-13T21:20:10.619 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd92bcd1640 1 -- 172.21.15.195:0/3428465391 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd924153e90 con 0x7fd92406b310 2024-03-13T21:20:10.619 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd91a7fc640 1 -- 172.21.15.195:0/3428465391 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd914004bd0 con 0x7fd92406b310 2024-03-13T21:20:10.619 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd92bcd1640 1 -- 172.21.15.195:0/3428465391 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd924154450 con 0x7fd92406b310 2024-03-13T21:20:10.619 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd91a7fc640 1 -- 172.21.15.195:0/3428465391 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd914011070 con 0x7fd92406b310 2024-03-13T21:20:10.619 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.623+0000 7fd91a7fc640 1 -- 172.21.15.195:0/3428465391 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fd914013a20 con 0x7fd92406b310 2024-03-13T21:20:10.619 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.624+0000 7fd92bcd1640 1 -- 172.21.15.195:0/3428465391 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd924075120 con 0x7fd92406b310 2024-03-13T21:20:10.620 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.626+0000 7fd91a7fc640 1 -- 172.21.15.195:0/3428465391 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd914004d70 con 0x7fd92406b310 2024-03-13T21:20:10.691 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.698+0000 7fd92bcd1640 1 -- 172.21.15.195:0/3428465391 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd new", "uuid": "df5edf8d-3d1b-486f-a640-e01e2f1d1f98", "id": 7} v 0) -- 0x7fd9240b4a50 con 0x7fd92406b310 2024-03-13T21:20:10.696 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.703+0000 7fd91a7fc640 1 -- 172.21.15.195:0/3428465391 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "df5edf8d-3d1b-486f-a640-e01e2f1d1f98", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fd914013cf0 con 0x7fd92406b310 2024-03-13T21:20:10.696 INFO:teuthology.orchestra.run.smithi195.stdout:7 2024-03-13T21:20:10.697 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.704+0000 7fd92bcd1640 1 -- 172.21.15.195:0/3428465391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd92406b310 msgr2=0x7fd924140450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.697 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.704+0000 7fd92bcd1640 1 --2- 172.21.15.195:0/3428465391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd92406b310 0x7fd924140450 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd91400c430 tx=0x7fd91400c8f0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.697 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.704+0000 7fd92bcd1640 1 -- 172.21.15.195:0/3428465391 shutdown_connections 2024-03-13T21:20:10.697 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.704+0000 7fd92bcd1640 1 --2- 172.21.15.195:0/3428465391 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fd924159530 0x7fd924071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.697 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.704+0000 7fd92bcd1640 1 --2- 172.21.15.195:0/3428465391 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fd9240ceb20 0x7fd924153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.697 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.704+0000 7fd92bcd1640 1 --2- 172.21.15.195:0/3428465391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd92406b310 0x7fd924140450 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.698 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.704+0000 7fd92bcd1640 1 -- 172.21.15.195:0/3428465391 >> 172.21.15.195:0/3428465391 conn(0x7fd9240d0880 msgr2=0x7fd9240cf1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:10.698 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.704+0000 7fd92bcd1640 1 -- 172.21.15.195:0/3428465391 shutdown_connections 2024-03-13T21:20:10.698 INFO:teuthology.orchestra.run.smithi195.stderr:2024-03-13T21:20:10.704+0000 7fd92bcd1640 1 -- 172.21.15.195:0/3428465391 wait complete. 2024-03-13T21:20:10.699 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:10.707+0000 7f4898c32040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-13T21:20:10.707 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-13T21:20:10.707 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-13T21:20:10.710 INFO:tasks.ceph.osd.0:Started 2024-03-13T21:20:10.710 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-13T21:20:10.710 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-13T21:20:10.712 INFO:tasks.ceph.osd.1:Started 2024-03-13T21:20:10.712 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-13T21:20:10.712 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-13T21:20:10.714 INFO:tasks.ceph.osd.2:Started 2024-03-13T21:20:10.714 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-13T21:20:10.715 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-13T21:20:10.715 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:10.723+0000 7fab46a42040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-13T21:20:10.717 INFO:tasks.ceph.osd.3:Started 2024-03-13T21:20:10.717 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-13T21:20:10.717 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-13T21:20:10.719 INFO:tasks.ceph.osd.4:Started 2024-03-13T21:20:10.719 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-13T21:20:10.719 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-13T21:20:10.721 INFO:tasks.ceph.osd.5:Started 2024-03-13T21:20:10.722 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-13T21:20:10.722 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-13T21:20:10.724 INFO:tasks.ceph.osd.6:Started 2024-03-13T21:20:10.724 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-13T21:20:10.724 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-13T21:20:10.726 INFO:tasks.ceph.osd.7:Started 2024-03-13T21:20:10.726 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-13T21:20:10.791 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:10.798+0000 7fab46a42040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-13T21:20:10.839 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:10.847+0000 7f4898c32040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-13T21:20:10.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.851+0000 7facbc95b640 1 Processor -- start 2024-03-13T21:20:10.844 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.851+0000 7facbc95b640 1 -- start start 2024-03-13T21:20:10.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.852+0000 7facbc95b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facb80b59d0 0x7facb80afa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.852+0000 7facbc95b640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facb80b0040 con 0x7facb806b4e0 2024-03-13T21:20:10.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.852+0000 7facbc95b640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facb80b3c20 con 0x7facb815dda0 2024-03-13T21:20:10.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.852+0000 7facbc95b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7facb80b3f00 con 0x7facb80b59d0 2024-03-13T21:20:10.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.852+0000 7facaffff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7facb806b4e0 0x7facb806d670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:57682/0 (socket says 172.21.15.107:57682) 2024-03-13T21:20:10.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.852+0000 7facaffff640 1 -- 172.21.15.107:0/762238509 learned_addr learned my addr 172.21.15.107:0/762238509 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-03-13T21:20:10.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.852+0000 7facb6d9d640 1 --2- 172.21.15.107:0/762238509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facb80b59d0 0x7facb80afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb5d9b640 1 -- 172.21.15.107:0/762238509 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1613969556 0 0) 0x7facb80b0040 con 0x7facb806b4e0 2024-03-13T21:20:10.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb5d9b640 1 -- 172.21.15.107:0/762238509 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faca4003520 con 0x7facb806b4e0 2024-03-13T21:20:10.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb5d9b640 1 -- 172.21.15.107:0/762238509 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2784469845 0 0) 0x7facb80b3c20 con 0x7facb815dda0 2024-03-13T21:20:10.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb5d9b640 1 -- 172.21.15.107:0/762238509 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facb80b0040 con 0x7facb815dda0 2024-03-13T21:20:10.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb5d9b640 1 -- 172.21.15.107:0/762238509 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2788680495 0 0) 0x7faca4003520 con 0x7facb806b4e0 2024-03-13T21:20:10.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb5d9b640 1 -- 172.21.15.107:0/762238509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facb80b59d0 msgr2=0x7facb80afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:10.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb5d9b640 1 --2- 172.21.15.107:0/762238509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facb80b59d0 0x7facb80afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb5d9b640 1 -- 172.21.15.107:0/762238509 >> v1:172.21.15.195:6789/0 conn(0x7facb815dda0 legacy=0x7facb806add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb5d9b640 1 -- 172.21.15.107:0/762238509 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb80b41e0 con 0x7facb806b4e0 2024-03-13T21:20:10.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb5d9b640 1 -- 172.21.15.107:0/762238509 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1025813135 0 0) 0x7faca0001670 con 0x7facb806b4e0 2024-03-13T21:20:10.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb6d9d640 1 --2- 172.21.15.107:0/762238509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facb80b59d0 0x7facb80afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-13T21:20:10.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb5d9b640 1 -- 172.21.15.107:0/762238509 >> v1:172.21.15.107:6789/0 conn(0x7facb806b4e0 legacy=0x7facb806d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb5d9b640 1 --2- 172.21.15.107:0/762238509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faca4003b70 0x7faca4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb5d9b640 1 --2- 172.21.15.107:0/762238509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faca4004800 0x7faca4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb5d9b640 1 --2- 172.21.15.107:0/762238509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facb80b59d0 0x7faca40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.849 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb5d9b640 1 -- 172.21.15.107:0/762238509 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7facb80b3f00 con 0x7faca4004800 2024-03-13T21:20:10.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb5d9b640 1 -- 172.21.15.107:0/762238509 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faca400b9f0 con 0x7faca4003b70 2024-03-13T21:20:10.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb5d9b640 1 -- 172.21.15.107:0/762238509 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faca400bbf0 con 0x7facb80b59d0 2024-03-13T21:20:10.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb6d9d640 1 --2- 172.21.15.107:0/762238509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facb80b59d0 0x7faca40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb659c640 1 --2- 172.21.15.107:0/762238509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faca4003b70 0x7faca4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facaffff640 1 --2- 172.21.15.107:0/762238509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faca4004800 0x7faca4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb6d9d640 1 -- 172.21.15.107:0/762238509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faca4003b70 msgr2=0x7faca4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:10.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb6d9d640 1 --2- 172.21.15.107:0/762238509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faca4003b70 0x7faca4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb6d9d640 1 -- 172.21.15.107:0/762238509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faca4004800 msgr2=0x7faca4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:10.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb6d9d640 1 --2- 172.21.15.107:0/762238509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faca4004800 0x7faca4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facb6d9d640 1 -- 172.21.15.107:0/762238509 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca4003520 con 0x7facb80b59d0 2024-03-13T21:20:10.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.853+0000 7facaffff640 1 --2- 172.21.15.107:0/762238509 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faca4004800 0x7faca4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-13T21:20:10.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.854+0000 7facb6d9d640 1 --2- 172.21.15.107:0/762238509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facb80b59d0 0x7faca40051c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7facb000e320 tx=0x7faca4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd18401c11d3ece5 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:10.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.854+0000 7facb5d9b640 1 -- 172.21.15.107:0/762238509 <== mon.2 v2:172.21.15.195:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb0039070 con 0x7facb80b59d0 2024-03-13T21:20:10.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.854+0000 7facb5d9b640 1 -- 172.21.15.107:0/762238509 <== mon.2 v2:172.21.15.195:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facb002cde0 con 0x7facb80b59d0 2024-03-13T21:20:10.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.854+0000 7facb5d9b640 1 -- 172.21.15.107:0/762238509 <== mon.2 v2:172.21.15.195:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facb0009de0 con 0x7facb80b59d0 2024-03-13T21:20:10.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.855+0000 7facbc95b640 1 -- 172.21.15.107:0/762238509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facb80b59d0 msgr2=0x7faca40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.855+0000 7facbc95b640 1 --2- 172.21.15.107:0/762238509 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facb80b59d0 0x7faca40051c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7facb000e320 tx=0x7faca4005830 comp rx=0 tx=0).stop 2024-03-13T21:20:10.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.855+0000 7facb6d9d640 1 -- 172.21.15.107:0/762238509 reap_dead start 2024-03-13T21:20:10.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.855+0000 7facbc95b640 1 -- 172.21.15.107:0/762238509 shutdown_connections 2024-03-13T21:20:10.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.855+0000 7facbc95b640 1 -- 172.21.15.107:0/762238509 >> 172.21.15.107:0/762238509 conn(0x7facb806c510 msgr2=0x7facb80b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:10.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.855+0000 7facbc95b640 1 -- 172.21.15.107:0/762238509 shutdown_connections 2024-03-13T21:20:10.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.855+0000 7facbc95b640 1 -- 172.21.15.107:0/762238509 wait complete. 2024-03-13T21:20:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.856+0000 7facbc95b640 1 Processor -- start 2024-03-13T21:20:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.856+0000 7facbc95b640 1 -- start start 2024-03-13T21:20:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.857+0000 7facbc95b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7facb80b59d0 0x7facb8151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.857+0000 7facbc95b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facb8151530 0x7facb8160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.857+0000 7facbc95b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facb81462e0 0x7facb80b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.857+0000 7facbc95b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7facb80b55c0 con 0x7facb80b59d0 2024-03-13T21:20:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.857+0000 7facbc95b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7facb80b5440 con 0x7facb81462e0 2024-03-13T21:20:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.857+0000 7facbc95b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7facb80afa40 con 0x7facb8151530 2024-03-13T21:20:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.857+0000 7facb659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7facb80b59d0 0x7facb8151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.857+0000 7facb659c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7facb80b59d0 0x7facb8151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36460/0 (socket says 172.21.15.107:36460) 2024-03-13T21:20:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.857+0000 7facb659c640 1 -- 172.21.15.107:0/1779536540 learned_addr learned my addr 172.21.15.107:0/1779536540 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-03-13T21:20:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.857+0000 7facb6d9d640 1 --2- 172.21.15.107:0/1779536540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facb81462e0 0x7facb80b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.857+0000 7facaffff640 1 --2- 172.21.15.107:0/1779536540 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facb8151530 0x7facb8160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.857+0000 7facb659c640 1 -- 172.21.15.107:0/1779536540 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facb8151530 msgr2=0x7facb8160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.857+0000 7facb659c640 1 --2- 172.21.15.107:0/1779536540 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facb8151530 0x7facb8160ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.857+0000 7facb659c640 1 -- 172.21.15.107:0/1779536540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facb81462e0 msgr2=0x7facb80b1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.857+0000 7facb659c640 1 --2- 172.21.15.107:0/1779536540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facb81462e0 0x7facb80b1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.857+0000 7facb659c640 1 -- 172.21.15.107:0/1779536540 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facb81610e0 con 0x7facb80b59d0 2024-03-13T21:20:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.857+0000 7facb659c640 1 --2- 172.21.15.107:0/1779536540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7facb80b59d0 0x7facb8151d60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faca800f7a0 tx=0x7faca800fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.858+0000 7facaeffd640 1 -- 172.21.15.107:0/1779536540 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca800fe50 con 0x7facb80b59d0 2024-03-13T21:20:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.858+0000 7facaeffd640 1 -- 172.21.15.107:0/1779536540 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faca8018070 con 0x7facb80b59d0 2024-03-13T21:20:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.858+0000 7facaeffd640 1 -- 172.21.15.107:0/1779536540 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faca800d730 con 0x7facb80b59d0 2024-03-13T21:20:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.858+0000 7facbc95b640 1 -- 172.21.15.107:0/1779536540 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facb815fb00 con 0x7facb80b59d0 2024-03-13T21:20:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.858+0000 7facbc95b640 1 -- 172.21.15.107:0/1779536540 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facb81600c0 con 0x7facb80b59d0 2024-03-13T21:20:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.858+0000 7facaeffd640 1 -- 172.21.15.107:0/1779536540 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faca800d8d0 con 0x7facb80b59d0 2024-03-13T21:20:10.855 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.858+0000 7facaeffd640 1 -- 172.21.15.107:0/1779536540 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7faca8003dc0 con 0x7facb80b59d0 2024-03-13T21:20:10.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.859+0000 7facbc95b640 1 -- 172.21.15.107:0/1779536540 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facb8075120 con 0x7facb80b59d0 2024-03-13T21:20:10.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.861+0000 7facaeffd640 1 -- 172.21.15.107:0/1779536540 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7facb81610e0 con 0x7facb80b59d0 2024-03-13T21:20:10.886 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:10.894+0000 7f4898c32040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-13T21:20:10.914 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.921+0000 7facbc95b640 1 -- 172.21.15.107:0/1779536540 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7facb80d0640 con 0x7facb80b59d0 2024-03-13T21:20:10.914 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:10.922+0000 7fab46a42040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-13T21:20:10.915 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.922+0000 7facaeffd640 1 -- 172.21.15.107:0/1779536540 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7faca800dbc0 con 0x7facb80b59d0 2024-03-13T21:20:10.915 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:20:10.915 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":10,"fsid":"2124cc6e-e803-48aa-9f5a-1b467da9f25e","created":"2024-03-13T21:20:08.464385+0000","modified":"2024-03-13T21:20:10.701372+0000","last_up_change":"0.000000","last_in_change":"2024-03-13T21:20:10.701372+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c2acc15b-5d55-4ce3-be7d-42c4498c7ade","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6452e15a-de59-4bb8-b50b-ed0c73193d57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6ec15277-ca0f-47b0-a89f-2fa53a606ed9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"de114af6-e8ee-4d26-92d8-e0b0683fe282","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"78d43c86-5c73-4e6d-9a51-d8022f68f36a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ef9caa1c-ef75-4307-8b5d-171bd2eb37b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0f07cccd-e497-44fa-afae-e81242b8ece2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"df5edf8d-3d1b-486f-a640-e01e2f1d1f98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-13T21:20:10.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.923+0000 7facbc95b640 1 -- 172.21.15.107:0/1779536540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7facb80b59d0 msgr2=0x7facb8151d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:10.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.923+0000 7facbc95b640 1 --2- 172.21.15.107:0/1779536540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7facb80b59d0 0x7facb8151d60 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7faca800f7a0 tx=0x7faca800fc60 comp rx=0 tx=0).stop 2024-03-13T21:20:10.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.923+0000 7facbc95b640 1 -- 172.21.15.107:0/1779536540 shutdown_connections 2024-03-13T21:20:10.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.923+0000 7facbc95b640 1 --2- 172.21.15.107:0/1779536540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facb81462e0 0x7facb80b1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.923+0000 7facbc95b640 1 --2- 172.21.15.107:0/1779536540 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7facb8151530 0x7facb8160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.916 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.923+0000 7facbc95b640 1 --2- 172.21.15.107:0/1779536540 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7facb80b59d0 0x7facb8151d60 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:10.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.923+0000 7facbc95b640 1 -- 172.21.15.107:0/1779536540 >> 172.21.15.107:0/1779536540 conn(0x7facb806c510 msgr2=0x7facb806ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:10.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.923+0000 7facbc95b640 1 -- 172.21.15.107:0/1779536540 shutdown_connections 2024-03-13T21:20:10.917 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:10.923+0000 7facbc95b640 1 -- 172.21.15.107:0/1779536540 wait complete. 2024-03-13T21:20:10.926 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-13T21:20:10.926 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-13T21:20:10.998 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:11.006+0000 7f4898c32040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-13T21:20:11.010 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:11.018+0000 7fab46a42040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-13T21:20:11.094 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:11.102+0000 7f4898c32040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-13T21:20:11.166 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:11.174+0000 7fab46a42040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-13T21:20:11.208 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:11.216+0000 7fab46a42040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-13T21:20:11.249 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:11.257+0000 7f4898c32040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-13T21:20:11.291 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:11.299+0000 7f4898c32040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-13T21:20:11.315 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-03-13T21:20:11.322+0000 7fcb7c20c640 -1 Falling back to public interface 2024-03-13T21:20:11.326 INFO:tasks.ceph.osd.2.smithi107.stderr:2024-03-13T21:20:11.333+0000 7faaeee19640 -1 Falling back to public interface 2024-03-13T21:20:11.327 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-03-13T21:20:11.335+0000 7f4d10212640 -1 Falling back to public interface 2024-03-13T21:20:11.334 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-03-13T21:20:11.342+0000 7efd81d38640 -1 Falling back to public interface 2024-03-13T21:20:11.335 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-03-13T21:20:11.343+0000 7fb047611640 -1 Falling back to public interface 2024-03-13T21:20:11.344 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-03-13T21:20:11.351+0000 7f6d15f38640 -1 Falling back to public interface 2024-03-13T21:20:11.345 INFO:tasks.ceph.osd.3.smithi107.stderr:2024-03-13T21:20:11.353+0000 7ff428a0e640 -1 Falling back to public interface 2024-03-13T21:20:11.348 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-03-13T21:20:11.355+0000 7f52b4749640 -1 Falling back to public interface 2024-03-13T21:20:11.365 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:11.373+0000 7fab46a42040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-13T21:20:11.450 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:11.458+0000 7f4898c32040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-13T21:20:11.732 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-13T21:20:11.822 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.830+0000 7efd56827640 1 Processor -- start 2024-03-13T21:20:11.823 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.830+0000 7efd56827640 1 -- start start 2024-03-13T21:20:11.829 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.830+0000 7efd56827640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7efd5015dee0 0x7efd500d1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:11.829 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.830+0000 7efd56827640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efd500d41b0 0x7efd500b6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:11.829 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.830+0000 7efd56827640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd500d2680 con 0x7efd500d2190 2024-03-13T21:20:11.830 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.830+0000 7efd56827640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7efd500d2960 con 0x7efd5015dee0 2024-03-13T21:20:11.830 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.830+0000 7efd56827640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7efd500d2c40 con 0x7efd500d41b0 2024-03-13T21:20:11.830 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4f7fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7efd500d2190 0x7efd500d3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:57692/0 (socket says 172.21.15.107:57692) 2024-03-13T21:20:11.830 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4f7fe640 1 -- 172.21.15.107:0/2489952942 learned_addr learned my addr 172.21.15.107:0/2489952942 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-03-13T21:20:11.830 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4ffff640 1 --2- 172.21.15.107:0/2489952942 >> v2:172.21.15.195:3300/0 conn(0x7efd5015dee0 0x7efd500d1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:11.830 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd54dc4640 1 --2- 172.21.15.107:0/2489952942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efd500d41b0 0x7efd500b6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:11.830 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4effd640 1 -- 172.21.15.107:0/2489952942 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2922212525 0 0) 0x7efd500d2680 con 0x7efd500d2190 2024-03-13T21:20:11.830 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4effd640 1 -- 172.21.15.107:0/2489952942 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd38003520 con 0x7efd500d2190 2024-03-13T21:20:11.830 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4effd640 1 -- 172.21.15.107:0/2489952942 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1395084862 0 0) 0x7efd38003520 con 0x7efd500d2190 2024-03-13T21:20:11.830 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4effd640 1 -- 172.21.15.107:0/2489952942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efd500d41b0 msgr2=0x7efd500b6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:11.830 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4effd640 1 --2- 172.21.15.107:0/2489952942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efd500d41b0 0x7efd500b6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:11.830 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4effd640 1 -- 172.21.15.107:0/2489952942 >> v2:172.21.15.195:3300/0 conn(0x7efd5015dee0 msgr2=0x7efd500d1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:11.830 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4effd640 1 --2- 172.21.15.107:0/2489952942 >> v2:172.21.15.195:3300/0 conn(0x7efd5015dee0 0x7efd500d1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:11.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4effd640 1 -- 172.21.15.107:0/2489952942 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd500d2f20 con 0x7efd500d2190 2024-03-13T21:20:11.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4effd640 1 -- 172.21.15.107:0/2489952942 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1025813135 0 0) 0x7efd440017f0 con 0x7efd500d2190 2024-03-13T21:20:11.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4ffff640 1 --2- 172.21.15.107:0/2489952942 >> v2:172.21.15.195:3300/0 conn(0x7efd5015dee0 0x7efd500d1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-13T21:20:11.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4effd640 1 -- 172.21.15.107:0/2489952942 >> v1:172.21.15.107:6789/0 conn(0x7efd500d2190 legacy=0x7efd500d3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:11.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4effd640 1 --2- 172.21.15.107:0/2489952942 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd380039b0 0x7efd38003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:11.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4effd640 1 --2- 172.21.15.107:0/2489952942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd38004800 0x7efd38004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:11.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4effd640 1 --2- 172.21.15.107:0/2489952942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efd500d41b0 0x7efd380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:11.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4effd640 1 -- 172.21.15.107:0/2489952942 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efd500d2960 con 0x7efd380039b0 2024-03-13T21:20:11.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4effd640 1 -- 172.21.15.107:0/2489952942 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7efd500d2c40 con 0x7efd38004800 2024-03-13T21:20:11.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4effd640 1 -- 172.21.15.107:0/2489952942 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7efd3800b9c0 con 0x7efd500d41b0 2024-03-13T21:20:11.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4ffff640 1 --2- 172.21.15.107:0/2489952942 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd380039b0 0x7efd38003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:11.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd4f7fe640 1 --2- 172.21.15.107:0/2489952942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd38004800 0x7efd38004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:11.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.831+0000 7efd54dc4640 1 --2- 172.21.15.107:0/2489952942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efd500d41b0 0x7efd380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:11.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.832+0000 7efd4ffff640 1 -- 172.21.15.107:0/2489952942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efd500d41b0 msgr2=0x7efd380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:11.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.832+0000 7efd4ffff640 1 --2- 172.21.15.107:0/2489952942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efd500d41b0 0x7efd380051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:11.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.832+0000 7efd4ffff640 1 -- 172.21.15.107:0/2489952942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd38004800 msgr2=0x7efd38004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:11.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.832+0000 7efd4ffff640 1 --2- 172.21.15.107:0/2489952942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd38004800 0x7efd38004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:11.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.832+0000 7efd4ffff640 1 -- 172.21.15.107:0/2489952942 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd38003520 con 0x7efd380039b0 2024-03-13T21:20:11.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.832+0000 7efd54dc4640 1 --2- 172.21.15.107:0/2489952942 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efd500d41b0 0x7efd380051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-13T21:20:11.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.832+0000 7efd4f7fe640 1 --2- 172.21.15.107:0/2489952942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd38004800 0x7efd38004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-13T21:20:11.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.832+0000 7efd4ffff640 1 --2- 172.21.15.107:0/2489952942 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd380039b0 0x7efd38003dd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efd40009c90 tx=0x7efd38005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a710c4cbe114c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:11.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.832+0000 7efd4effd640 1 -- 172.21.15.107:0/2489952942 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40039070 con 0x7efd380039b0 2024-03-13T21:20:11.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.832+0000 7efd4effd640 1 -- 172.21.15.107:0/2489952942 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd4002c980 con 0x7efd380039b0 2024-03-13T21:20:11.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.832+0000 7efd4effd640 1 -- 172.21.15.107:0/2489952942 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40009860 con 0x7efd380039b0 2024-03-13T21:20:11.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.833+0000 7efd56827640 1 -- 172.21.15.107:0/2489952942 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd380039b0 msgr2=0x7efd38003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:11.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.833+0000 7efd56827640 1 --2- 172.21.15.107:0/2489952942 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd380039b0 0x7efd38003dd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7efd40009c90 tx=0x7efd38005830 comp rx=0 tx=0).stop 2024-03-13T21:20:11.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.833+0000 7efd54dc4640 1 -- 172.21.15.107:0/2489952942 reap_dead start 2024-03-13T21:20:11.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.833+0000 7efd56827640 1 -- 172.21.15.107:0/2489952942 shutdown_connections 2024-03-13T21:20:11.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.833+0000 7efd56827640 1 -- 172.21.15.107:0/2489952942 >> 172.21.15.107:0/2489952942 conn(0x7efd500729a0 msgr2=0x7efd50072db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:11.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.833+0000 7efd56827640 1 -- 172.21.15.107:0/2489952942 shutdown_connections 2024-03-13T21:20:11.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.833+0000 7efd56827640 1 -- 172.21.15.107:0/2489952942 wait complete. 2024-03-13T21:20:11.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.834+0000 7efd56827640 1 Processor -- start 2024-03-13T21:20:11.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.834+0000 7efd56827640 1 -- start start 2024-03-13T21:20:11.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.835+0000 7efd56827640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd380039b0 0x7efd5014fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:11.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.835+0000 7efd56827640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efd501f7620 0x7efd501f7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:11.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.835+0000 7efd56827640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd5014c680 0x7efd5014cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:11.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.835+0000 7efd56827640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7efd500d3720 con 0x7efd5014c680 2024-03-13T21:20:11.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.835+0000 7efd56827640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7efd5015e2c0 con 0x7efd380039b0 2024-03-13T21:20:11.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.835+0000 7efd56827640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7efd5014f2a0 con 0x7efd501f7620 2024-03-13T21:20:11.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.835+0000 7efd54dc4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd5014c680 0x7efd5014cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:11.834 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.835+0000 7efd54dc4640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd5014c680 0x7efd5014cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:36484/0 (socket says 172.21.15.107:36484) 2024-03-13T21:20:11.834 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.835+0000 7efd54dc4640 1 -- 172.21.15.107:0/1553843837 learned_addr learned my addr 172.21.15.107:0/1553843837 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-03-13T21:20:11.834 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.835+0000 7efd4ffff640 1 --2- 172.21.15.107:0/1553843837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd380039b0 0x7efd5014fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:11.834 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.835+0000 7efd4f7fe640 1 --2- 172.21.15.107:0/1553843837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efd501f7620 0x7efd501f7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:11.834 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.835+0000 7efd54dc4640 1 -- 172.21.15.107:0/1553843837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efd501f7620 msgr2=0x7efd501f7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:11.834 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.835+0000 7efd54dc4640 1 --2- 172.21.15.107:0/1553843837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efd501f7620 0x7efd501f7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:11.834 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.835+0000 7efd54dc4640 1 -- 172.21.15.107:0/1553843837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd380039b0 msgr2=0x7efd5014fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:11.834 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.835+0000 7efd54dc4640 1 --2- 172.21.15.107:0/1553843837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd380039b0 0x7efd5014fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:11.834 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.835+0000 7efd54dc4640 1 -- 172.21.15.107:0/1553843837 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd50150240 con 0x7efd5014c680 2024-03-13T21:20:11.834 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.836+0000 7efd54dc4640 1 --2- 172.21.15.107:0/1553843837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd5014c680 0x7efd5014cb00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efd500b66d0 tx=0x7efd48010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:11.834 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.836+0000 7efd4cff9640 1 -- 172.21.15.107:0/1553843837 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd44007d50 con 0x7efd5014c680 2024-03-13T21:20:11.834 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.836+0000 7efd4cff9640 1 -- 172.21.15.107:0/1553843837 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd48003990 con 0x7efd5014c680 2024-03-13T21:20:11.834 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.836+0000 7efd56827640 1 -- 172.21.15.107:0/1553843837 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd501f80c0 con 0x7efd5014c680 2024-03-13T21:20:11.834 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.836+0000 7efd4cff9640 1 -- 172.21.15.107:0/1553843837 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd48003d80 con 0x7efd5014c680 2024-03-13T21:20:11.835 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.836+0000 7efd56827640 1 -- 172.21.15.107:0/1553843837 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5014f500 con 0x7efd5014c680 2024-03-13T21:20:11.835 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.836+0000 7efd4cff9640 1 -- 172.21.15.107:0/1553843837 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efd4801e030 con 0x7efd5014c680 2024-03-13T21:20:11.835 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.836+0000 7efd4cff9640 1 -- 172.21.15.107:0/1553843837 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7efd48020410 con 0x7efd5014c680 2024-03-13T21:20:11.835 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.837+0000 7efd56827640 1 -- 172.21.15.107:0/1553843837 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd500678e0 con 0x7efd5014c680 2024-03-13T21:20:11.835 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.839+0000 7efd4cff9640 1 -- 172.21.15.107:0/1553843837 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7efd500678e0 con 0x7efd5014c680 2024-03-13T21:20:11.892 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.900+0000 7efd56827640 1 -- 172.21.15.107:0/1553843837 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd50068780 con 0x7efd5014c680 2024-03-13T21:20:11.892 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.900+0000 7efd4cff9640 1 -- 172.21.15.107:0/1553843837 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7efd48025020 con 0x7efd5014c680 2024-03-13T21:20:11.893 INFO:teuthology.misc.health.smithi107.stdout: 2024-03-13T21:20:11.893 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":10,"fsid":"2124cc6e-e803-48aa-9f5a-1b467da9f25e","created":"2024-03-13T21:20:08.464385+0000","modified":"2024-03-13T21:20:10.701372+0000","last_up_change":"0.000000","last_in_change":"2024-03-13T21:20:10.701372+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c2acc15b-5d55-4ce3-be7d-42c4498c7ade","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6452e15a-de59-4bb8-b50b-ed0c73193d57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6ec15277-ca0f-47b0-a89f-2fa53a606ed9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"de114af6-e8ee-4d26-92d8-e0b0683fe282","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"78d43c86-5c73-4e6d-9a51-d8022f68f36a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ef9caa1c-ef75-4307-8b5d-171bd2eb37b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0f07cccd-e497-44fa-afae-e81242b8ece2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"df5edf8d-3d1b-486f-a640-e01e2f1d1f98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-13T21:20:11.894 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.901+0000 7efd56827640 1 -- 172.21.15.107:0/1553843837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd5014c680 msgr2=0x7efd5014cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:11.894 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.901+0000 7efd56827640 1 --2- 172.21.15.107:0/1553843837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd5014c680 0x7efd5014cb00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7efd500b66d0 tx=0x7efd48010590 comp rx=0 tx=0).stop 2024-03-13T21:20:11.894 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.901+0000 7efd56827640 1 -- 172.21.15.107:0/1553843837 shutdown_connections 2024-03-13T21:20:11.894 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.901+0000 7efd56827640 1 --2- 172.21.15.107:0/1553843837 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7efd5014c680 0x7efd5014cb00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:11.894 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.901+0000 7efd56827640 1 --2- 172.21.15.107:0/1553843837 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7efd501f7620 0x7efd501f7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:11.894 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.901+0000 7efd56827640 1 --2- 172.21.15.107:0/1553843837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd380039b0 0x7efd5014fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:11.894 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.901+0000 7efd56827640 1 -- 172.21.15.107:0/1553843837 >> 172.21.15.107:0/1553843837 conn(0x7efd500729a0 msgr2=0x7efd500b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:11.894 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.901+0000 7efd56827640 1 -- 172.21.15.107:0/1553843837 shutdown_connections 2024-03-13T21:20:11.894 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:11.901+0000 7efd56827640 1 -- 172.21.15.107:0/1553843837 wait complete. 2024-03-13T21:20:11.902 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-13T21:20:12.194 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:12.202+0000 7fab46a42040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-13T21:20:12.295 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:12.303+0000 7f4898c32040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-13T21:20:12.469 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:12.476+0000 7fab46a42040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-13T21:20:12.520 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:12.527+0000 7fab46a42040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-13T21:20:12.573 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:12.580+0000 7f4898c32040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-13T21:20:12.623 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:12.630+0000 7f4898c32040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-13T21:20:12.633 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:12.641+0000 7fab46a42040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-13T21:20:12.743 INFO:tasks.ceph.mgr.x.smithi195.stderr:2024-03-13T21:20:12.751+0000 7f4898c32040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-13T21:20:13.658 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:13.666+0000 7faae7626640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-13T21:20:13.658 INFO:tasks.ceph.mgr.y.smithi107.stderr:2024-03-13T21:20:13.666+0000 7faae7626640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-13T21:20:14.795 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-03-13T21:20:14.802+0000 7f4d10212640 -1 osd.5 0 log_to_monitors true 2024-03-13T21:20:14.797 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-03-13T21:20:14.805+0000 7fcb7c20c640 -1 osd.4 0 log_to_monitors true 2024-03-13T21:20:14.802 INFO:tasks.ceph.osd.2.smithi107.stderr:2024-03-13T21:20:14.809+0000 7faaeee19640 -1 osd.2 0 log_to_monitors true 2024-03-13T21:20:14.843 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-03-13T21:20:14.851+0000 7f52b4749640 -1 osd.7 0 log_to_monitors true 2024-03-13T21:20:14.851 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-03-13T21:20:14.859+0000 7efd81d38640 -1 osd.0 0 log_to_monitors true 2024-03-13T21:20:14.863 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-03-13T21:20:14.872+0000 7f6d15f38640 -1 osd.6 0 log_to_monitors true 2024-03-13T21:20:14.893 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-03-13T21:20:14.900+0000 7fb047611640 -1 osd.1 0 log_to_monitors true 2024-03-13T21:20:14.903 INFO:tasks.ceph.osd.3.smithi107.stderr:2024-03-13T21:20:14.910+0000 7ff428a0e640 -1 osd.3 0 log_to_monitors true 2024-03-13T21:20:18.059 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-03-13T21:20:18.067+0000 7f4d0b2b1640 -1 osd.5 0 waiting for initial osdmap 2024-03-13T21:20:18.066 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-03-13T21:20:18.075+0000 7f6d116ab640 -1 osd.6 0 waiting for initial osdmap 2024-03-13T21:20:18.072 INFO:tasks.ceph.osd.5.smithi195.stderr:2024-03-13T21:20:18.081+0000 7f4d038e3640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-13T21:20:18.079 INFO:tasks.ceph.osd.6.smithi195.stderr:2024-03-13T21:20:18.088+0000 7f6d09cdd640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-13T21:20:18.102 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-03-13T21:20:18.110+0000 7f52afebc640 -1 osd.7 0 waiting for initial osdmap 2024-03-13T21:20:18.111 INFO:tasks.ceph.osd.7.smithi195.stderr:2024-03-13T21:20:18.120+0000 7f52a84ee640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-13T21:20:18.112 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-03-13T21:20:18.120+0000 7fcb78adb640 -1 osd.4 0 waiting for initial osdmap 2024-03-13T21:20:18.121 INFO:tasks.ceph.osd.4.smithi195.stderr:2024-03-13T21:20:18.130+0000 7fcb6f8d5640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-13T21:20:18.708 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-13T21:20:18.716 INFO:tasks.ceph.osd.3.smithi107.stderr:2024-03-13T21:20:18.724+0000 7ff423bb0640 -1 osd.3 0 waiting for initial osdmap 2024-03-13T21:20:18.721 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-03-13T21:20:18.730+0000 7fb0426c2640 -1 osd.1 0 waiting for initial osdmap 2024-03-13T21:20:18.727 INFO:tasks.ceph.osd.3.smithi107.stderr:2024-03-13T21:20:18.736+0000 7ff41c1e2640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-13T21:20:18.734 INFO:tasks.ceph.osd.1.smithi107.stderr:2024-03-13T21:20:18.743+0000 7fb03acf4640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-13T21:20:18.792 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-03-13T21:20:18.800+0000 7efd7d4ab640 -1 osd.0 0 waiting for initial osdmap 2024-03-13T21:20:18.806 INFO:tasks.ceph.osd.2.smithi107.stderr:2024-03-13T21:20:18.814+0000 7faaeb892640 -1 osd.2 0 waiting for initial osdmap 2024-03-13T21:20:18.806 INFO:tasks.ceph.osd.0.smithi107.stderr:2024-03-13T21:20:18.815+0000 7efd75add640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-13T21:20:18.824 INFO:tasks.ceph.osd.2.smithi107.stderr:2024-03-13T21:20:18.833+0000 7faae268c640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-13T21:20:18.826 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.835+0000 7f743f989640 1 Processor -- start 2024-03-13T21:20:18.827 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.835+0000 7f743f989640 1 -- start start 2024-03-13T21:20:18.830 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.836+0000 7f743f989640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f743806f960 0x7f743806ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:18.830 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.836+0000 7f743f989640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74380729f0 con 0x7f743815e630 2024-03-13T21:20:18.830 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.836+0000 7f743f989640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7438072cb0 con 0x7f743815e250 2024-03-13T21:20:18.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.836+0000 7f743f989640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f74380ad050 con 0x7f743806f960 2024-03-13T21:20:18.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.836+0000 7f743df26640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f743815e630 0x7f743815eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:45916/0 (socket says 172.21.15.107:45916) 2024-03-13T21:20:18.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.836+0000 7f743df26640 1 -- 172.21.15.107:0/2647052187 learned_addr learned my addr 172.21.15.107:0/2647052187 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-03-13T21:20:18.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.836+0000 7f743cf24640 1 --2- 172.21.15.107:0/2647052187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f743806f960 0x7f743806ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:18.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.836+0000 7f742ffff640 1 -- 172.21.15.107:0/2647052187 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4154766780 0 0) 0x7f74380729f0 con 0x7f743815e630 2024-03-13T21:20:18.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.836+0000 7f742ffff640 1 -- 172.21.15.107:0/2647052187 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7424003520 con 0x7f743815e630 2024-03-13T21:20:18.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f742ffff640 1 -- 172.21.15.107:0/2647052187 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2707917600 0 0) 0x7f7424003520 con 0x7f743815e630 2024-03-13T21:20:18.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f742ffff640 1 -- 172.21.15.107:0/2647052187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f743806f960 msgr2=0x7f743806ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:18.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f742ffff640 1 --2- 172.21.15.107:0/2647052187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f743806f960 0x7f743806ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:18.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f742ffff640 1 -- 172.21.15.107:0/2647052187 >> v1:172.21.15.195:6789/0 conn(0x7f743815e250 legacy=0x7f743806dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:18.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f742ffff640 1 -- 172.21.15.107:0/2647052187 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74380ad330 con 0x7f743815e630 2024-03-13T21:20:18.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f742ffff640 1 -- 172.21.15.107:0/2647052187 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1025813135 0 0) 0x7f7430001a10 con 0x7f743815e630 2024-03-13T21:20:18.831 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f742ffff640 1 -- 172.21.15.107:0/2647052187 >> v1:172.21.15.107:6789/0 conn(0x7f743815e630 legacy=0x7f743815eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:18.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f742ffff640 1 --2- 172.21.15.107:0/2647052187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f743806f960 0x7f74240039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:18.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f742ffff640 1 --2- 172.21.15.107:0/2647052187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7424003f20 0x7f7424004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:18.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f742ffff640 1 --2- 172.21.15.107:0/2647052187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7424004d40 0x7f74240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:18.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f742ffff640 1 -- 172.21.15.107:0/2647052187 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f74380ad050 con 0x7f7424004d40 2024-03-13T21:20:18.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f742ffff640 1 -- 172.21.15.107:0/2647052187 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f742400ba20 con 0x7f7424003f20 2024-03-13T21:20:18.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f742ffff640 1 -- 172.21.15.107:0/2647052187 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f742400bc20 con 0x7f743806f960 2024-03-13T21:20:18.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f743df26640 1 --2- 172.21.15.107:0/2647052187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7424004d40 0x7f74240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:18.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f743cf24640 1 --2- 172.21.15.107:0/2647052187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7424003f20 0x7f7424004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:18.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f743d725640 1 --2- 172.21.15.107:0/2647052187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f743806f960 0x7f74240039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:18.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f743df26640 1 -- 172.21.15.107:0/2647052187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f743806f960 msgr2=0x7f74240039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:18.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f743df26640 1 --2- 172.21.15.107:0/2647052187 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f743806f960 0x7f74240039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:18.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f743df26640 1 -- 172.21.15.107:0/2647052187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7424003f20 msgr2=0x7f7424004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:18.832 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f743df26640 1 --2- 172.21.15.107:0/2647052187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7424003f20 0x7f7424004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:18.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.837+0000 7f743df26640 1 -- 172.21.15.107:0/2647052187 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7424003520 con 0x7f7424004d40 2024-03-13T21:20:18.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.838+0000 7f743df26640 1 --2- 172.21.15.107:0/2647052187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7424004d40 0x7f74240051c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f743000a880 tx=0x7f7424005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90cd80b90448408d server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:18.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.838+0000 7f742ffff640 1 -- 172.21.15.107:0/2647052187 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743000a4d0 con 0x7f7424004d40 2024-03-13T21:20:18.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.838+0000 7f742ffff640 1 -- 172.21.15.107:0/2647052187 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74300072d0 con 0x7f7424004d40 2024-03-13T21:20:18.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.838+0000 7f742ffff640 1 -- 172.21.15.107:0/2647052187 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74300076c0 con 0x7f7424004d40 2024-03-13T21:20:18.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.838+0000 7f743f989640 1 -- 172.21.15.107:0/2647052187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7424004d40 msgr2=0x7f74240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:18.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.838+0000 7f743f989640 1 --2- 172.21.15.107:0/2647052187 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7424004d40 0x7f74240051c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f743000a880 tx=0x7f7424005830 comp rx=0 tx=0).stop 2024-03-13T21:20:18.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.838+0000 7f743df26640 1 -- 172.21.15.107:0/2647052187 reap_dead start 2024-03-13T21:20:18.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.838+0000 7f743f989640 1 -- 172.21.15.107:0/2647052187 shutdown_connections 2024-03-13T21:20:18.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.838+0000 7f743f989640 1 -- 172.21.15.107:0/2647052187 >> 172.21.15.107:0/2647052187 conn(0x7f74380b1bf0 msgr2=0x7f74380b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:18.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.839+0000 7f743f989640 1 -- 172.21.15.107:0/2647052187 shutdown_connections 2024-03-13T21:20:18.833 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.839+0000 7f743f989640 1 -- 172.21.15.107:0/2647052187 wait complete. 2024-03-13T21:20:18.836 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.840+0000 7f743f989640 1 Processor -- start 2024-03-13T21:20:18.837 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.840+0000 7f743f989640 1 -- start start 2024-03-13T21:20:18.837 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.840+0000 7f743f989640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7438149a60 0x7f74380cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:18.837 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.840+0000 7f743f989640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7438149e40 0x7f743815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:18.837 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.840+0000 7f743f989640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7438152c20 0x7f74380cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:18.837 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.840+0000 7f743f989640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f743806b1e0 con 0x7f7438149e40 2024-03-13T21:20:18.837 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.840+0000 7f743f989640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f743806b060 con 0x7f7438152c20 2024-03-13T21:20:18.837 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.840+0000 7f743f989640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f74380ad850 con 0x7f7438149a60 2024-03-13T21:20:18.837 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.840+0000 7f743cf24640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7438149e40 0x7f743815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:18.837 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.840+0000 7f743cf24640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7438149e40 0x7f743815a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38378/0 (socket says 172.21.15.107:38378) 2024-03-13T21:20:18.837 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.840+0000 7f743cf24640 1 -- 172.21.15.107:0/2247830913 learned_addr learned my addr 172.21.15.107:0/2247830913 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-03-13T21:20:18.837 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.841+0000 7f743d725640 1 --2- 172.21.15.107:0/2247830913 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7438149a60 0x7f74380cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:18.838 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.841+0000 7f743df26640 1 --2- 172.21.15.107:0/2247830913 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7438152c20 0x7f74380cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:18.838 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.841+0000 7f743cf24640 1 -- 172.21.15.107:0/2247830913 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7438149a60 msgr2=0x7f74380cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:18.838 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.841+0000 7f743cf24640 1 --2- 172.21.15.107:0/2247830913 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7438149a60 0x7f74380cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:18.838 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.841+0000 7f743cf24640 1 -- 172.21.15.107:0/2247830913 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7438152c20 msgr2=0x7f74380cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:18.838 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.841+0000 7f743cf24640 1 --2- 172.21.15.107:0/2247830913 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7438152c20 0x7f74380cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:18.838 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.841+0000 7f743cf24640 1 -- 172.21.15.107:0/2247830913 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7438159650 con 0x7f7438149e40 2024-03-13T21:20:18.838 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.841+0000 7f743d725640 1 --2- 172.21.15.107:0/2247830913 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7438149a60 0x7f74380cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-13T21:20:18.838 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.841+0000 7f743cf24640 1 --2- 172.21.15.107:0/2247830913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7438149e40 0x7f743815a6f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7428011910 tx=0x7f7428011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:18.838 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.841+0000 7f742dffb640 1 -- 172.21.15.107:0/2247830913 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428019070 con 0x7f7438149e40 2024-03-13T21:20:18.838 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.841+0000 7f742dffb640 1 -- 172.21.15.107:0/2247830913 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7428004240 con 0x7f7438149e40 2024-03-13T21:20:18.838 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.841+0000 7f743f989640 1 -- 172.21.15.107:0/2247830913 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7438159930 con 0x7f7438149e40 2024-03-13T21:20:18.838 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.841+0000 7f742dffb640 1 -- 172.21.15.107:0/2247830913 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f742800f8e0 con 0x7f7438149e40 2024-03-13T21:20:18.839 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.841+0000 7f743f989640 1 -- 172.21.15.107:0/2247830913 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7438159ef0 con 0x7f7438149e40 2024-03-13T21:20:18.839 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.842+0000 7f743f989640 1 -- 172.21.15.107:0/2247830913 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7438068780 con 0x7f7438149e40 2024-03-13T21:20:18.839 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.843+0000 7f742dffb640 1 -- 172.21.15.107:0/2247830913 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 4) ==== 90080+0+0 (secure 0 0 0) 0x7f742801c070 con 0x7f7438149e40 2024-03-13T21:20:18.839 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.843+0000 7f742dffb640 1 --2- 172.21.15.107:0/2247830913 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f741c06bb70 0x7f741c06e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:18.839 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.843+0000 7f742dffb640 1 -- 172.21.15.107:0/2247830913 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f742808a0a0 con 0x7f7438149e40 2024-03-13T21:20:18.839 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.843+0000 7f743d725640 1 --2- 172.21.15.107:0/2247830913 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f741c06bb70 0x7f741c06e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:18.839 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.843+0000 7f743d725640 1 --2- 172.21.15.107:0/2247830913 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f741c06bb70 0x7f741c06e030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7434003700 tx=0x7f7434009040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:18.839 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:18.847+0000 7f742dffb640 1 -- 172.21.15.107:0/2247830913 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183657 (secure 0 0 0) 0x7f7428059a00 con 0x7f7438149e40 2024-03-13T21:20:19.011 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:19.020+0000 7f743f989640 1 -- 172.21.15.107:0/2247830913 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74380722e0 con 0x7f7438149e40 2024-03-13T21:20:19.012 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:19.020+0000 7f742dffb640 1 -- 172.21.15.107:0/2247830913 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f7428059300 con 0x7f7438149e40 2024-03-13T21:20:19.012 INFO:teuthology.misc.health.smithi107.stdout: 2024-03-13T21:20:19.012 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":12,"fsid":"2124cc6e-e803-48aa-9f5a-1b467da9f25e","created":"2024-03-13T21:20:08.464385+0000","modified":"2024-03-13T21:20:16.667583+0000","last_up_change":"0.000000","last_in_change":"2024-03-13T21:20:10.701372+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c2acc15b-5d55-4ce3-be7d-42c4498c7ade","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"6452e15a-de59-4bb8-b50b-ed0c73193d57","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6ec15277-ca0f-47b0-a89f-2fa53a606ed9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"de114af6-e8ee-4d26-92d8-e0b0683fe282","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"78d43c86-5c73-4e6d-9a51-d8022f68f36a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ef9caa1c-ef75-4307-8b5d-171bd2eb37b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0f07cccd-e497-44fa-afae-e81242b8ece2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"df5edf8d-3d1b-486f-a640-e01e2f1d1f98","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-13T21:20:19.014 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:19.022+0000 7f743f989640 1 -- 172.21.15.107:0/2247830913 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f741c06bb70 msgr2=0x7f741c06e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:19.014 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:19.022+0000 7f743f989640 1 --2- 172.21.15.107:0/2247830913 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f741c06bb70 0x7f741c06e030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7434003700 tx=0x7f7434009040 comp rx=0 tx=0).stop 2024-03-13T21:20:19.014 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:19.022+0000 7f743f989640 1 -- 172.21.15.107:0/2247830913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7438149e40 msgr2=0x7f743815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:19.014 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:19.022+0000 7f743f989640 1 --2- 172.21.15.107:0/2247830913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7438149e40 0x7f743815a6f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7428011910 tx=0x7f7428011dd0 comp rx=0 tx=0).stop 2024-03-13T21:20:19.015 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:19.022+0000 7f743f989640 1 -- 172.21.15.107:0/2247830913 shutdown_connections 2024-03-13T21:20:19.015 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:19.022+0000 7f743f989640 1 --2- 172.21.15.107:0/2247830913 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f741c06bb70 0x7f741c06e030 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:19.015 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:19.022+0000 7f743f989640 1 --2- 172.21.15.107:0/2247830913 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7438152c20 0x7f74380cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:19.015 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:19.022+0000 7f743f989640 1 --2- 172.21.15.107:0/2247830913 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7438149e40 0x7f743815a6f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:19.015 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:19.022+0000 7f743f989640 1 --2- 172.21.15.107:0/2247830913 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7438149a60 0x7f74380cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:19.015 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:19.022+0000 7f743f989640 1 -- 172.21.15.107:0/2247830913 >> 172.21.15.107:0/2247830913 conn(0x7f74380b1bf0 msgr2=0x7f74380adbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:19.015 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:19.022+0000 7f743f989640 1 -- 172.21.15.107:0/2247830913 shutdown_connections 2024-03-13T21:20:19.015 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:19.022+0000 7f743f989640 1 -- 172.21.15.107:0/2247830913 wait complete. 2024-03-13T21:20:19.023 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-13T21:20:25.830 DEBUG:teuthology.orchestra.run.smithi107:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-13T21:20:25.930 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.938+0000 7f426d359640 1 Processor -- start 2024-03-13T21:20:25.930 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.938+0000 7f426d359640 1 -- start start 2024-03-13T21:20:25.934 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.939+0000 7f426d359640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f426809a310 0x7f42680cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:25.934 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.939+0000 7f426d359640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42680b1710 con 0x7f426815f430 2024-03-13T21:20:25.934 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.939+0000 7f426d359640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42680b19f0 con 0x7f42680b11a0 2024-03-13T21:20:25.934 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.939+0000 7f426d359640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f42680b1cd0 con 0x7f426809a310 2024-03-13T21:20:25.934 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.939+0000 7f4266ffd640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f426815f430 0x7f42680b27b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:45922/0 (socket says 172.21.15.107:45922) 2024-03-13T21:20:25.934 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.939+0000 7f4266ffd640 1 -- 172.21.15.107:0/2260514180 learned_addr learned my addr 172.21.15.107:0/2260514180 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-03-13T21:20:25.934 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f42677fe640 1 --2- 172.21.15.107:0/2260514180 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f426809a310 0x7f42680cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:25.934 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f4265ffb640 1 -- 172.21.15.107:0/2260514180 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 433496797 0 0) 0x7f42680b1710 con 0x7f426815f430 2024-03-13T21:20:25.935 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f4265ffb640 1 -- 172.21.15.107:0/2260514180 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4250003520 con 0x7f426815f430 2024-03-13T21:20:25.935 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f4265ffb640 1 -- 172.21.15.107:0/2260514180 <== mon.1 v1:172.21.15.195:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3308747331 0 0) 0x7f42680b19f0 con 0x7f42680b11a0 2024-03-13T21:20:25.935 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f4265ffb640 1 -- 172.21.15.107:0/2260514180 --> v1:172.21.15.195:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42680b1710 con 0x7f42680b11a0 2024-03-13T21:20:25.935 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f4265ffb640 1 -- 172.21.15.107:0/2260514180 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2357276531 0 0) 0x7f4250003520 con 0x7f426815f430 2024-03-13T21:20:25.935 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f4265ffb640 1 -- 172.21.15.107:0/2260514180 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f426809a310 msgr2=0x7f42680cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:25.935 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f4265ffb640 1 --2- 172.21.15.107:0/2260514180 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f426809a310 0x7f42680cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:25.935 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f4265ffb640 1 -- 172.21.15.107:0/2260514180 >> v1:172.21.15.195:6789/0 conn(0x7f42680b11a0 legacy=0x7f4268099c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:25.935 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f4265ffb640 1 -- 172.21.15.107:0/2260514180 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42680b1fb0 con 0x7f426815f430 2024-03-13T21:20:25.935 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f4265ffb640 1 -- 172.21.15.107:0/2260514180 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1025813135 0 0) 0x7f4258001670 con 0x7f426815f430 2024-03-13T21:20:25.935 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f4265ffb640 1 -- 172.21.15.107:0/2260514180 >> v1:172.21.15.107:6789/0 conn(0x7f426815f430 legacy=0x7f42680b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:25.935 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f4265ffb640 1 --2- 172.21.15.107:0/2260514180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4250003b70 0x7f4250003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:25.935 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f4265ffb640 1 --2- 172.21.15.107:0/2260514180 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f426809a310 0x7f4250004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:25.935 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f4265ffb640 1 --2- 172.21.15.107:0/2260514180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4250004d40 0x7f42500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:25.935 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f4265ffb640 1 -- 172.21.15.107:0/2260514180 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f42680b1cd0 con 0x7f4250004d40 2024-03-13T21:20:25.936 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f4265ffb640 1 -- 172.21.15.107:0/2260514180 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f425000baf0 con 0x7f4250003b70 2024-03-13T21:20:25.936 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f4265ffb640 1 -- 172.21.15.107:0/2260514180 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f425000bcf0 con 0x7f426809a310 2024-03-13T21:20:25.936 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f42677fe640 1 --2- 172.21.15.107:0/2260514180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4250004d40 0x7f42500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:25.936 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f42667fc640 1 --2- 172.21.15.107:0/2260514180 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f426809a310 0x7f4250004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:25.936 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f4266ffd640 1 --2- 172.21.15.107:0/2260514180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4250003b70 0x7f4250003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:25.936 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f42677fe640 1 -- 172.21.15.107:0/2260514180 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f426809a310 msgr2=0x7f4250004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:25.936 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f42677fe640 1 --2- 172.21.15.107:0/2260514180 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f426809a310 0x7f4250004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:25.936 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f42677fe640 1 -- 172.21.15.107:0/2260514180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4250003b70 msgr2=0x7f4250003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:25.936 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f42677fe640 1 --2- 172.21.15.107:0/2260514180 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4250003b70 0x7f4250003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:25.936 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.940+0000 7f42677fe640 1 -- 172.21.15.107:0/2260514180 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4250003520 con 0x7f4250004d40 2024-03-13T21:20:25.936 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.941+0000 7f42677fe640 1 --2- 172.21.15.107:0/2260514180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4250004d40 0x7f42500051c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4260009fc0 tx=0x7f4250005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa726cb8f2b9eb82 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:25.936 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.941+0000 7f4265ffb640 1 -- 172.21.15.107:0/2260514180 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4260039070 con 0x7f4250004d40 2024-03-13T21:20:25.936 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.941+0000 7f4265ffb640 1 -- 172.21.15.107:0/2260514180 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f426002cc20 con 0x7f4250004d40 2024-03-13T21:20:25.937 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.941+0000 7f4265ffb640 1 -- 172.21.15.107:0/2260514180 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4260009c10 con 0x7f4250004d40 2024-03-13T21:20:25.937 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.942+0000 7f426d359640 1 -- 172.21.15.107:0/2260514180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4250004d40 msgr2=0x7f42500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:25.937 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.942+0000 7f426d359640 1 --2- 172.21.15.107:0/2260514180 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4250004d40 0x7f42500051c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4260009fc0 tx=0x7f4250005830 comp rx=0 tx=0).stop 2024-03-13T21:20:25.937 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.942+0000 7f42677fe640 1 -- 172.21.15.107:0/2260514180 reap_dead start 2024-03-13T21:20:25.937 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.942+0000 7f426d359640 1 -- 172.21.15.107:0/2260514180 shutdown_connections 2024-03-13T21:20:25.937 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.942+0000 7f426d359640 1 -- 172.21.15.107:0/2260514180 >> 172.21.15.107:0/2260514180 conn(0x7f42680b34f0 msgr2=0x7f42680b3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:25.937 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.942+0000 7f426d359640 1 -- 172.21.15.107:0/2260514180 shutdown_connections 2024-03-13T21:20:25.937 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.942+0000 7f426d359640 1 -- 172.21.15.107:0/2260514180 wait complete. 2024-03-13T21:20:25.940 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.943+0000 7f426d359640 1 Processor -- start 2024-03-13T21:20:25.940 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.943+0000 7f426d359640 1 -- start start 2024-03-13T21:20:25.940 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.944+0000 7f426d359640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4250004d40 0x7f42680b4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:25.940 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.944+0000 7f426d359640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f426814ff80 0x7f42680c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:25.940 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.944+0000 7f426d359640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4268159f90 0x7f426815a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:25.940 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.944+0000 7f426d359640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f42680b3200 con 0x7f4268159f90 2024-03-13T21:20:25.940 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.944+0000 7f426d359640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f42680b3080 con 0x7f426814ff80 2024-03-13T21:20:25.940 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.944+0000 7f426d359640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f42680cfa00 con 0x7f4250004d40 2024-03-13T21:20:25.940 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.944+0000 7f42677fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4268159f90 0x7f426815a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:25.940 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.944+0000 7f42677fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4268159f90 0x7f426815a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38402/0 (socket says 172.21.15.107:38402) 2024-03-13T21:20:25.940 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.944+0000 7f42677fe640 1 -- 172.21.15.107:0/4281401195 learned_addr learned my addr 172.21.15.107:0/4281401195 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-03-13T21:20:25.940 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.944+0000 7f42667fc640 1 --2- 172.21.15.107:0/4281401195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f426814ff80 0x7f42680c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:25.941 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.944+0000 7f4266ffd640 1 --2- 172.21.15.107:0/4281401195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4250004d40 0x7f42680b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:25.941 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.944+0000 7f42677fe640 1 -- 172.21.15.107:0/4281401195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4250004d40 msgr2=0x7f42680b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:25.941 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.944+0000 7f42677fe640 1 --2- 172.21.15.107:0/4281401195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4250004d40 0x7f42680b4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:25.941 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.944+0000 7f42677fe640 1 -- 172.21.15.107:0/4281401195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f426814ff80 msgr2=0x7f42680c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:25.941 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.944+0000 7f42677fe640 1 --2- 172.21.15.107:0/4281401195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f426814ff80 0x7f42680c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:25.941 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.944+0000 7f42677fe640 1 -- 172.21.15.107:0/4281401195 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42681503c0 con 0x7f4268159f90 2024-03-13T21:20:25.941 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.945+0000 7f42677fe640 1 --2- 172.21.15.107:0/4281401195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4268159f90 0x7f426815a410 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4260002230 tx=0x7f4260009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:25.941 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.945+0000 7f424f7fe640 1 -- 172.21.15.107:0/4281401195 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4260039030 con 0x7f4268159f90 2024-03-13T21:20:25.941 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.945+0000 7f424f7fe640 1 -- 172.21.15.107:0/4281401195 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4260043070 con 0x7f4268159f90 2024-03-13T21:20:25.941 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.945+0000 7f426d359640 1 -- 172.21.15.107:0/4281401195 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42680c74a0 con 0x7f4268159f90 2024-03-13T21:20:25.941 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.945+0000 7f424f7fe640 1 -- 172.21.15.107:0/4281401195 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4260009c10 con 0x7f4268159f90 2024-03-13T21:20:25.941 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.945+0000 7f426d359640 1 -- 172.21.15.107:0/4281401195 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42680b4c00 con 0x7f4268159f90 2024-03-13T21:20:25.941 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.946+0000 7f426d359640 1 -- 172.21.15.107:0/4281401195 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42681f1b70 con 0x7f4268159f90 2024-03-13T21:20:25.942 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.946+0000 7f424f7fe640 1 -- 172.21.15.107:0/4281401195 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f426003d7f0 con 0x7f4268159f90 2024-03-13T21:20:25.942 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.947+0000 7f424f7fe640 1 --2- 172.21.15.107:0/4281401195 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f425406bbd0 0x7f425406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:25.942 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.947+0000 7f424f7fe640 1 -- 172.21.15.107:0/4281401195 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f42600acc10 con 0x7f4268159f90 2024-03-13T21:20:25.942 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.947+0000 7f4266ffd640 1 --2- 172.21.15.107:0/4281401195 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f425406bbd0 0x7f425406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:25.942 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.947+0000 7f4266ffd640 1 --2- 172.21.15.107:0/4281401195 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f425406bbd0 0x7f425406e090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4258000c00 tx=0x7f4258001e40 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:25.942 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:25.951+0000 7f424f7fe640 1 -- 172.21.15.107:0/4281401195 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183657 (secure 0 0 0) 0x7f42681f1b70 con 0x7f4268159f90 2024-03-13T21:20:26.115 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:26.124+0000 7f426d359640 1 -- 172.21.15.107:0/4281401195 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4268068780 con 0x7f4268159f90 2024-03-13T21:20:26.116 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:26.125+0000 7f424f7fe640 1 -- 172.21.15.107:0/4281401195 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12920 (secure 0 0 0) 0x7f42600b0090 con 0x7f4268159f90 2024-03-13T21:20:26.116 INFO:teuthology.misc.health.smithi107.stdout: 2024-03-13T21:20:26.116 INFO:teuthology.misc.health.smithi107.stdout:{"epoch":17,"fsid":"2124cc6e-e803-48aa-9f5a-1b467da9f25e","created":"2024-03-13T21:20:08.464385+0000","modified":"2024-03-13T21:20:23.687266+0000","last_up_change":"2024-03-13T21:20:19.090808+0000","last_in_change":"2024-03-13T21:20:10.701372+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-13T21:20:20.705949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c2acc15b-5d55-4ce3-be7d-42c4498c7ade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":671021832},{"type":"v1","addr":"172.21.15.107:6809","nonce":671021832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":671021832},{"type":"v1","addr":"172.21.15.107:6811","nonce":671021832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":671021832},{"type":"v1","addr":"172.21.15.107:6817","nonce":671021832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":671021832},{"type":"v1","addr":"172.21.15.107:6813","nonce":671021832}]},"public_addr":"172.21.15.107:6809/671021832","cluster_addr":"172.21.15.107:6811/671021832","heartbeat_back_addr":"172.21.15.107:6817/671021832","heartbeat_front_addr":"172.21.15.107:6813/671021832","state":["exists","up"]},{"osd":1,"uuid":"6452e15a-de59-4bb8-b50b-ed0c73193d57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3112363424},{"type":"v1","addr":"172.21.15.107:6816","nonce":3112363424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3112363424},{"type":"v1","addr":"172.21.15.107:6819","nonce":3112363424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3112363424},{"type":"v1","addr":"172.21.15.107:6823","nonce":3112363424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3112363424},{"type":"v1","addr":"172.21.15.107:6821","nonce":3112363424}]},"public_addr":"172.21.15.107:6816/3112363424","cluster_addr":"172.21.15.107:6819/3112363424","heartbeat_back_addr":"172.21.15.107:6823/3112363424","heartbeat_front_addr":"172.21.15.107:6821/3112363424","state":["exists","up"]},{"osd":2,"uuid":"6ec15277-ca0f-47b0-a89f-2fa53a606ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":4245800458},{"type":"v1","addr":"172.21.15.107:6801","nonce":4245800458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":4245800458},{"type":"v1","addr":"172.21.15.107:6803","nonce":4245800458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":4245800458},{"type":"v1","addr":"172.21.15.107:6807","nonce":4245800458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":4245800458},{"type":"v1","addr":"172.21.15.107:6805","nonce":4245800458}]},"public_addr":"172.21.15.107:6801/4245800458","cluster_addr":"172.21.15.107:6803/4245800458","heartbeat_back_addr":"172.21.15.107:6807/4245800458","heartbeat_front_addr":"172.21.15.107:6805/4245800458","state":["exists","up"]},{"osd":3,"uuid":"de114af6-e8ee-4d26-92d8-e0b0683fe282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1397993525},{"type":"v1","addr":"172.21.15.107:6825","nonce":1397993525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1397993525},{"type":"v1","addr":"172.21.15.107:6827","nonce":1397993525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1397993525},{"type":"v1","addr":"172.21.15.107:6831","nonce":1397993525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1397993525},{"type":"v1","addr":"172.21.15.107:6829","nonce":1397993525}]},"public_addr":"172.21.15.107:6825/1397993525","cluster_addr":"172.21.15.107:6827/1397993525","heartbeat_back_addr":"172.21.15.107:6831/1397993525","heartbeat_front_addr":"172.21.15.107:6829/1397993525","state":["exists","up"]},{"osd":4,"uuid":"78d43c86-5c73-4e6d-9a51-d8022f68f36a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":531258567},{"type":"v1","addr":"172.21.15.195:6801","nonce":531258567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":531258567},{"type":"v1","addr":"172.21.15.195:6803","nonce":531258567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":531258567},{"type":"v1","addr":"172.21.15.195:6807","nonce":531258567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":531258567},{"type":"v1","addr":"172.21.15.195:6805","nonce":531258567}]},"public_addr":"172.21.15.195:6801/531258567","cluster_addr":"172.21.15.195:6803/531258567","heartbeat_back_addr":"172.21.15.195:6807/531258567","heartbeat_front_addr":"172.21.15.195:6805/531258567","state":["exists","up"]},{"osd":5,"uuid":"ef9caa1c-ef75-4307-8b5d-171bd2eb37b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1177215231},{"type":"v1","addr":"172.21.15.195:6809","nonce":1177215231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1177215231},{"type":"v1","addr":"172.21.15.195:6811","nonce":1177215231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1177215231},{"type":"v1","addr":"172.21.15.195:6815","nonce":1177215231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1177215231},{"type":"v1","addr":"172.21.15.195:6813","nonce":1177215231}]},"public_addr":"172.21.15.195:6809/1177215231","cluster_addr":"172.21.15.195:6811/1177215231","heartbeat_back_addr":"172.21.15.195:6815/1177215231","heartbeat_front_addr":"172.21.15.195:6813/1177215231","state":["exists","up"]},{"osd":6,"uuid":"0f07cccd-e497-44fa-afae-e81242b8ece2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":3656715468},{"type":"v1","addr":"172.21.15.195:6817","nonce":3656715468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":3656715468},{"type":"v1","addr":"172.21.15.195:6819","nonce":3656715468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":3656715468},{"type":"v1","addr":"172.21.15.195:6823","nonce":3656715468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":3656715468},{"type":"v1","addr":"172.21.15.195:6821","nonce":3656715468}]},"public_addr":"172.21.15.195:6817/3656715468","cluster_addr":"172.21.15.195:6819/3656715468","heartbeat_back_addr":"172.21.15.195:6823/3656715468","heartbeat_front_addr":"172.21.15.195:6821/3656715468","state":["exists","up"]},{"osd":7,"uuid":"df5edf8d-3d1b-486f-a640-e01e2f1d1f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2200630994},{"type":"v1","addr":"172.21.15.195:6825","nonce":2200630994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2200630994},{"type":"v1","addr":"172.21.15.195:6827","nonce":2200630994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2200630994},{"type":"v1","addr":"172.21.15.195:6831","nonce":2200630994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2200630994},{"type":"v1","addr":"172.21.15.195:6829","nonce":2200630994}]},"public_addr":"172.21.15.195:6825/2200630994","cluster_addr":"172.21.15.195:6827/2200630994","heartbeat_back_addr":"172.21.15.195:6831/2200630994","heartbeat_front_addr":"172.21.15.195:6829/2200630994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.890430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.935903+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.815338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.934666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.803329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.772128+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.837195+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.823592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-13T21:20:26.118 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:26.127+0000 7f426d359640 1 -- 172.21.15.107:0/4281401195 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f425406bbd0 msgr2=0x7f425406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:26.118 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:26.127+0000 7f426d359640 1 --2- 172.21.15.107:0/4281401195 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f425406bbd0 0x7f425406e090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4258000c00 tx=0x7f4258001e40 comp rx=0 tx=0).stop 2024-03-13T21:20:26.118 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:26.127+0000 7f426d359640 1 -- 172.21.15.107:0/4281401195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4268159f90 msgr2=0x7f426815a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:26.118 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:26.127+0000 7f426d359640 1 --2- 172.21.15.107:0/4281401195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4268159f90 0x7f426815a410 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4260002230 tx=0x7f4260009750 comp rx=0 tx=0).stop 2024-03-13T21:20:26.119 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:26.127+0000 7f426d359640 1 -- 172.21.15.107:0/4281401195 shutdown_connections 2024-03-13T21:20:26.119 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:26.127+0000 7f426d359640 1 --2- 172.21.15.107:0/4281401195 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f425406bbd0 0x7f425406e090 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.119 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:26.127+0000 7f426d359640 1 --2- 172.21.15.107:0/4281401195 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f4268159f90 0x7f426815a410 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.119 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:26.127+0000 7f426d359640 1 --2- 172.21.15.107:0/4281401195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f426814ff80 0x7f42680c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.119 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:26.127+0000 7f426d359640 1 --2- 172.21.15.107:0/4281401195 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f4250004d40 0x7f42680b4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.119 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:26.127+0000 7f426d359640 1 -- 172.21.15.107:0/4281401195 >> 172.21.15.107:0/4281401195 conn(0x7f42680b34f0 msgr2=0x7f4268070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:26.119 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:26.127+0000 7f426d359640 1 -- 172.21.15.107:0/4281401195 shutdown_connections 2024-03-13T21:20:26.119 INFO:teuthology.misc.health.smithi107.stderr:2024-03-13T21:20:26.127+0000 7f426d359640 1 -- 172.21.15.107:0/4281401195 wait complete. 2024-03-13T21:20:26.128 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-13T21:20:26.128 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-13T21:20:26.128 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-13T21:20:26.129 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-13T21:20:26.131 INFO:tasks.ceph.mds.a:Started 2024-03-13T21:20:26.131 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-13T21:20:26.131 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-13T21:20:26.133 INFO:tasks.ceph.mds.c:Started 2024-03-13T21:20:26.133 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-13T21:20:26.133 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-13T21:20:26.136 INFO:tasks.ceph.mds.b:Started 2024-03-13T21:20:26.137 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-13T21:20:26.137 DEBUG:teuthology.orchestra.run.smithi195:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-13T21:20:26.139 INFO:tasks.ceph.mds.d:Started 2024-03-13T21:20:26.139 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-13T21:20:26.142 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-13T21:20:26.206 INFO:tasks.ceph.mds.a.smithi107.stdout:starting mds.a at 2024-03-13T21:20:26.207 INFO:tasks.ceph.mds.c.smithi107.stdout:starting mds.c at 2024-03-13T21:20:26.222 INFO:tasks.ceph.mds.d.smithi195.stdout:starting mds.d at 2024-03-13T21:20:26.222 INFO:tasks.ceph.mds.b.smithi195.stdout:starting mds.b at 2024-03-13T21:20:26.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.254+0000 7fbbc480b640 1 Processor -- start 2024-03-13T21:20:26.246 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.254+0000 7fbbc480b640 1 -- start start 2024-03-13T21:20:26.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.255+0000 7fbbc480b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbbc015bb00 0x7fbbc0072010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.255+0000 7fbbc480b640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7fbbc015bee0 0x7fbbc00cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.255+0000 7fbbc480b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc00ce7e0 0x7fbbc00cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.255+0000 7fbbc480b640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7fbbc00cf940 con 0x7fbbc015bb00 2024-03-13T21:20:26.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.255+0000 7fbbc480b640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7fbbc0072550 con 0x7fbbc015bee0 2024-03-13T21:20:26.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.255+0000 7fbbc480b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc00ced30 con 0x7fbbc00ce7e0 2024-03-13T21:20:26.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.255+0000 7fbbbe59c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbbc015bb00 0x7fbbc0072010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:26.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.255+0000 7fbbbe59c640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7fbbc015bb00 0x7fbbc0072010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38452/0 (socket says 172.21.15.107:38452) 2024-03-13T21:20:26.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.255+0000 7fbbbe59c640 1 -- 172.21.15.107:0/1205125854 learned_addr learned my addr 172.21.15.107:0/1205125854 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-03-13T21:20:26.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.256+0000 7fbbb7fff640 1 --2- 172.21.15.107:0/1205125854 >> v2:172.21.15.195:3300/0 conn(0x7fbbc015bee0 0x7fbbc00cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:26.248 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.256+0000 7fbbbed9d640 1 --2- 172.21.15.107:0/1205125854 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc00ce7e0 0x7fbbc00cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:26.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.256+0000 7fbbbe59c640 1 -- 172.21.15.107:0/1205125854 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc00ce7e0 msgr2=0x7fbbc00cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:26.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.256+0000 7fbbbe59c640 1 --2- 172.21.15.107:0/1205125854 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc00ce7e0 0x7fbbc00cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.256+0000 7fbbbe59c640 1 -- 172.21.15.107:0/1205125854 >> v2:172.21.15.195:3300/0 conn(0x7fbbc015bee0 msgr2=0x7fbbc00cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:26.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.256+0000 7fbbbe59c640 1 --2- 172.21.15.107:0/1205125854 >> v2:172.21.15.195:3300/0 conn(0x7fbbc015bee0 0x7fbbc00cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.256+0000 7fbbbe59c640 1 -- 172.21.15.107:0/1205125854 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc00cf010 con 0x7fbbc015bb00 2024-03-13T21:20:26.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.256+0000 7fbbbe59c640 1 --2- 172.21.15.107:0/1205125854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbc015bb00 0x7fbbc0072010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00ccb60 tx=0x7fbbb002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15f739ad5bfaccd6 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:26.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.257+0000 7fbbbdd9b640 1 -- 172.21.15.107:0/1205125854 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0035020 con 0x7fbbc015bb00 2024-03-13T21:20:26.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.257+0000 7fbbbdd9b640 1 -- 172.21.15.107:0/1205125854 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb0031870 con 0x7fbbc015bb00 2024-03-13T21:20:26.249 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.257+0000 7fbbbdd9b640 1 -- 172.21.15.107:0/1205125854 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0031c40 con 0x7fbbc015bb00 2024-03-13T21:20:26.252 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.257+0000 7fbbc480b640 1 -- 172.21.15.107:0/1205125854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbc015bb00 msgr2=0x7fbbc0072010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:26.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.257+0000 7fbbc480b640 1 --2- 172.21.15.107:0/1205125854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbc015bb00 0x7fbbc0072010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00ccb60 tx=0x7fbbb002b910 comp rx=0 tx=0).stop 2024-03-13T21:20:26.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.257+0000 7fbbc480b640 1 -- 172.21.15.107:0/1205125854 shutdown_connections 2024-03-13T21:20:26.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.257+0000 7fbbc480b640 1 --2- 172.21.15.107:0/1205125854 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc00ce7e0 0x7fbbc00cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.257+0000 7fbbc480b640 1 --2- 172.21.15.107:0/1205125854 >> v2:172.21.15.195:3300/0 conn(0x7fbbc015bee0 0x7fbbc00cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.257+0000 7fbbc480b640 1 --2- 172.21.15.107:0/1205125854 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbc015bb00 0x7fbbc0072010 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.257+0000 7fbbc480b640 1 -- 172.21.15.107:0/1205125854 >> 172.21.15.107:0/1205125854 conn(0x7fbbc00b25f0 msgr2=0x7fbbc00b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:26.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.257+0000 7fbbc480b640 1 -- 172.21.15.107:0/1205125854 shutdown_connections 2024-03-13T21:20:26.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.257+0000 7fbbc480b640 1 -- 172.21.15.107:0/1205125854 wait complete. 2024-03-13T21:20:26.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.259+0000 7fbbc480b640 1 Processor -- start 2024-03-13T21:20:26.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.259+0000 7fbbc480b640 1 -- start start 2024-03-13T21:20:26.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.259+0000 7fbbc480b640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbc00ce7e0 0x7fbbc013bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.259+0000 7fbbc480b640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc015bb00 0x7fbbc0153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.259+0000 7fbbc480b640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc015bee0 0x7fbbc0159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.253 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.259+0000 7fbbc480b640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc015f8c0 con 0x7fbbc00ce7e0 2024-03-13T21:20:26.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.259+0000 7fbbc480b640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc00cf5d0 con 0x7fbbc015bee0 2024-03-13T21:20:26.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.259+0000 7fbbc480b640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7fbbc015fa40 con 0x7fbbc015bb00 2024-03-13T21:20:26.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.259+0000 7fbbbe59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbc00ce7e0 0x7fbbc013bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:26.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.259+0000 7fbbbe59c640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbc00ce7e0 0x7fbbc013bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38454/0 (socket says 172.21.15.107:38454) 2024-03-13T21:20:26.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.259+0000 7fbbbe59c640 1 -- 172.21.15.107:0/1096977302 learned_addr learned my addr 172.21.15.107:0/1096977302 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-03-13T21:20:26.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.259+0000 7fbbbed9d640 1 --2- 172.21.15.107:0/1096977302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc015bee0 0x7fbbc0159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:26.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.259+0000 7fbbb7fff640 1 --2- 172.21.15.107:0/1096977302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc015bb00 0x7fbbc0153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:26.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.260+0000 7fbbbe59c640 1 -- 172.21.15.107:0/1096977302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc015bb00 msgr2=0x7fbbc0153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:26.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.260+0000 7fbbbe59c640 1 --2- 172.21.15.107:0/1096977302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc015bb00 0x7fbbc0153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.260+0000 7fbbbe59c640 1 -- 172.21.15.107:0/1096977302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc015bee0 msgr2=0x7fbbc0159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:26.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.260+0000 7fbbbe59c640 1 --2- 172.21.15.107:0/1096977302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc015bee0 0x7fbbc0159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.260+0000 7fbbbe59c640 1 -- 172.21.15.107:0/1096977302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc0156770 con 0x7fbbc00ce7e0 2024-03-13T21:20:26.254 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.260+0000 7fbbbe59c640 1 --2- 172.21.15.107:0/1096977302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbc00ce7e0 0x7fbbc013bc40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0000c00 tx=0x7fbbb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:26.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.260+0000 7fbbb6ffd640 1 -- 172.21.15.107:0/1096977302 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0035040 con 0x7fbbc00ce7e0 2024-03-13T21:20:26.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.260+0000 7fbbb6ffd640 1 -- 172.21.15.107:0/1096977302 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbb0030d00 con 0x7fbbc00ce7e0 2024-03-13T21:20:26.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.260+0000 7fbbc480b640 1 -- 172.21.15.107:0/1096977302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc0156a50 con 0x7fbbc00ce7e0 2024-03-13T21:20:26.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.260+0000 7fbbb6ffd640 1 -- 172.21.15.107:0/1096977302 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb00456a0 con 0x7fbbc00ce7e0 2024-03-13T21:20:26.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.260+0000 7fbbc480b640 1 -- 172.21.15.107:0/1096977302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc0157010 con 0x7fbbc00ce7e0 2024-03-13T21:20:26.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.261+0000 7fbbc480b640 1 -- 172.21.15.107:0/1096977302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc0075120 con 0x7fbbc00ce7e0 2024-03-13T21:20:26.255 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.261+0000 7fbbb6ffd640 1 -- 172.21.15.107:0/1096977302 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fbbb0038020 con 0x7fbbc00ce7e0 2024-03-13T21:20:26.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.262+0000 7fbbb6ffd640 1 --2- 172.21.15.107:0/1096977302 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7fbba006bbd0 0x7fbba006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.256 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.262+0000 7fbbb6ffd640 1 -- 172.21.15.107:0/1096977302 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fbbb00ac990 con 0x7fbbc00ce7e0 2024-03-13T21:20:26.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.262+0000 7fbbb7fff640 1 --2- 172.21.15.107:0/1096977302 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7fbba006bbd0 0x7fbba006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:26.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.262+0000 7fbbb7fff640 1 --2- 172.21.15.107:0/1096977302 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7fbba006bbd0 0x7fbba006e090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00b38d0 tx=0x7fbba8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:26.257 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.266+0000 7fbbb6ffd640 1 -- 172.21.15.107:0/1096977302 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183657 (secure 0 0 0) 0x7fbbb007b100 con 0x7fbbc00ce7e0 2024-03-13T21:20:26.430 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.438+0000 7fbbc480b640 1 -- 172.21.15.107:0/1096977302 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbc006cc40 con 0x7fbbc00ce7e0 2024-03-13T21:20:26.431 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.439+0000 7fbbb6ffd640 1 -- 172.21.15.107:0/1096977302 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12920 (secure 0 0 0) 0x7fbbb007f1a0 con 0x7fbbc00ce7e0 2024-03-13T21:20:26.431 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:20:26.431 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":17,"fsid":"2124cc6e-e803-48aa-9f5a-1b467da9f25e","created":"2024-03-13T21:20:08.464385+0000","modified":"2024-03-13T21:20:23.687266+0000","last_up_change":"2024-03-13T21:20:19.090808+0000","last_in_change":"2024-03-13T21:20:10.701372+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-13T21:20:20.705949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c2acc15b-5d55-4ce3-be7d-42c4498c7ade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":671021832},{"type":"v1","addr":"172.21.15.107:6809","nonce":671021832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":671021832},{"type":"v1","addr":"172.21.15.107:6811","nonce":671021832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":671021832},{"type":"v1","addr":"172.21.15.107:6817","nonce":671021832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":671021832},{"type":"v1","addr":"172.21.15.107:6813","nonce":671021832}]},"public_addr":"172.21.15.107:6809/671021832","cluster_addr":"172.21.15.107:6811/671021832","heartbeat_back_addr":"172.21.15.107:6817/671021832","heartbeat_front_addr":"172.21.15.107:6813/671021832","state":["exists","up"]},{"osd":1,"uuid":"6452e15a-de59-4bb8-b50b-ed0c73193d57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3112363424},{"type":"v1","addr":"172.21.15.107:6816","nonce":3112363424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3112363424},{"type":"v1","addr":"172.21.15.107:6819","nonce":3112363424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3112363424},{"type":"v1","addr":"172.21.15.107:6823","nonce":3112363424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3112363424},{"type":"v1","addr":"172.21.15.107:6821","nonce":3112363424}]},"public_addr":"172.21.15.107:6816/3112363424","cluster_addr":"172.21.15.107:6819/3112363424","heartbeat_back_addr":"172.21.15.107:6823/3112363424","heartbeat_front_addr":"172.21.15.107:6821/3112363424","state":["exists","up"]},{"osd":2,"uuid":"6ec15277-ca0f-47b0-a89f-2fa53a606ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":4245800458},{"type":"v1","addr":"172.21.15.107:6801","nonce":4245800458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":4245800458},{"type":"v1","addr":"172.21.15.107:6803","nonce":4245800458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":4245800458},{"type":"v1","addr":"172.21.15.107:6807","nonce":4245800458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":4245800458},{"type":"v1","addr":"172.21.15.107:6805","nonce":4245800458}]},"public_addr":"172.21.15.107:6801/4245800458","cluster_addr":"172.21.15.107:6803/4245800458","heartbeat_back_addr":"172.21.15.107:6807/4245800458","heartbeat_front_addr":"172.21.15.107:6805/4245800458","state":["exists","up"]},{"osd":3,"uuid":"de114af6-e8ee-4d26-92d8-e0b0683fe282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1397993525},{"type":"v1","addr":"172.21.15.107:6825","nonce":1397993525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1397993525},{"type":"v1","addr":"172.21.15.107:6827","nonce":1397993525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1397993525},{"type":"v1","addr":"172.21.15.107:6831","nonce":1397993525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1397993525},{"type":"v1","addr":"172.21.15.107:6829","nonce":1397993525}]},"public_addr":"172.21.15.107:6825/1397993525","cluster_addr":"172.21.15.107:6827/1397993525","heartbeat_back_addr":"172.21.15.107:6831/1397993525","heartbeat_front_addr":"172.21.15.107:6829/1397993525","state":["exists","up"]},{"osd":4,"uuid":"78d43c86-5c73-4e6d-9a51-d8022f68f36a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":531258567},{"type":"v1","addr":"172.21.15.195:6801","nonce":531258567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":531258567},{"type":"v1","addr":"172.21.15.195:6803","nonce":531258567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":531258567},{"type":"v1","addr":"172.21.15.195:6807","nonce":531258567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":531258567},{"type":"v1","addr":"172.21.15.195:6805","nonce":531258567}]},"public_addr":"172.21.15.195:6801/531258567","cluster_addr":"172.21.15.195:6803/531258567","heartbeat_back_addr":"172.21.15.195:6807/531258567","heartbeat_front_addr":"172.21.15.195:6805/531258567","state":["exists","up"]},{"osd":5,"uuid":"ef9caa1c-ef75-4307-8b5d-171bd2eb37b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1177215231},{"type":"v1","addr":"172.21.15.195:6809","nonce":1177215231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1177215231},{"type":"v1","addr":"172.21.15.195:6811","nonce":1177215231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1177215231},{"type":"v1","addr":"172.21.15.195:6815","nonce":1177215231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1177215231},{"type":"v1","addr":"172.21.15.195:6813","nonce":1177215231}]},"public_addr":"172.21.15.195:6809/1177215231","cluster_addr":"172.21.15.195:6811/1177215231","heartbeat_back_addr":"172.21.15.195:6815/1177215231","heartbeat_front_addr":"172.21.15.195:6813/1177215231","state":["exists","up"]},{"osd":6,"uuid":"0f07cccd-e497-44fa-afae-e81242b8ece2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":3656715468},{"type":"v1","addr":"172.21.15.195:6817","nonce":3656715468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":3656715468},{"type":"v1","addr":"172.21.15.195:6819","nonce":3656715468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":3656715468},{"type":"v1","addr":"172.21.15.195:6823","nonce":3656715468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":3656715468},{"type":"v1","addr":"172.21.15.195:6821","nonce":3656715468}]},"public_addr":"172.21.15.195:6817/3656715468","cluster_addr":"172.21.15.195:6819/3656715468","heartbeat_back_addr":"172.21.15.195:6823/3656715468","heartbeat_front_addr":"172.21.15.195:6821/3656715468","state":["exists","up"]},{"osd":7,"uuid":"df5edf8d-3d1b-486f-a640-e01e2f1d1f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2200630994},{"type":"v1","addr":"172.21.15.195:6825","nonce":2200630994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2200630994},{"type":"v1","addr":"172.21.15.195:6827","nonce":2200630994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2200630994},{"type":"v1","addr":"172.21.15.195:6831","nonce":2200630994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2200630994},{"type":"v1","addr":"172.21.15.195:6829","nonce":2200630994}]},"public_addr":"172.21.15.195:6825/2200630994","cluster_addr":"172.21.15.195:6827/2200630994","heartbeat_back_addr":"172.21.15.195:6831/2200630994","heartbeat_front_addr":"172.21.15.195:6829/2200630994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.890430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.935903+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.815338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.934666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.803329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.772128+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.837195+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.823592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-13T21:20:26.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.441+0000 7fbbc480b640 1 -- 172.21.15.107:0/1096977302 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7fbba006bbd0 msgr2=0x7fbba006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:26.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.441+0000 7fbbc480b640 1 --2- 172.21.15.107:0/1096977302 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7fbba006bbd0 0x7fbba006e090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00b38d0 tx=0x7fbba8009190 comp rx=0 tx=0).stop 2024-03-13T21:20:26.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.441+0000 7fbbc480b640 1 -- 172.21.15.107:0/1096977302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbc00ce7e0 msgr2=0x7fbbc013bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:26.433 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.441+0000 7fbbc480b640 1 --2- 172.21.15.107:0/1096977302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbc00ce7e0 0x7fbbc013bc40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0000c00 tx=0x7fbbb00046c0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.442+0000 7fbbc480b640 1 -- 172.21.15.107:0/1096977302 shutdown_connections 2024-03-13T21:20:26.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.442+0000 7fbbc480b640 1 --2- 172.21.15.107:0/1096977302 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7fbba006bbd0 0x7fbba006e090 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.442+0000 7fbbc480b640 1 --2- 172.21.15.107:0/1096977302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbc015bee0 0x7fbbc0159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.442+0000 7fbbc480b640 1 --2- 172.21.15.107:0/1096977302 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7fbbc015bb00 0x7fbbc0153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.442+0000 7fbbc480b640 1 --2- 172.21.15.107:0/1096977302 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7fbbc00ce7e0 0x7fbbc013bc40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.442+0000 7fbbc480b640 1 -- 172.21.15.107:0/1096977302 >> 172.21.15.107:0/1096977302 conn(0x7fbbc00b25f0 msgr2=0x7fbbc00b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:26.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.442+0000 7fbbc480b640 1 -- 172.21.15.107:0/1096977302 shutdown_connections 2024-03-13T21:20:26.434 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.442+0000 7fbbc480b640 1 -- 172.21.15.107:0/1096977302 wait complete. 2024-03-13T21:20:26.444 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-13T21:20:20.705949+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-13T21:20:26.444 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-13T21:20:26.546 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.555+0000 7f10eaabf640 1 Processor -- start 2024-03-13T21:20:26.547 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.555+0000 7f10eaabf640 1 -- start start 2024-03-13T21:20:26.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.556+0000 7f10eaabf640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f10e4161630 0x7f10e40b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.549 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.556+0000 7f10eaabf640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f10e40b34f0 0x7f10e40b3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.556+0000 7f10eaabf640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e40b0810 0x7f10e40b0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.556+0000 7f10eaabf640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f10e40b3e90 con 0x7f10e4161630 2024-03-13T21:20:26.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.556+0000 7f10eaabf640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f10e4161a10 con 0x7f10e40b34f0 2024-03-13T21:20:26.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.556+0000 7f10eaabf640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f10e40ce5a0 con 0x7f10e40b0810 2024-03-13T21:20:26.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.556+0000 7f10e885b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f10e4161630 0x7f10e40b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:26.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.556+0000 7f10e885b640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f10e4161630 0x7f10e40b2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38460/0 (socket says 172.21.15.107:38460) 2024-03-13T21:20:26.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.556+0000 7f10e885b640 1 -- 172.21.15.107:0/4089236853 learned_addr learned my addr 172.21.15.107:0/4089236853 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-03-13T21:20:26.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.556+0000 7f10e3fff640 1 --2- 172.21.15.107:0/4089236853 >> v2:172.21.15.195:3300/0 conn(0x7f10e40b34f0 0x7f10e40b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:26.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.556+0000 7f10e905c640 1 --2- 172.21.15.107:0/4089236853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e40b0810 0x7f10e40b0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:26.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.556+0000 7f10e885b640 1 -- 172.21.15.107:0/4089236853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e40b0810 msgr2=0x7f10e40b0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:26.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.556+0000 7f10e885b640 1 --2- 172.21.15.107:0/4089236853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e40b0810 0x7f10e40b0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.556+0000 7f10e885b640 1 -- 172.21.15.107:0/4089236853 >> v2:172.21.15.195:3300/0 conn(0x7f10e40b34f0 msgr2=0x7f10e40b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:26.550 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.556+0000 7f10e885b640 1 --2- 172.21.15.107:0/4089236853 >> v2:172.21.15.195:3300/0 conn(0x7f10e40b34f0 0x7f10e40b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.556+0000 7f10e885b640 1 -- 172.21.15.107:0/4089236853 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e40d4a30 con 0x7f10e4161630 2024-03-13T21:20:26.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.556+0000 7f10e3fff640 1 --2- 172.21.15.107:0/4089236853 >> v2:172.21.15.195:3300/0 conn(0x7f10e40b34f0 0x7f10e40b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-13T21:20:26.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.557+0000 7f10e885b640 1 --2- 172.21.15.107:0/4089236853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10e4161630 0x7f10e40b2200 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f10e408ca90 tx=0x7f10d802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ed0021339439d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:26.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.557+0000 7f10e37fe640 1 -- 172.21.15.107:0/4089236853 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8035020 con 0x7f10e4161630 2024-03-13T21:20:26.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.557+0000 7f10e37fe640 1 -- 172.21.15.107:0/4089236853 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d8031870 con 0x7f10e4161630 2024-03-13T21:20:26.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.557+0000 7f10e37fe640 1 -- 172.21.15.107:0/4089236853 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8031c40 con 0x7f10e4161630 2024-03-13T21:20:26.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.558+0000 7f10eaabf640 1 -- 172.21.15.107:0/4089236853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10e4161630 msgr2=0x7f10e40b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:26.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.558+0000 7f10eaabf640 1 --2- 172.21.15.107:0/4089236853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10e4161630 0x7f10e40b2200 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f10e408ca90 tx=0x7f10d802b910 comp rx=0 tx=0).stop 2024-03-13T21:20:26.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.558+0000 7f10eaabf640 1 -- 172.21.15.107:0/4089236853 shutdown_connections 2024-03-13T21:20:26.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.558+0000 7f10eaabf640 1 --2- 172.21.15.107:0/4089236853 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e40b0810 0x7f10e40b0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.558+0000 7f10eaabf640 1 --2- 172.21.15.107:0/4089236853 >> v2:172.21.15.195:3300/0 conn(0x7f10e40b34f0 0x7f10e40b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.558+0000 7f10eaabf640 1 --2- 172.21.15.107:0/4089236853 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10e4161630 0x7f10e40b2200 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.558+0000 7f10eaabf640 1 -- 172.21.15.107:0/4089236853 >> 172.21.15.107:0/4089236853 conn(0x7f10e40d3be0 msgr2=0x7f10e40d3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:26.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.558+0000 7f10eaabf640 1 -- 172.21.15.107:0/4089236853 shutdown_connections 2024-03-13T21:20:26.551 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.558+0000 7f10eaabf640 1 -- 172.21.15.107:0/4089236853 wait complete. 2024-03-13T21:20:26.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.559+0000 7f10eaabf640 1 Processor -- start 2024-03-13T21:20:26.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.559+0000 7f10eaabf640 1 -- start start 2024-03-13T21:20:26.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10eaabf640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e40b0810 0x7f10e40c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.554 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10eaabf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10e40b34f0 0x7f10e40cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10eaabf640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10e4161630 0x7f10e40b8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10eaabf640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f10e40d2260 con 0x7f10e40b34f0 2024-03-13T21:20:26.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10eaabf640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f10e40b2e30 con 0x7f10e4161630 2024-03-13T21:20:26.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10eaabf640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f10e40d2540 con 0x7f10e40b0810 2024-03-13T21:20:26.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10e3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10e40b34f0 0x7f10e40cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:26.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10e3fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10e40b34f0 0x7f10e40cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38462/0 (socket says 172.21.15.107:38462) 2024-03-13T21:20:26.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10e3fff640 1 -- 172.21.15.107:0/712230320 learned_addr learned my addr 172.21.15.107:0/712230320 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-03-13T21:20:26.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10e905c640 1 --2- 172.21.15.107:0/712230320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10e4161630 0x7f10e40b8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:26.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10e885b640 1 --2- 172.21.15.107:0/712230320 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e40b0810 0x7f10e40c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:26.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10e3fff640 1 -- 172.21.15.107:0/712230320 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e40b0810 msgr2=0x7f10e40c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:26.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10e3fff640 1 --2- 172.21.15.107:0/712230320 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e40b0810 0x7f10e40c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.555 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10e3fff640 1 -- 172.21.15.107:0/712230320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10e4161630 msgr2=0x7f10e40b8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:26.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10e3fff640 1 --2- 172.21.15.107:0/712230320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10e4161630 0x7f10e40b8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10e3fff640 1 -- 172.21.15.107:0/712230320 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e414df40 con 0x7f10e40b34f0 2024-03-13T21:20:26.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10e905c640 1 --2- 172.21.15.107:0/712230320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10e4161630 0x7f10e40b8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-13T21:20:26.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10e3fff640 1 --2- 172.21.15.107:0/712230320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10e40b34f0 0x7f10e40cbea0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f10d000e7e0 tx=0x7f10d000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:26.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10e17fa640 1 -- 172.21.15.107:0/712230320 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d000f040 con 0x7f10e40b34f0 2024-03-13T21:20:26.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10e17fa640 1 -- 172.21.15.107:0/712230320 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d0004030 con 0x7f10e40b34f0 2024-03-13T21:20:26.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10e17fa640 1 -- 172.21.15.107:0/712230320 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d0004400 con 0x7f10e40b34f0 2024-03-13T21:20:26.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10eaabf640 1 -- 172.21.15.107:0/712230320 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e414e220 con 0x7f10e40b34f0 2024-03-13T21:20:26.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.560+0000 7f10eaabf640 1 -- 172.21.15.107:0/712230320 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e414e7e0 con 0x7f10e40b34f0 2024-03-13T21:20:26.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.561+0000 7f10eaabf640 1 -- 172.21.15.107:0/712230320 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e4075120 con 0x7f10e40b34f0 2024-03-13T21:20:26.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.562+0000 7f10e17fa640 1 -- 172.21.15.107:0/712230320 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f10d000c6d0 con 0x7f10e40b34f0 2024-03-13T21:20:26.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.562+0000 7f10e17fa640 1 --2- 172.21.15.107:0/712230320 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f10c806bbd0 0x7f10c806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.562+0000 7f10e17fa640 1 -- 172.21.15.107:0/712230320 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f10d008a4b0 con 0x7f10e40b34f0 2024-03-13T21:20:26.556 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.562+0000 7f10e885b640 1 --2- 172.21.15.107:0/712230320 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f10c806bbd0 0x7f10c806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:26.557 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.563+0000 7f10e885b640 1 --2- 172.21.15.107:0/712230320 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f10c806bbd0 0x7f10c806e090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f10d8036000 tx=0x7f10d803c040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:26.558 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.566+0000 7f10e17fa640 1 -- 172.21.15.107:0/712230320 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183657 (secure 0 0 0) 0x7f10d0017020 con 0x7f10e40b34f0 2024-03-13T21:20:26.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.740+0000 7f10eaabf640 1 -- 172.21.15.107:0/712230320 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f10e4074600 con 0x7f10e40b34f0 2024-03-13T21:20:26.732 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.740+0000 7f10e17fa640 1 -- 172.21.15.107:0/712230320 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f10d0058ca0 con 0x7f10e40b34f0 2024-03-13T21:20:26.732 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-03-13T21:20:26.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.743+0000 7f10eaabf640 1 -- 172.21.15.107:0/712230320 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f10c806bbd0 msgr2=0x7f10c806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:26.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.743+0000 7f10eaabf640 1 --2- 172.21.15.107:0/712230320 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f10c806bbd0 0x7f10c806e090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f10d8036000 tx=0x7f10d803c040 comp rx=0 tx=0).stop 2024-03-13T21:20:26.734 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.743+0000 7f10eaabf640 1 -- 172.21.15.107:0/712230320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10e40b34f0 msgr2=0x7f10e40cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:26.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.743+0000 7f10eaabf640 1 --2- 172.21.15.107:0/712230320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10e40b34f0 0x7f10e40cbea0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f10d000e7e0 tx=0x7f10d000eca0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.743+0000 7f10eaabf640 1 -- 172.21.15.107:0/712230320 shutdown_connections 2024-03-13T21:20:26.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.743+0000 7f10eaabf640 1 --2- 172.21.15.107:0/712230320 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f10c806bbd0 0x7f10c806e090 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.743+0000 7f10eaabf640 1 --2- 172.21.15.107:0/712230320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10e4161630 0x7f10e40b8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.743+0000 7f10eaabf640 1 --2- 172.21.15.107:0/712230320 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f10e40b34f0 0x7f10e40cbea0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.743+0000 7f10eaabf640 1 --2- 172.21.15.107:0/712230320 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f10e40b0810 0x7f10e40c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.743+0000 7f10eaabf640 1 -- 172.21.15.107:0/712230320 >> 172.21.15.107:0/712230320 conn(0x7f10e40d3be0 msgr2=0x7f10e406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:26.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.743+0000 7f10eaabf640 1 -- 172.21.15.107:0/712230320 shutdown_connections 2024-03-13T21:20:26.735 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.743+0000 7f10eaabf640 1 -- 172.21.15.107:0/712230320 wait complete. 2024-03-13T21:20:26.745 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-13T21:20:26.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.853+0000 7f7f6d459640 1 Processor -- start 2024-03-13T21:20:26.845 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.853+0000 7f7f6d459640 1 -- start start 2024-03-13T21:20:26.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.854+0000 7f7f6d459640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f7f680d21b0 0x7f7f680d2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.854+0000 7f7f6d459640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7f680cf3a0 0x7f7f680d0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.854+0000 7f7f6d459640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f680d2ad0 con 0x7f7f680cf830 2024-03-13T21:20:26.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.854+0000 7f7f6d459640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f7f680b33a0 con 0x7f7f680cf3a0 2024-03-13T21:20:26.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.854+0000 7f7f6d459640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f7f680b3680 con 0x7f7f680d21b0 2024-03-13T21:20:26.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.854+0000 7f7f667fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7f680cf3a0 0x7f7f680d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:26.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.854+0000 7f7f677fe640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f7f680cf830 0x7f7f680d07d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:45946/0 (socket says 172.21.15.107:45946) 2024-03-13T21:20:26.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.854+0000 7f7f667fc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f7f680cf3a0 0x7f7f680d0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38476/0 (socket says 172.21.15.107:38476) 2024-03-13T21:20:26.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.854+0000 7f7f677fe640 1 -- 172.21.15.107:0/3030026036 learned_addr learned my addr 172.21.15.107:0/3030026036 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-03-13T21:20:26.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.854+0000 7f7f667fc640 1 -- 172.21.15.107:0/3030026036 >> v2:172.21.15.195:3300/0 conn(0x7f7f680d21b0 msgr2=0x7f7f680d2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:26.847 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.854+0000 7f7f66ffd640 1 --2- 172.21.15.107:0/3030026036 >> v2:172.21.15.195:3300/0 conn(0x7f7f680d21b0 0x7f7f680d2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:26.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.854+0000 7f7f667fc640 1 --2- 172.21.15.107:0/3030026036 >> v2:172.21.15.195:3300/0 conn(0x7f7f680d21b0 0x7f7f680d2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.854+0000 7f7f65ffb640 1 -- 172.21.15.107:0/3030026036 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2602299097 0 0) 0x7f7f680d2ad0 con 0x7f7f680cf830 2024-03-13T21:20:26.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.854+0000 7f7f667fc640 1 -- 172.21.15.107:0/3030026036 >> v1:172.21.15.107:6789/0 conn(0x7f7f680cf830 legacy=0x7f7f680d07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:26.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.854+0000 7f7f667fc640 1 -- 172.21.15.107:0/3030026036 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f680b3960 con 0x7f7f680cf3a0 2024-03-13T21:20:26.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.855+0000 7f7f667fc640 1 --2- 172.21.15.107:0/3030026036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f680cf3a0 0x7f7f680d0290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7f6808dd30 tx=0x7f7f5c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc573d54159cc64f server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:26.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.855+0000 7f7f65ffb640 1 -- 172.21.15.107:0/3030026036 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c035020 con 0x7f7f680cf3a0 2024-03-13T21:20:26.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.855+0000 7f7f65ffb640 1 -- 172.21.15.107:0/3030026036 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f5c031830 con 0x7f7f680cf3a0 2024-03-13T21:20:26.848 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.855+0000 7f7f65ffb640 1 -- 172.21.15.107:0/3030026036 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c031c00 con 0x7f7f680cf3a0 2024-03-13T21:20:26.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.856+0000 7f7f6d459640 1 -- 172.21.15.107:0/3030026036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f680cf3a0 msgr2=0x7f7f680d0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:26.850 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.856+0000 7f7f6d459640 1 --2- 172.21.15.107:0/3030026036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f680cf3a0 0x7f7f680d0290 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7f6808dd30 tx=0x7f7f5c02b8d0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.856+0000 7f7f6d459640 1 -- 172.21.15.107:0/3030026036 shutdown_connections 2024-03-13T21:20:26.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.856+0000 7f7f6d459640 1 --2- 172.21.15.107:0/3030026036 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f680cf3a0 0x7f7f680d0290 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.856+0000 7f7f6d459640 1 --2- 172.21.15.107:0/3030026036 >> v2:172.21.15.195:3300/0 conn(0x7f7f680d21b0 0x7f7f680d2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.856+0000 7f7f6d459640 1 -- 172.21.15.107:0/3030026036 >> 172.21.15.107:0/3030026036 conn(0x7f7f6809cea0 msgr2=0x7f7f680d3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:26.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.856+0000 7f7f6d459640 1 -- 172.21.15.107:0/3030026036 shutdown_connections 2024-03-13T21:20:26.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.856+0000 7f7f6d459640 1 -- 172.21.15.107:0/3030026036 wait complete. 2024-03-13T21:20:26.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.857+0000 7f7f6d459640 1 Processor -- start 2024-03-13T21:20:26.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.857+0000 7f7f6d459640 1 -- start start 2024-03-13T21:20:26.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.858+0000 7f7f6d459640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f680cf3a0 0x7f7f6815ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.858+0000 7f7f6d459640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f680cf830 0x7f7f6806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.858+0000 7f7f6d459640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f680d21b0 0x7f7f6806bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.858+0000 7f7f6d459640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f7f680b0790 con 0x7f7f680cf830 2024-03-13T21:20:26.851 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.858+0000 7f7f6d459640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f7f680b3f20 con 0x7f7f680cf3a0 2024-03-13T21:20:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.858+0000 7f7f6d459640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f7f680b5450 con 0x7f7f680d21b0 2024-03-13T21:20:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.858+0000 7f7f667fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f680cf830 0x7f7f6806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.858+0000 7f7f667fc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f680cf830 0x7f7f6806b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:38490/0 (socket says 172.21.15.107:38490) 2024-03-13T21:20:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.858+0000 7f7f667fc640 1 -- 172.21.15.107:0/3552385518 learned_addr learned my addr 172.21.15.107:0/3552385518 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-03-13T21:20:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.858+0000 7f7f667fc640 1 -- 172.21.15.107:0/3552385518 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f680d21b0 msgr2=0x7f7f6806bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.858+0000 7f7f667fc640 1 --2- 172.21.15.107:0/3552385518 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f680d21b0 0x7f7f6806bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.858+0000 7f7f667fc640 1 -- 172.21.15.107:0/3552385518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f680cf3a0 msgr2=0x7f7f6815ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.858+0000 7f7f667fc640 1 --2- 172.21.15.107:0/3552385518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f680cf3a0 0x7f7f6815ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.858+0000 7f7f667fc640 1 -- 172.21.15.107:0/3552385518 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f680ccb00 con 0x7f7f680cf830 2024-03-13T21:20:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.858+0000 7f7f667fc640 1 --2- 172.21.15.107:0/3552385518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f680cf830 0x7f7f6806b9e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009890 tx=0x7f7f5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.858+0000 7f7f4f7fe640 1 -- 172.21.15.107:0/3552385518 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c03a9b0 con 0x7f7f680cf830 2024-03-13T21:20:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.859+0000 7f7f4f7fe640 1 -- 172.21.15.107:0/3552385518 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f5c03ab50 con 0x7f7f680cf830 2024-03-13T21:20:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.859+0000 7f7f4f7fe640 1 -- 172.21.15.107:0/3552385518 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5c0443f0 con 0x7f7f680cf830 2024-03-13T21:20:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.859+0000 7f7f6d459640 1 -- 172.21.15.107:0/3552385518 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f6815ee80 con 0x7f7f680cf830 2024-03-13T21:20:26.852 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.859+0000 7f7f6d459640 1 -- 172.21.15.107:0/3552385518 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f6815f440 con 0x7f7f680cf830 2024-03-13T21:20:26.853 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.860+0000 7f7f6d459640 1 -- 172.21.15.107:0/3552385518 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f68075120 con 0x7f7f680cf830 2024-03-13T21:20:26.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.860+0000 7f7f4f7fe640 1 -- 172.21.15.107:0/3552385518 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f7f5c038020 con 0x7f7f680cf830 2024-03-13T21:20:26.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.860+0000 7f7f4f7fe640 1 --2- 172.21.15.107:0/3552385518 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f7f5406bc00 0x7f7f5406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:26.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.861+0000 7f7f66ffd640 1 --2- 172.21.15.107:0/3552385518 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f7f5406bc00 0x7f7f5406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:26.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.861+0000 7f7f4f7fe640 1 -- 172.21.15.107:0/3552385518 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f7f5c0ac500 con 0x7f7f680cf830 2024-03-13T21:20:26.854 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.861+0000 7f7f66ffd640 1 --2- 172.21.15.107:0/3552385518 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f7f5406bc00 0x7f7f5406e0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7f58007dc0 tx=0x7f7f580072f0 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:26.856 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:26.865+0000 7f7f4f7fe640 1 -- 172.21.15.107:0/3552385518 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183657 (secure 0 0 0) 0x7f7f680ccb00 con 0x7f7f680cf830 2024-03-13T21:20:27.063 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:27.072+0000 7f7f6d459640 1 -- 172.21.15.107:0/3552385518 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f680d3e40 con 0x7f7f680cf830 2024-03-13T21:20:27.064 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:27.072+0000 7f7f4f7fe640 1 -- 172.21.15.107:0/3552385518 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7f7f5c03f070 con 0x7f7f680cf830 2024-03-13T21:20:27.064 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:20:27.064 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3229557763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3229557763},{"type":"v1","addr":"172.21.15.107:6836","nonce":3229557763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-03-13T21:20:27.065 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 2 2024-03-13T21:20:27.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:27.074+0000 7f7f6d459640 1 -- 172.21.15.107:0/3552385518 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f7f5406bc00 msgr2=0x7f7f5406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:27.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:27.074+0000 7f7f6d459640 1 --2- 172.21.15.107:0/3552385518 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f7f5406bc00 0x7f7f5406e0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7f58007dc0 tx=0x7f7f580072f0 comp rx=0 tx=0).stop 2024-03-13T21:20:27.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:27.074+0000 7f7f6d459640 1 -- 172.21.15.107:0/3552385518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f680cf830 msgr2=0x7f7f6806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:27.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:27.074+0000 7f7f6d459640 1 --2- 172.21.15.107:0/3552385518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f680cf830 0x7f7f6806b9e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c009890 tx=0x7f7f5c0046c0 comp rx=0 tx=0).stop 2024-03-13T21:20:27.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:27.074+0000 7f7f6d459640 1 -- 172.21.15.107:0/3552385518 shutdown_connections 2024-03-13T21:20:27.066 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:27.074+0000 7f7f6d459640 1 --2- 172.21.15.107:0/3552385518 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f7f5406bc00 0x7f7f5406e0c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:27.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:27.074+0000 7f7f6d459640 1 --2- 172.21.15.107:0/3552385518 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f7f680d21b0 0x7f7f6806bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:27.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:27.074+0000 7f7f6d459640 1 --2- 172.21.15.107:0/3552385518 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f7f680cf830 0x7f7f6806b9e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:27.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:27.074+0000 7f7f6d459640 1 --2- 172.21.15.107:0/3552385518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f680cf3a0 0x7f7f6815ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:27.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:27.074+0000 7f7f6d459640 1 -- 172.21.15.107:0/3552385518 >> 172.21.15.107:0/3552385518 conn(0x7f7f6809cea0 msgr2=0x7f7f6806cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:27.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:27.074+0000 7f7f6d459640 1 -- 172.21.15.107:0/3552385518 shutdown_connections 2024-03-13T21:20:27.067 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:27.074+0000 7f7f6d459640 1 -- 172.21.15.107:0/3552385518 wait complete. 2024-03-13T21:20:29.077 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-13T21:20:29.188 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.197+0000 7f051b544640 1 Processor -- start 2024-03-13T21:20:29.189 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.197+0000 7f051b544640 1 -- start start 2024-03-13T21:20:29.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.198+0000 7f051b544640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f051415e1c0 0x7f05140cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.198+0000 7f051b544640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f051415e5a0 0x7f051415e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.198+0000 7f051b544640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05140cec70 con 0x7f05140b2890 2024-03-13T21:20:29.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.198+0000 7f051b544640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f051406c010 con 0x7f051415e5a0 2024-03-13T21:20:29.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.198+0000 7f051b544640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f05140cef50 con 0x7f051415e1c0 2024-03-13T21:20:29.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.198+0000 7f0519ae1640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f051415e5a0 0x7f051415e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.198+0000 7f0518adf640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7f05140b2890 0x7f051406c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:51518/0 (socket says 172.21.15.107:51518) 2024-03-13T21:20:29.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.198+0000 7f0518adf640 1 -- 172.21.15.107:0/3224837055 learned_addr learned my addr 172.21.15.107:0/3224837055 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-03-13T21:20:29.190 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.198+0000 7f05192e0640 1 --2- 172.21.15.107:0/3224837055 >> v2:172.21.15.195:3300/0 conn(0x7f051415e1c0 0x7f05140cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.198+0000 7f0519ae1640 1 -- 172.21.15.107:0/3224837055 >> v2:172.21.15.195:3300/0 conn(0x7f051415e1c0 msgr2=0x7f05140cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:29.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.198+0000 7f0519ae1640 1 --2- 172.21.15.107:0/3224837055 >> v2:172.21.15.195:3300/0 conn(0x7f051415e1c0 0x7f05140cfa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.198+0000 7f0519ae1640 1 -- 172.21.15.107:0/3224837055 >> v1:172.21.15.107:6789/0 conn(0x7f05140b2890 legacy=0x7f051406c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:29.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.198+0000 7f050bfff640 1 -- 172.21.15.107:0/3224837055 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1117236765 0 0) 0x7f05140cec70 con 0x7f05140b2890 2024-03-13T21:20:29.191 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.198+0000 7f0519ae1640 1 -- 172.21.15.107:0/3224837055 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05140cf230 con 0x7f051415e5a0 2024-03-13T21:20:29.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.199+0000 7f0519ae1640 1 --2- 172.21.15.107:0/3224837055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f051415e5a0 0x7f051415e9b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0514071bf0 tx=0x7f050c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d8bc25a2edaee08 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:29.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.199+0000 7f050bfff640 1 -- 172.21.15.107:0/3224837055 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c035020 con 0x7f051415e5a0 2024-03-13T21:20:29.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.199+0000 7f050bfff640 1 -- 172.21.15.107:0/3224837055 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f050c031830 con 0x7f051415e5a0 2024-03-13T21:20:29.192 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.199+0000 7f050bfff640 1 -- 172.21.15.107:0/3224837055 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050c031c00 con 0x7f051415e5a0 2024-03-13T21:20:29.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.200+0000 7f051b544640 1 -- 172.21.15.107:0/3224837055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f051415e5a0 msgr2=0x7f051415e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:29.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.200+0000 7f051b544640 1 --2- 172.21.15.107:0/3224837055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f051415e5a0 0x7f051415e9b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0514071bf0 tx=0x7f050c02b8d0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.200+0000 7f051b544640 1 -- 172.21.15.107:0/3224837055 shutdown_connections 2024-03-13T21:20:29.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.200+0000 7f051b544640 1 --2- 172.21.15.107:0/3224837055 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f051415e5a0 0x7f051415e9b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.200+0000 7f051b544640 1 --2- 172.21.15.107:0/3224837055 >> v2:172.21.15.195:3300/0 conn(0x7f051415e1c0 0x7f05140cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.200+0000 7f051b544640 1 -- 172.21.15.107:0/3224837055 >> 172.21.15.107:0/3224837055 conn(0x7f05140d1940 msgr2=0x7f05140d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:29.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.200+0000 7f051b544640 1 -- 172.21.15.107:0/3224837055 shutdown_connections 2024-03-13T21:20:29.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.200+0000 7f051b544640 1 -- 172.21.15.107:0/3224837055 wait complete. 2024-03-13T21:20:29.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.201+0000 7f051b544640 1 Processor -- start 2024-03-13T21:20:29.193 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.201+0000 7f051b544640 1 -- start start 2024-03-13T21:20:29.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.202+0000 7f051b544640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05140b2890 0x7f051414fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.195 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.202+0000 7f051b544640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f051415e1c0 0x7f051415f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.202+0000 7f051b544640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f051415e5a0 0x7f05140cabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.202+0000 7f051b544640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f051406c4a0 con 0x7f051415e1c0 2024-03-13T21:20:29.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.202+0000 7f051b544640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f05140b2cc0 con 0x7f05140b2890 2024-03-13T21:20:29.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.202+0000 7f051b544640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f05141609b0 con 0x7f051415e5a0 2024-03-13T21:20:29.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.202+0000 7f0518adf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f051415e1c0 0x7f051415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.202+0000 7f0518adf640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f051415e1c0 0x7f051415f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33100/0 (socket says 172.21.15.107:33100) 2024-03-13T21:20:29.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.202+0000 7f0518adf640 1 -- 172.21.15.107:0/1413255874 learned_addr learned my addr 172.21.15.107:0/1413255874 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-03-13T21:20:29.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.202+0000 7f05192e0640 1 --2- 172.21.15.107:0/1413255874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05140b2890 0x7f051414fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.202+0000 7f0519ae1640 1 --2- 172.21.15.107:0/1413255874 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f051415e5a0 0x7f05140cabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.202+0000 7f0518adf640 1 -- 172.21.15.107:0/1413255874 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f051415e5a0 msgr2=0x7f05140cabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:29.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.202+0000 7f0518adf640 1 --2- 172.21.15.107:0/1413255874 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f051415e5a0 0x7f05140cabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.202+0000 7f0518adf640 1 -- 172.21.15.107:0/1413255874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05140b2890 msgr2=0x7f051414fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:29.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.202+0000 7f0518adf640 1 --2- 172.21.15.107:0/1413255874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05140b2890 0x7f051414fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.196 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.202+0000 7f0518adf640 1 -- 172.21.15.107:0/1413255874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051415fda0 con 0x7f051415e1c0 2024-03-13T21:20:29.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.202+0000 7f05192e0640 1 --2- 172.21.15.107:0/1413255874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05140b2890 0x7f051414fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-13T21:20:29.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.202+0000 7f0518adf640 1 --2- 172.21.15.107:0/1413255874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f051415e1c0 0x7f051415f370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f050400c430 tx=0x7f050400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:29.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.203+0000 7f0509ffb640 1 -- 172.21.15.107:0/1413255874 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05040074e0 con 0x7f051415e1c0 2024-03-13T21:20:29.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.203+0000 7f0509ffb640 1 -- 172.21.15.107:0/1413255874 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05040047e0 con 0x7f051415e1c0 2024-03-13T21:20:29.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.203+0000 7f051b544640 1 -- 172.21.15.107:0/1413255874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0514160080 con 0x7f051415e1c0 2024-03-13T21:20:29.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.203+0000 7f0509ffb640 1 -- 172.21.15.107:0/1413255874 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0504004bd0 con 0x7f051415e1c0 2024-03-13T21:20:29.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.203+0000 7f051b544640 1 -- 172.21.15.107:0/1413255874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0514150370 con 0x7f051415e1c0 2024-03-13T21:20:29.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.204+0000 7f051b544640 1 -- 172.21.15.107:0/1413255874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0514160470 con 0x7f051415e1c0 2024-03-13T21:20:29.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.204+0000 7f0509ffb640 1 -- 172.21.15.107:0/1413255874 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f0504011070 con 0x7f051415e1c0 2024-03-13T21:20:29.197 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.204+0000 7f0509ffb640 1 --2- 172.21.15.107:0/1413255874 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f04f806bbd0 0x7f04f806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.205+0000 7f0509ffb640 1 -- 172.21.15.107:0/1413255874 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f050408a3a0 con 0x7f051415e1c0 2024-03-13T21:20:29.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.205+0000 7f05192e0640 1 --2- 172.21.15.107:0/1413255874 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f04f806bbd0 0x7f04f806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.198 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.205+0000 7f05192e0640 1 --2- 172.21.15.107:0/1413255874 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f04f806bbd0 0x7f04f806e090 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f05140c7150 tx=0x7f0510007420 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:29.200 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.209+0000 7f0509ffb640 1 -- 172.21.15.107:0/1413255874 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183657 (secure 0 0 0) 0x7f05040591e0 con 0x7f051415e1c0 2024-03-13T21:20:29.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.414+0000 7f051b544640 1 -- 172.21.15.107:0/1413255874 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0514160250 con 0x7f051415e1c0 2024-03-13T21:20:29.406 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.415+0000 7f0509ffb640 1 -- 172.21.15.107:0/1413255874 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3873 (secure 0 0 0) 0x7f0504058ae0 con 0x7f051415e1c0 2024-03-13T21:20:29.406 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:20:29.406 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/2625942903","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2625942903},{"type":"v1","addr":"172.21.15.195:6835","nonce":2625942903}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6836/3229557763","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6834","nonce":3229557763},{"type":"v1","addr":"172.21.15.107:6836","nonce":3229557763}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4279,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.107:6837/423035033","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6835","nonce":423035033},{"type":"v1","addr":"172.21.15.107:6837","nonce":423035033}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6834/3099490879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6833","nonce":3099490879},{"type":"v1","addr":"172.21.15.195:6834","nonce":3099490879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-13T21:20:29.407 INFO:teuthology.orchestra.run.smithi107.stderr:dumped fsmap epoch 3 2024-03-13T21:20:29.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.417+0000 7f051b544640 1 -- 172.21.15.107:0/1413255874 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f04f806bbd0 msgr2=0x7f04f806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:29.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.417+0000 7f051b544640 1 --2- 172.21.15.107:0/1413255874 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f04f806bbd0 0x7f04f806e090 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f05140c7150 tx=0x7f0510007420 comp rx=0 tx=0).stop 2024-03-13T21:20:29.408 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.417+0000 7f051b544640 1 -- 172.21.15.107:0/1413255874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f051415e1c0 msgr2=0x7f051415f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:29.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.417+0000 7f051b544640 1 --2- 172.21.15.107:0/1413255874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f051415e1c0 0x7f051415f370 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f050400c430 tx=0x7f050400c8f0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.417+0000 7f051b544640 1 -- 172.21.15.107:0/1413255874 shutdown_connections 2024-03-13T21:20:29.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.417+0000 7f051b544640 1 --2- 172.21.15.107:0/1413255874 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f04f806bbd0 0x7f04f806e090 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.417+0000 7f051b544640 1 --2- 172.21.15.107:0/1413255874 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f051415e5a0 0x7f05140cabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.417+0000 7f051b544640 1 --2- 172.21.15.107:0/1413255874 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f051415e1c0 0x7f051415f370 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.417+0000 7f051b544640 1 --2- 172.21.15.107:0/1413255874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05140b2890 0x7f051414fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.417+0000 7f051b544640 1 -- 172.21.15.107:0/1413255874 >> 172.21.15.107:0/1413255874 conn(0x7f05140d1940 msgr2=0x7f05140cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:29.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.417+0000 7f051b544640 1 -- 172.21.15.107:0/1413255874 shutdown_connections 2024-03-13T21:20:29.409 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.417+0000 7f051b544640 1 -- 172.21.15.107:0/1413255874 wait complete. 2024-03-13T21:20:29.419 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-13T21:20:29.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.528+0000 7f837dae8640 1 Processor -- start 2024-03-13T21:20:29.519 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.528+0000 7f837dae8640 1 -- start start 2024-03-13T21:20:29.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.528+0000 7f837dae8640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f837815ac80 0x7f83780cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.528+0000 7f837dae8640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f83780b32f0 0x7f83780b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.528+0000 7f837dae8640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f837806e040 con 0x7f837815a8a0 2024-03-13T21:20:29.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.528+0000 7f837dae8640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f83780cc2a0 con 0x7f837815ac80 2024-03-13T21:20:29.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.528+0000 7f837dae8640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f837806e2e0 con 0x7f83780b32f0 2024-03-13T21:20:29.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.529+0000 7f836ffff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f837815ac80 0x7f83780cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.529+0000 7f836ffff640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f837815ac80 0x7f83780cbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33112/0 (socket says 172.21.15.107:33112) 2024-03-13T21:20:29.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.529+0000 7f836ffff640 1 -- 172.21.15.107:0/1592120616 learned_addr learned my addr 172.21.15.107:0/1592120616 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-03-13T21:20:29.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.529+0000 7f8377fff640 1 --2- 172.21.15.107:0/1592120616 >> v2:172.21.15.195:3300/0 conn(0x7f83780b32f0 0x7f83780b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.522 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.529+0000 7f836ffff640 1 -- 172.21.15.107:0/1592120616 >> v2:172.21.15.195:3300/0 conn(0x7f83780b32f0 msgr2=0x7f83780b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:29.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.529+0000 7f836ffff640 1 --2- 172.21.15.107:0/1592120616 >> v2:172.21.15.195:3300/0 conn(0x7f83780b32f0 0x7f83780b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.529+0000 7f836ffff640 1 -- 172.21.15.107:0/1592120616 >> v1:172.21.15.195:6789/0 conn(0x7f837815a8a0 legacy=0x7f8378071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:29.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.529+0000 7f836ffff640 1 -- 172.21.15.107:0/1592120616 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837806c6f0 con 0x7f837815ac80 2024-03-13T21:20:29.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.530+0000 7f836ffff640 1 --2- 172.21.15.107:0/1592120616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f837815ac80 0x7f83780cbd60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8378074a20 tx=0x7f836002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2aee0be0391eb94 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:29.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.530+0000 7f8376ffd640 1 -- 172.21.15.107:0/1592120616 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836003b070 con 0x7f837815ac80 2024-03-13T21:20:29.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.530+0000 7f8376ffd640 1 -- 172.21.15.107:0/1592120616 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8360036440 con 0x7f837815ac80 2024-03-13T21:20:29.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.530+0000 7f8376ffd640 1 -- 172.21.15.107:0/1592120616 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8360036810 con 0x7f837815ac80 2024-03-13T21:20:29.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.530+0000 7f837dae8640 1 -- 172.21.15.107:0/1592120616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f837815ac80 msgr2=0x7f83780cbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:29.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.530+0000 7f837dae8640 1 --2- 172.21.15.107:0/1592120616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f837815ac80 0x7f83780cbd60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8378074a20 tx=0x7f836002e0e0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.530+0000 7f837dae8640 1 -- 172.21.15.107:0/1592120616 shutdown_connections 2024-03-13T21:20:29.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.530+0000 7f837dae8640 1 --2- 172.21.15.107:0/1592120616 >> v2:172.21.15.195:3300/0 conn(0x7f83780b32f0 0x7f83780b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.530+0000 7f837dae8640 1 --2- 172.21.15.107:0/1592120616 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f837815ac80 0x7f83780cbd60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.523 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.530+0000 7f837dae8640 1 -- 172.21.15.107:0/1592120616 >> 172.21.15.107:0/1592120616 conn(0x7f83780b15e0 msgr2=0x7f83780b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:29.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.530+0000 7f837dae8640 1 -- 172.21.15.107:0/1592120616 shutdown_connections 2024-03-13T21:20:29.524 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.530+0000 7f837dae8640 1 -- 172.21.15.107:0/1592120616 wait complete. 2024-03-13T21:20:29.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.531+0000 7f837dae8640 1 Processor -- start 2024-03-13T21:20:29.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.532+0000 7f837dae8640 1 -- start start 2024-03-13T21:20:29.526 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.532+0000 7f837dae8640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83780b32f0 0x7f8378158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.532+0000 7f837dae8640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f837815a8a0 0x7f8378159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.532+0000 7f837dae8640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f837815ac80 0x7f837814a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.532+0000 7f837dae8640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f83780b3c30 con 0x7f83780b32f0 2024-03-13T21:20:29.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.532+0000 7f837dae8640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f8378071e60 con 0x7f837815a8a0 2024-03-13T21:20:29.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.532+0000 7f837dae8640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f837815e590 con 0x7f837815ac80 2024-03-13T21:20:29.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.532+0000 7f83777fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83780b32f0 0x7f8378158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.532+0000 7f83777fe640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83780b32f0 0x7f8378158640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33122/0 (socket says 172.21.15.107:33122) 2024-03-13T21:20:29.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.532+0000 7f83777fe640 1 -- 172.21.15.107:0/2464767123 learned_addr learned my addr 172.21.15.107:0/2464767123 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-03-13T21:20:29.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.532+0000 7f83777fe640 1 -- 172.21.15.107:0/2464767123 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f837815ac80 msgr2=0x7f837814a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:29.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.532+0000 7f83777fe640 1 --2- 172.21.15.107:0/2464767123 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f837815ac80 0x7f837814a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.532+0000 7f83777fe640 1 -- 172.21.15.107:0/2464767123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f837815a8a0 msgr2=0x7f8378159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:29.527 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.532+0000 7f83777fe640 1 --2- 172.21.15.107:0/2464767123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f837815a8a0 0x7f8378159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.533+0000 7f83777fe640 1 -- 172.21.15.107:0/2464767123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83781575a0 con 0x7f83780b32f0 2024-03-13T21:20:29.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.533+0000 7f83777fe640 1 --2- 172.21.15.107:0/2464767123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83780b32f0 0x7f8378158640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f836800c430 tx=0x7f836800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:29.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.533+0000 7f8374ff9640 1 -- 172.21.15.107:0/2464767123 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83680052d0 con 0x7f83780b32f0 2024-03-13T21:20:29.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.533+0000 7f8374ff9640 1 -- 172.21.15.107:0/2464767123 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8368005490 con 0x7f83780b32f0 2024-03-13T21:20:29.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.533+0000 7f837dae8640 1 -- 172.21.15.107:0/2464767123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8378157880 con 0x7f83780b32f0 2024-03-13T21:20:29.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.533+0000 7f8374ff9640 1 -- 172.21.15.107:0/2464767123 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8368007260 con 0x7f83780b32f0 2024-03-13T21:20:29.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.533+0000 7f837dae8640 1 -- 172.21.15.107:0/2464767123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8378157e40 con 0x7f83780b32f0 2024-03-13T21:20:29.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.534+0000 7f837dae8640 1 -- 172.21.15.107:0/2464767123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8378075120 con 0x7f83780b32f0 2024-03-13T21:20:29.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.534+0000 7f8374ff9640 1 -- 172.21.15.107:0/2464767123 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f8368007400 con 0x7f83780b32f0 2024-03-13T21:20:29.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.534+0000 7f8374ff9640 1 --2- 172.21.15.107:0/2464767123 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f835806bbd0 0x7f835806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.528 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.535+0000 7f836ffff640 1 --2- 172.21.15.107:0/2464767123 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f835806bbd0 0x7f835806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.535+0000 7f8374ff9640 1 -- 172.21.15.107:0/2464767123 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f8368089c30 con 0x7f83780b32f0 2024-03-13T21:20:29.529 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.535+0000 7f836ffff640 1 --2- 172.21.15.107:0/2464767123 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f835806bbd0 0x7f835806e090 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8360038000 tx=0x7f8360030000 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:29.530 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.539+0000 7f8374ff9640 1 -- 172.21.15.107:0/2464767123 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183657 (secure 0 0 0) 0x7f8368058a70 con 0x7f83780b32f0 2024-03-13T21:20:29.704 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.713+0000 7f837dae8640 1 -- 172.21.15.107:0/2464767123 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83780b29a0 con 0x7f83780b32f0 2024-03-13T21:20:29.705 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.713+0000 7f8374ff9640 1 -- 172.21.15.107:0/2464767123 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12920 (secure 0 0 0) 0x7f8368058370 con 0x7f83780b32f0 2024-03-13T21:20:29.705 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:20:29.705 INFO:teuthology.orchestra.run.smithi107.stdout:{"epoch":17,"fsid":"2124cc6e-e803-48aa-9f5a-1b467da9f25e","created":"2024-03-13T21:20:08.464385+0000","modified":"2024-03-13T21:20:23.687266+0000","last_up_change":"2024-03-13T21:20:19.090808+0000","last_in_change":"2024-03-13T21:20:10.701372+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-13T21:20:20.705949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c2acc15b-5d55-4ce3-be7d-42c4498c7ade","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6808","nonce":671021832},{"type":"v1","addr":"172.21.15.107:6809","nonce":671021832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6810","nonce":671021832},{"type":"v1","addr":"172.21.15.107:6811","nonce":671021832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6815","nonce":671021832},{"type":"v1","addr":"172.21.15.107:6817","nonce":671021832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6812","nonce":671021832},{"type":"v1","addr":"172.21.15.107:6813","nonce":671021832}]},"public_addr":"172.21.15.107:6809/671021832","cluster_addr":"172.21.15.107:6811/671021832","heartbeat_back_addr":"172.21.15.107:6817/671021832","heartbeat_front_addr":"172.21.15.107:6813/671021832","state":["exists","up"]},{"osd":1,"uuid":"6452e15a-de59-4bb8-b50b-ed0c73193d57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6814","nonce":3112363424},{"type":"v1","addr":"172.21.15.107:6816","nonce":3112363424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6818","nonce":3112363424},{"type":"v1","addr":"172.21.15.107:6819","nonce":3112363424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6822","nonce":3112363424},{"type":"v1","addr":"172.21.15.107:6823","nonce":3112363424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6820","nonce":3112363424},{"type":"v1","addr":"172.21.15.107:6821","nonce":3112363424}]},"public_addr":"172.21.15.107:6816/3112363424","cluster_addr":"172.21.15.107:6819/3112363424","heartbeat_back_addr":"172.21.15.107:6823/3112363424","heartbeat_front_addr":"172.21.15.107:6821/3112363424","state":["exists","up"]},{"osd":2,"uuid":"6ec15277-ca0f-47b0-a89f-2fa53a606ed9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6800","nonce":4245800458},{"type":"v1","addr":"172.21.15.107:6801","nonce":4245800458}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6802","nonce":4245800458},{"type":"v1","addr":"172.21.15.107:6803","nonce":4245800458}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6806","nonce":4245800458},{"type":"v1","addr":"172.21.15.107:6807","nonce":4245800458}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6804","nonce":4245800458},{"type":"v1","addr":"172.21.15.107:6805","nonce":4245800458}]},"public_addr":"172.21.15.107:6801/4245800458","cluster_addr":"172.21.15.107:6803/4245800458","heartbeat_back_addr":"172.21.15.107:6807/4245800458","heartbeat_front_addr":"172.21.15.107:6805/4245800458","state":["exists","up"]},{"osd":3,"uuid":"de114af6-e8ee-4d26-92d8-e0b0683fe282","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6824","nonce":1397993525},{"type":"v1","addr":"172.21.15.107:6825","nonce":1397993525}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6826","nonce":1397993525},{"type":"v1","addr":"172.21.15.107:6827","nonce":1397993525}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6830","nonce":1397993525},{"type":"v1","addr":"172.21.15.107:6831","nonce":1397993525}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.107:6828","nonce":1397993525},{"type":"v1","addr":"172.21.15.107:6829","nonce":1397993525}]},"public_addr":"172.21.15.107:6825/1397993525","cluster_addr":"172.21.15.107:6827/1397993525","heartbeat_back_addr":"172.21.15.107:6831/1397993525","heartbeat_front_addr":"172.21.15.107:6829/1397993525","state":["exists","up"]},{"osd":4,"uuid":"78d43c86-5c73-4e6d-9a51-d8022f68f36a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":531258567},{"type":"v1","addr":"172.21.15.195:6801","nonce":531258567}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":531258567},{"type":"v1","addr":"172.21.15.195:6803","nonce":531258567}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":531258567},{"type":"v1","addr":"172.21.15.195:6807","nonce":531258567}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":531258567},{"type":"v1","addr":"172.21.15.195:6805","nonce":531258567}]},"public_addr":"172.21.15.195:6801/531258567","cluster_addr":"172.21.15.195:6803/531258567","heartbeat_back_addr":"172.21.15.195:6807/531258567","heartbeat_front_addr":"172.21.15.195:6805/531258567","state":["exists","up"]},{"osd":5,"uuid":"ef9caa1c-ef75-4307-8b5d-171bd2eb37b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":1177215231},{"type":"v1","addr":"172.21.15.195:6809","nonce":1177215231}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":1177215231},{"type":"v1","addr":"172.21.15.195:6811","nonce":1177215231}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":1177215231},{"type":"v1","addr":"172.21.15.195:6815","nonce":1177215231}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":1177215231},{"type":"v1","addr":"172.21.15.195:6813","nonce":1177215231}]},"public_addr":"172.21.15.195:6809/1177215231","cluster_addr":"172.21.15.195:6811/1177215231","heartbeat_back_addr":"172.21.15.195:6815/1177215231","heartbeat_front_addr":"172.21.15.195:6813/1177215231","state":["exists","up"]},{"osd":6,"uuid":"0f07cccd-e497-44fa-afae-e81242b8ece2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":3656715468},{"type":"v1","addr":"172.21.15.195:6817","nonce":3656715468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":3656715468},{"type":"v1","addr":"172.21.15.195:6819","nonce":3656715468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":3656715468},{"type":"v1","addr":"172.21.15.195:6823","nonce":3656715468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":3656715468},{"type":"v1","addr":"172.21.15.195:6821","nonce":3656715468}]},"public_addr":"172.21.15.195:6817/3656715468","cluster_addr":"172.21.15.195:6819/3656715468","heartbeat_back_addr":"172.21.15.195:6823/3656715468","heartbeat_front_addr":"172.21.15.195:6821/3656715468","state":["exists","up"]},{"osd":7,"uuid":"df5edf8d-3d1b-486f-a640-e01e2f1d1f98","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2200630994},{"type":"v1","addr":"172.21.15.195:6825","nonce":2200630994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2200630994},{"type":"v1","addr":"172.21.15.195:6827","nonce":2200630994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2200630994},{"type":"v1","addr":"172.21.15.195:6831","nonce":2200630994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2200630994},{"type":"v1","addr":"172.21.15.195:6829","nonce":2200630994}]},"public_addr":"172.21.15.195:6825/2200630994","cluster_addr":"172.21.15.195:6827/2200630994","heartbeat_back_addr":"172.21.15.195:6831/2200630994","heartbeat_front_addr":"172.21.15.195:6829/2200630994","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.890430+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.935903+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.815338+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.934666+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.803329+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.772128+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.837195+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-13T21:20:15.823592+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-13T21:20:29.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.715+0000 7f837dae8640 1 -- 172.21.15.107:0/2464767123 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f835806bbd0 msgr2=0x7f835806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:29.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.715+0000 7f837dae8640 1 --2- 172.21.15.107:0/2464767123 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f835806bbd0 0x7f835806e090 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8360038000 tx=0x7f8360030000 comp rx=0 tx=0).stop 2024-03-13T21:20:29.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.715+0000 7f837dae8640 1 -- 172.21.15.107:0/2464767123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83780b32f0 msgr2=0x7f8378158640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:29.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.715+0000 7f837dae8640 1 --2- 172.21.15.107:0/2464767123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83780b32f0 0x7f8378158640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f836800c430 tx=0x7f836800c8f0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.715+0000 7f837dae8640 1 -- 172.21.15.107:0/2464767123 shutdown_connections 2024-03-13T21:20:29.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.715+0000 7f837dae8640 1 --2- 172.21.15.107:0/2464767123 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f835806bbd0 0x7f835806e090 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.715+0000 7f837dae8640 1 --2- 172.21.15.107:0/2464767123 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f837815ac80 0x7f837814a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.715+0000 7f837dae8640 1 --2- 172.21.15.107:0/2464767123 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f837815a8a0 0x7f8378159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.715+0000 7f837dae8640 1 --2- 172.21.15.107:0/2464767123 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f83780b32f0 0x7f8378158640 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.707 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.715+0000 7f837dae8640 1 -- 172.21.15.107:0/2464767123 >> 172.21.15.107:0/2464767123 conn(0x7f83780b15e0 msgr2=0x7f83780b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:29.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.715+0000 7f837dae8640 1 -- 172.21.15.107:0/2464767123 shutdown_connections 2024-03-13T21:20:29.708 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.715+0000 7f837dae8640 1 -- 172.21.15.107:0/2464767123 wait complete. 2024-03-13T21:20:29.718 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-13T21:20:20.705949+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-13T21:20:29.718 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-13T21:20:29.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.828+0000 7faaff197640 1 Processor -- start 2024-03-13T21:20:29.820 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.828+0000 7faaff197640 1 -- start start 2024-03-13T21:20:29.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.829+0000 7faaff197640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7faaf80afe70 0x7faaf80cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.829+0000 7faaff197640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaf8071da0 0x7faaf80cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.823 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.829+0000 7faaff197640 1 -- --> v1:172.21.15.107:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaf806e1c0 con 0x7faaf815bcf0 2024-03-13T21:20:29.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.829+0000 7faaff197640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7faaf815aec0 con 0x7faaf80afe70 2024-03-13T21:20:29.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.829+0000 7faaff197640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faaf815f4e0 con 0x7faaf8071da0 2024-03-13T21:20:29.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.829+0000 7faaf7fff640 1 --1- >> v1:172.21.15.107:6789/0 conn(0x7faaf815bcf0 0x7faaf8071690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.107:6789/0 says I am v1:172.21.15.107:51522/0 (socket says 172.21.15.107:51522) 2024-03-13T21:20:29.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.829+0000 7faaf7fff640 1 -- 172.21.15.107:0/3661550588 learned_addr learned my addr 172.21.15.107:0/3661550588 (peer_addr_for_me v1:172.21.15.107:0/0) 2024-03-13T21:20:29.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faafcf33640 1 --2- 172.21.15.107:0/3661550588 >> v2:172.21.15.195:3300/0 conn(0x7faaf80afe70 0x7faaf80cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faafd734640 1 --2- 172.21.15.107:0/3661550588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaf8071da0 0x7faaf80cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faaf77fe640 1 -- 172.21.15.107:0/3661550588 <== mon.0 v1:172.21.15.107:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2099275057 0 0) 0x7faaec001110 con 0x7faaf815bcf0 2024-03-13T21:20:29.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faaf77fe640 1 -- 172.21.15.107:0/3661550588 --> v1:172.21.15.107:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faae0003520 con 0x7faaf815bcf0 2024-03-13T21:20:29.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faaf77fe640 1 -- 172.21.15.107:0/3661550588 <== mon.0 v1:172.21.15.107:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 144001742 0 0) 0x7faae0003520 con 0x7faaf815bcf0 2024-03-13T21:20:29.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faaf77fe640 1 -- 172.21.15.107:0/3661550588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaf8071da0 msgr2=0x7faaf80cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:29.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faaf77fe640 1 --2- 172.21.15.107:0/3661550588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaf8071da0 0x7faaf80cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faaf77fe640 1 -- 172.21.15.107:0/3661550588 >> v2:172.21.15.195:3300/0 conn(0x7faaf80afe70 msgr2=0x7faaf80cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:29.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faaf77fe640 1 --2- 172.21.15.107:0/3661550588 >> v2:172.21.15.195:3300/0 conn(0x7faaf80afe70 0x7faaf80cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.824 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faaf77fe640 1 -- 172.21.15.107:0/3661550588 --> v1:172.21.15.107:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf80b0250 con 0x7faaf815bcf0 2024-03-13T21:20:29.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faaf77fe640 1 -- 172.21.15.107:0/3661550588 <== mon.0 v1:172.21.15.107:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1025813135 0 0) 0x7faaec001840 con 0x7faaf815bcf0 2024-03-13T21:20:29.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faaf77fe640 1 -- 172.21.15.107:0/3661550588 >> v1:172.21.15.107:6789/0 conn(0x7faaf815bcf0 legacy=0x7faaf8071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:29.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faaf77fe640 1 --2- 172.21.15.107:0/3661550588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaf8071da0 0x7faae00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faaf77fe640 1 --2- 172.21.15.107:0/3661550588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faae0003f30 0x7faae0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faaf77fe640 1 --2- 172.21.15.107:0/3661550588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faae0004d40 0x7faae00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faaf77fe640 1 -- 172.21.15.107:0/3661550588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faaf815aec0 con 0x7faae0004d40 2024-03-13T21:20:29.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faaf77fe640 1 -- 172.21.15.107:0/3661550588 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faaf815f4e0 con 0x7faae0003f30 2024-03-13T21:20:29.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faaf77fe640 1 -- 172.21.15.107:0/3661550588 --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faae000dbd0 con 0x7faaf8071da0 2024-03-13T21:20:29.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faafd734640 1 --2- 172.21.15.107:0/3661550588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faae0004d40 0x7faae00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faafcf33640 1 --2- 172.21.15.107:0/3661550588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaf8071da0 0x7faae00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.825 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faaf7fff640 1 --2- 172.21.15.107:0/3661550588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faae0003f30 0x7faae0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faafd734640 1 -- 172.21.15.107:0/3661550588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaf8071da0 msgr2=0x7faae00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:29.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faafd734640 1 --2- 172.21.15.107:0/3661550588 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaf8071da0 0x7faae00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faafd734640 1 -- 172.21.15.107:0/3661550588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faae0003f30 msgr2=0x7faae0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:29.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faafd734640 1 --2- 172.21.15.107:0/3661550588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faae0003f30 0x7faae0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.830+0000 7faafd734640 1 -- 172.21.15.107:0/3661550588 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae0003520 con 0x7faae0004d40 2024-03-13T21:20:29.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.831+0000 7faafd734640 1 --2- 172.21.15.107:0/3661550588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faae0004d40 0x7faae00051c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009f90 tx=0x7faae0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be128638ec0cc7a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:29.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.831+0000 7faaf77fe640 1 -- 172.21.15.107:0/3661550588 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0039070 con 0x7faae0004d40 2024-03-13T21:20:29.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.831+0000 7faaf77fe640 1 -- 172.21.15.107:0/3661550588 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaf002cbc0 con 0x7faae0004d40 2024-03-13T21:20:29.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.831+0000 7faaf77fe640 1 -- 172.21.15.107:0/3661550588 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0009c10 con 0x7faae0004d40 2024-03-13T21:20:29.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.832+0000 7faaff197640 1 -- 172.21.15.107:0/3661550588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faae0004d40 msgr2=0x7faae00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:29.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.832+0000 7faaff197640 1 --2- 172.21.15.107:0/3661550588 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faae0004d40 0x7faae00051c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009f90 tx=0x7faae0005830 comp rx=0 tx=0).stop 2024-03-13T21:20:29.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.832+0000 7faafd734640 1 -- 172.21.15.107:0/3661550588 reap_dead start 2024-03-13T21:20:29.826 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.832+0000 7faaff197640 1 -- 172.21.15.107:0/3661550588 shutdown_connections 2024-03-13T21:20:29.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.832+0000 7faaff197640 1 -- 172.21.15.107:0/3661550588 >> 172.21.15.107:0/3661550588 conn(0x7faaf80d0820 msgr2=0x7faaf80d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:29.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.832+0000 7faaff197640 1 -- 172.21.15.107:0/3661550588 shutdown_connections 2024-03-13T21:20:29.827 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.832+0000 7faaff197640 1 -- 172.21.15.107:0/3661550588 wait complete. 2024-03-13T21:20:29.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.833+0000 7faaff197640 1 Processor -- start 2024-03-13T21:20:29.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.833+0000 7faaff197640 1 -- start start 2024-03-13T21:20:29.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaff197640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaf814e390 0x7faaf815caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaff197640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf80b5180 0x7faaf8156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaff197640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaf8156ed0 0x7faaf80b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaff197640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7faaf815ece0 con 0x7faaf80b5180 2024-03-13T21:20:29.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaff197640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7faaf815ea00 con 0x7faaf8156ed0 2024-03-13T21:20:29.829 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaff197640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7faaf815efc0 con 0x7faaf814e390 2024-03-13T21:20:29.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaf7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf80b5180 0x7faaf8156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaf7fff640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf80b5180 0x7faaf8156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33136/0 (socket says 172.21.15.107:33136) 2024-03-13T21:20:29.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaf7fff640 1 -- 172.21.15.107:0/3151421130 learned_addr learned my addr 172.21.15.107:0/3151421130 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-03-13T21:20:29.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faafcf33640 1 --2- 172.21.15.107:0/3151421130 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaf814e390 0x7faaf815caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faafd734640 1 --2- 172.21.15.107:0/3151421130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaf8156ed0 0x7faaf80b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaf7fff640 1 -- 172.21.15.107:0/3151421130 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaf814e390 msgr2=0x7faaf815caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:29.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaf7fff640 1 --2- 172.21.15.107:0/3151421130 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaf814e390 0x7faaf815caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaf7fff640 1 -- 172.21.15.107:0/3151421130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaf8156ed0 msgr2=0x7faaf80b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:29.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaf7fff640 1 --2- 172.21.15.107:0/3151421130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaf8156ed0 0x7faaf80b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:29.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaf7fff640 1 -- 172.21.15.107:0/3151421130 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf815d1d0 con 0x7faaf80b5180 2024-03-13T21:20:29.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faafd734640 1 --2- 172.21.15.107:0/3151421130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaf8156ed0 0x7faaf80b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-13T21:20:29.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaf7fff640 1 --2- 172.21.15.107:0/3151421130 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf80b5180 0x7faaf8156990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faaec007290 tx=0x7faaec007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:29.830 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaf57fa640 1 -- 172.21.15.107:0/3151421130 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec01a070 con 0x7faaf80b5180 2024-03-13T21:20:29.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaf57fa640 1 -- 172.21.15.107:0/3151421130 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaec00f9c0 con 0x7faaf80b5180 2024-03-13T21:20:29.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaff197640 1 -- 172.21.15.107:0/3151421130 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf815d4b0 con 0x7faaf80b5180 2024-03-13T21:20:29.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaf57fa640 1 -- 172.21.15.107:0/3151421130 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec00fdf0 con 0x7faaf80b5180 2024-03-13T21:20:29.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.834+0000 7faaff197640 1 -- 172.21.15.107:0/3151421130 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf815da70 con 0x7faaf80b5180 2024-03-13T21:20:29.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.835+0000 7faaff197640 1 -- 172.21.15.107:0/3151421130 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf8075120 con 0x7faaf80b5180 2024-03-13T21:20:29.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.836+0000 7faaf57fa640 1 -- 172.21.15.107:0/3151421130 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7faaec01d070 con 0x7faaf80b5180 2024-03-13T21:20:29.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.836+0000 7faaf57fa640 1 --2- 172.21.15.107:0/3151421130 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7faae406bc00 0x7faae406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:29.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.836+0000 7faafcf33640 1 --2- 172.21.15.107:0/3151421130 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7faae406bc00 0x7faae406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:29.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.836+0000 7faaf57fa640 1 -- 172.21.15.107:0/3151421130 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7faaec08a1d0 con 0x7faaf80b5180 2024-03-13T21:20:29.831 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.837+0000 7faafcf33640 1 --2- 172.21.15.107:0/3151421130 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7faae406bc00 0x7faae406e0c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faae8009c40 tx=0x7faae8009190 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:29.832 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:29.841+0000 7faaf57fa640 1 -- 172.21.15.107:0/3151421130 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183657 (secure 0 0 0) 0x7faaf806e1c0 con 0x7faaf80b5180 2024-03-13T21:20:30.003 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.012+0000 7faaff197640 1 -- 172.21.15.107:0/3151421130 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faaf8072570 con 0x7faaf80b5180 2024-03-13T21:20:30.005 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.012+0000 7faaf57fa640 1 -- 172.21.15.107:0/3151421130 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7faaec058f80 con 0x7faaf80b5180 2024-03-13T21:20:30.005 INFO:teuthology.orchestra.run.smithi107.stdout:pg_num: 1 2024-03-13T21:20:30.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.014+0000 7faaff197640 1 -- 172.21.15.107:0/3151421130 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7faae406bc00 msgr2=0x7faae406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:30.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.014+0000 7faaff197640 1 --2- 172.21.15.107:0/3151421130 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7faae406bc00 0x7faae406e0c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faae8009c40 tx=0x7faae8009190 comp rx=0 tx=0).stop 2024-03-13T21:20:30.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.014+0000 7faaff197640 1 -- 172.21.15.107:0/3151421130 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf80b5180 msgr2=0x7faaf8156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:30.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.014+0000 7faaff197640 1 --2- 172.21.15.107:0/3151421130 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf80b5180 0x7faaf8156990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7faaec007290 tx=0x7faaec007690 comp rx=0 tx=0).stop 2024-03-13T21:20:30.006 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.014+0000 7faaff197640 1 -- 172.21.15.107:0/3151421130 shutdown_connections 2024-03-13T21:20:30.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.014+0000 7faaff197640 1 --2- 172.21.15.107:0/3151421130 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7faae406bc00 0x7faae406e0c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:30.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.014+0000 7faaff197640 1 --2- 172.21.15.107:0/3151421130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faaf8156ed0 0x7faaf80b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:30.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.014+0000 7faaff197640 1 --2- 172.21.15.107:0/3151421130 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7faaf80b5180 0x7faaf8156990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:30.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.014+0000 7faaff197640 1 --2- 172.21.15.107:0/3151421130 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7faaf814e390 0x7faaf815caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:30.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.014+0000 7faaff197640 1 -- 172.21.15.107:0/3151421130 >> 172.21.15.107:0/3151421130 conn(0x7faaf80d0820 msgr2=0x7faaf80b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:30.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.014+0000 7faaff197640 1 -- 172.21.15.107:0/3151421130 shutdown_connections 2024-03-13T21:20:30.007 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.014+0000 7faaff197640 1 -- 172.21.15.107:0/3151421130 wait complete. 2024-03-13T21:20:30.016 DEBUG:teuthology.orchestra.run.smithi107:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-13T21:20:30.115 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.124+0000 7f47824dc640 1 Processor -- start 2024-03-13T21:20:30.116 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.124+0000 7f47824dc640 1 -- start start 2024-03-13T21:20:30.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.125+0000 7f47824dc640 1 --2- >> v2:172.21.15.195:3300/0 conn(0x7f477c15dec0 0x7f477c0b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:30.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.125+0000 7f47824dc640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f477c06ae00 0x7f477c06b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:30.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.125+0000 7f47824dc640 1 -- --> v1:172.21.15.195:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f477c0b0100 con 0x7f477c162530 2024-03-13T21:20:30.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.125+0000 7f47824dc640 1 -- --> v2:172.21.15.107:3300/0 -- mon_getmap magic: 0 -- 0x7f477c06b770 con 0x7f477c06ae00 2024-03-13T21:20:30.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.125+0000 7f47824dc640 1 -- --> v2:172.21.15.195:3300/0 -- mon_getmap magic: 0 -- 0x7f477c161a50 con 0x7f477c15dec0 2024-03-13T21:20:30.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.125+0000 7f4780a79640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f477c06ae00 0x7f477c06b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:30.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.125+0000 7f4780a79640 1 --2- >> v2:172.21.15.107:3300/0 conn(0x7f477c06ae00 0x7f477c06b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33148/0 (socket says 172.21.15.107:33148) 2024-03-13T21:20:30.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.125+0000 7f4780a79640 1 -- 172.21.15.107:0/1378304572 learned_addr learned my addr 172.21.15.107:0/1378304572 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-03-13T21:20:30.117 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.125+0000 7f477bfff640 1 --2- 172.21.15.107:0/1378304572 >> v2:172.21.15.195:3300/0 conn(0x7f477c15dec0 0x7f477c0b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:30.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.125+0000 7f4780a79640 1 -- 172.21.15.107:0/1378304572 >> v2:172.21.15.195:3300/0 conn(0x7f477c15dec0 msgr2=0x7f477c0b5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-13T21:20:30.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.125+0000 7f4780a79640 1 --2- 172.21.15.107:0/1378304572 >> v2:172.21.15.195:3300/0 conn(0x7f477c15dec0 0x7f477c0b5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:30.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.125+0000 7f4780a79640 1 -- 172.21.15.107:0/1378304572 >> v1:172.21.15.195:6789/0 conn(0x7f477c162530 legacy=0x7f477c0af8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:30.118 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.125+0000 7f4780a79640 1 -- 172.21.15.107:0/1378304572 --> v2:172.21.15.107:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c161d30 con 0x7f477c06ae00 2024-03-13T21:20:30.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.126+0000 7f4780a79640 1 --2- 172.21.15.107:0/1378304572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c06ae00 0x7f477c06b230 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f477c06bb80 tx=0x7f477402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48bd3007d64509e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:30.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.126+0000 7f477affd640 1 -- 172.21.15.107:0/1378304572 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f477402cb20 con 0x7f477c06ae00 2024-03-13T21:20:30.119 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.126+0000 7f477affd640 1 -- 172.21.15.107:0/1378304572 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f477402ccc0 con 0x7f477c06ae00 2024-03-13T21:20:30.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.126+0000 7f477affd640 1 -- 172.21.15.107:0/1378304572 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774034610 con 0x7f477c06ae00 2024-03-13T21:20:30.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.127+0000 7f47824dc640 1 -- 172.21.15.107:0/1378304572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c06ae00 msgr2=0x7f477c06b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:30.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.127+0000 7f47824dc640 1 --2- 172.21.15.107:0/1378304572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c06ae00 0x7f477c06b230 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f477c06bb80 tx=0x7f477402bf80 comp rx=0 tx=0).stop 2024-03-13T21:20:30.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.127+0000 7f47824dc640 1 -- 172.21.15.107:0/1378304572 shutdown_connections 2024-03-13T21:20:30.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.127+0000 7f47824dc640 1 --2- 172.21.15.107:0/1378304572 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c06ae00 0x7f477c06b230 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:30.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.127+0000 7f47824dc640 1 --2- 172.21.15.107:0/1378304572 >> v2:172.21.15.195:3300/0 conn(0x7f477c15dec0 0x7f477c0b5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:30.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.127+0000 7f47824dc640 1 -- 172.21.15.107:0/1378304572 >> 172.21.15.107:0/1378304572 conn(0x7f477c0b28b0 msgr2=0x7f477c0b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-13T21:20:30.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.127+0000 7f47824dc640 1 -- 172.21.15.107:0/1378304572 shutdown_connections 2024-03-13T21:20:30.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.127+0000 7f47824dc640 1 -- 172.21.15.107:0/1378304572 wait complete. 2024-03-13T21:20:30.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.128+0000 7f47824dc640 1 Processor -- start 2024-03-13T21:20:30.120 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.128+0000 7f47824dc640 1 -- start start 2024-03-13T21:20:30.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f47824dc640 1 --2- >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f477c06ae00 0x7f477c153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:30.123 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f47824dc640 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f477c15dec0 0x7f477c155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:30.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f47824dc640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c162530 0x7f477c1483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:30.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f47824dc640 1 -- --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_getmap magic: 0 -- 0x7f477c06d670 con 0x7f477c162530 2024-03-13T21:20:30.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f47824dc640 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 -- 0x7f477c06d4f0 con 0x7f477c15dec0 2024-03-13T21:20:30.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f47824dc640 1 -- --> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] -- mon_getmap magic: 0 -- 0x7f477c06d7f0 con 0x7f477c06ae00 2024-03-13T21:20:30.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f4780a79640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c162530 0x7f477c1483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:30.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f4780a79640 1 --2- >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c162530 0x7f477c1483e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.107:3300/0 says I am v2:172.21.15.107:33150/0 (socket says 172.21.15.107:33150) 2024-03-13T21:20:30.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f4780a79640 1 -- 172.21.15.107:0/3501413811 learned_addr learned my addr 172.21.15.107:0/3501413811 (peer_addr_for_me v2:172.21.15.107:0/0) 2024-03-13T21:20:30.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f477bfff640 1 --2- 172.21.15.107:0/3501413811 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f477c06ae00 0x7f477c153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:30.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f477b7fe640 1 --2- 172.21.15.107:0/3501413811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f477c15dec0 0x7f477c155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:30.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f4780a79640 1 -- 172.21.15.107:0/3501413811 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f477c06ae00 msgr2=0x7f477c153280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:30.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f4780a79640 1 --2- 172.21.15.107:0/3501413811 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f477c06ae00 0x7f477c153280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:30.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f4780a79640 1 -- 172.21.15.107:0/3501413811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f477c15dec0 msgr2=0x7f477c155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:30.124 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f4780a79640 1 --2- 172.21.15.107:0/3501413811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f477c15dec0 0x7f477c155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:30.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f4780a79640 1 -- 172.21.15.107:0/3501413811 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c148920 con 0x7f477c162530 2024-03-13T21:20:30.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f477bfff640 1 --2- 172.21.15.107:0/3501413811 >> [v2:172.21.15.195:3301/0,v1:172.21.15.195:6790/0] conn(0x7f477c06ae00 0x7f477c153280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-13T21:20:30.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f477b7fe640 1 --2- 172.21.15.107:0/3501413811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f477c15dec0 0x7f477c155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-13T21:20:30.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f4780a79640 1 --2- 172.21.15.107:0/3501413811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c162530 0x7f477c1483e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4774036040 tx=0x7f4774004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:30.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f4778ff9640 1 -- 172.21.15.107:0/3501413811 <== mon.0 v2:172.21.15.107:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774043020 con 0x7f477c162530 2024-03-13T21:20:30.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f4778ff9640 1 -- 172.21.15.107:0/3501413811 <== mon.0 v2:172.21.15.107:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f477403e450 con 0x7f477c162530 2024-03-13T21:20:30.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f47824dc640 1 -- 172.21.15.107:0/3501413811 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f477c153860 con 0x7f477c162530 2024-03-13T21:20:30.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f4778ff9640 1 -- 172.21.15.107:0/3501413811 <== mon.0 v2:172.21.15.107:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4774009510 con 0x7f477c162530 2024-03-13T21:20:30.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.129+0000 7f47824dc640 1 -- 172.21.15.107:0/3501413811 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f477c153e20 con 0x7f477c162530 2024-03-13T21:20:30.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.131+0000 7f47824dc640 1 -- 172.21.15.107:0/3501413811 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f477c075120 con 0x7f477c162530 2024-03-13T21:20:30.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.131+0000 7f4778ff9640 1 -- 172.21.15.107:0/3501413811 <== mon.0 v2:172.21.15.107:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f4774046020 con 0x7f477c162530 2024-03-13T21:20:30.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.131+0000 7f4778ff9640 1 --2- 172.21.15.107:0/3501413811 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f476806bbd0 0x7f476806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-13T21:20:30.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.131+0000 7f4778ff9640 1 -- 172.21.15.107:0/3501413811 <== mon.0 v2:172.21.15.107:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f47740acdb0 con 0x7f477c162530 2024-03-13T21:20:30.125 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.131+0000 7f477bfff640 1 --2- 172.21.15.107:0/3501413811 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f476806bbd0 0x7f476806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-13T21:20:30.126 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.132+0000 7f477bfff640 1 --2- 172.21.15.107:0/3501413811 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f476806bbd0 0x7f476806e090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f476c009ac0 tx=0x7f476c008040 comp rx=0 tx=0).ready entity=mgr.4113 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-13T21:20:30.127 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.136+0000 7f4778ff9640 1 -- 172.21.15.107:0/3501413811 <== mon.0 v2:172.21.15.107:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+183657 (secure 0 0 0) 0x7f477404d030 con 0x7f477c162530 2024-03-13T21:20:30.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.311+0000 7f47824dc640 1 -- 172.21.15.107:0/3501413811 --> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f477c072350 con 0x7f477c162530 2024-03-13T21:20:30.302 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.311+0000 7f4778ff9640 1 -- 172.21.15.107:0/3501413811 <== mon.0 v2:172.21.15.107:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f477c148920 con 0x7f477c162530 2024-03-13T21:20:30.303 INFO:teuthology.orchestra.run.smithi107.stdout: 2024-03-13T21:20:30.303 INFO:teuthology.orchestra.run.smithi107.stdout:[ 2024-03-13T21:20:30.303 INFO:teuthology.orchestra.run.smithi107.stdout: { 2024-03-13T21:20:30.303 INFO:teuthology.orchestra.run.smithi107.stdout: "poolnum": 1, 2024-03-13T21:20:30.303 INFO:teuthology.orchestra.run.smithi107.stdout: "poolname": ".mgr" 2024-03-13T21:20:30.303 INFO:teuthology.orchestra.run.smithi107.stdout: } 2024-03-13T21:20:30.303 INFO:teuthology.orchestra.run.smithi107.stdout:] 2024-03-13T21:20:30.304 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.313+0000 7f47824dc640 1 -- 172.21.15.107:0/3501413811 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f476806bbd0 msgr2=0x7f476806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:30.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.313+0000 7f47824dc640 1 --2- 172.21.15.107:0/3501413811 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f476806bbd0 0x7f476806e090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f476c009ac0 tx=0x7f476c008040 comp rx=0 tx=0).stop 2024-03-13T21:20:30.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.313+0000 7f47824dc640 1 -- 172.21.15.107:0/3501413811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c162530 msgr2=0x7f477c1483e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-13T21:20:30.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.313+0000 7f47824dc640 1 --2- 172.21.15.107:0/3501413811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c162530 0x7f477c1483e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4774036040 tx=0x7f4774004a40 comp rx=0 tx=0).stop 2024-03-13T21:20:30.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.313+0000 7f47824dc640 1 -- 172.21.15.107:0/3501413811 shutdown_connections 2024-03-13T21:20:30.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.313+0000 7f47824dc640 1 --2- 172.21.15.107:0/3501413811 >> [v2:172.21.15.107:6832/2492220276,v1:172.21.15.107:6833/2492220276] conn(0x7f476806bbd0 0x7f476806e090 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:30.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.313+0000 7f47824dc640 1 --2- 172.21.15.107:0/3501413811 >> [v2:172.21.15.107:3300/0,v1:172.21.15.107:6789/0] conn(0x7f477c162530 0x7f477c1483e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:30.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-13T21:20:30.313+0000 7f47824dc640 1 --2- 172.21.15.107:0/3501413811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f477c15dec0 0x7f477c155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-13T21:20:30.305 INFO:teuthology.orchestra.run.smithi107.stderr:2024-03-